The following analysis will address how Westlaw.com (CLASSIC), Westlaw Next (NEXT), Lexis.com (LEXIS) and Lexis Advance (ADVANCE) performed using a the same search (only modified to account for differences with how the platforms interpret search language). I used both Natural Language and Terms and Connectors searches and depending on how your preferences are set, your results may differ from what I report.
I began from an ALR article, When Statute of Limitations Commences to Run Against Promise to Pay Debt “When Able,” “When Convenient,” or the like. (67 ALR5th 479).
This article suggested the following searches:
Terms and Connectors: limitations /s (commence* begin* began start!) /s (debt note money repay repayment) /s (“when able” “when convenient” “when possible” “when practicable”)
On Lexis this would become: limitations w/s (commence* or begin* or began or start!) w/s (debt or note or money or repay or repayment) w/s (“when able” or “when convenient” or “when practicable” or “when possible”)
Natural Language: when does statute of limitations period commence, begin, or start when time for repayment of a debt or note is “when able” “when convenient” “when possible” “when practicable”
Natural Language Searching: Westlaw
I ran the ALR suggested search in the following databases on CLASSIC:
- All Federal & State Cases (ALLCASES)
- United States Code Annotated (USCA)
- State Statutes – Annotated (ST-ANN-ALL)
- American Law Reports (ALR)
- American Jurisprudence – All (AMJUR-ALL)
- Corpus Juris Secundum (CJS)
However, I found the suggested Natural Language search did not produce as good of results as a simplified version of it:
“statute of limitations” commences, begins, starts, toll debt “when able” “when convenient” “when possible” “when practicable”
CLASSIC limits results for Natural Language searching to up to 100 results, I had my preferences set to 60.
The results were relevant to the search, although most of the documents came from secondary sources, then statutes, and then cases. Since there is no way to filter the results on CLASSIC, I had to scroll through all the screens to find the cases mixed in with the secondary source material and code sections.
Only one case appeared on the first screen of cites, but it was the ALR model case, Dewey v. Tabor, 226 Mich.App. 189, 572 N.W.2d 715, 67 A.L.R.5th 737, showing up as document #18. However, slightly editing the search produced very different results. If I included the words “pay” or “repayment” the results were skewed to the point that Dewey v. Tabor was pushed down to #43 in the results set.
Right-clicking on the “View All Results” from the ResultsPlus sidebar allowed me to open a new tab with these hits. This list included 14 secondary sources, some of which were also in my main results screen.
NEXT at first returned tens of thousands of results, many of them useless, but this was before I limited my databases and edited the search.
Taking advantage of the Favorites section allows a user to add any database to their list of most used sources and then conduct a search in those databases (one does this by hovering over the title and clicking on the “star” that appears). I selected the same databases I had used in CLASSIC.
I also edited the search using the “+” sign, which tells NEXT that the term must be given extra weight. The search I settled on was:
+”statute of limitations” commences, begins, starts, toll +debt “when able” “when convenient” “when possible” “when practicable”
This search did much better, returning the case used by the ALR at the top of the Overview and offering other cases on point. The other results were generally relevant, but with over 1500 hits these results were of limited benefit beyond the first few screens:
- 34 Cases
- 38 Statutes & Court Rules
- 134 American Jurisprudence Trials
- 185 American Jurisprudence Proof of Facts
- 270 American Jurisprudence 2d
- 1,164 American Law Reports
- 251 Corpus Juris Secundum
Natural Language Searching: Lexis
Using LEXIS I chose comparable libraries used on CLASSIC:
- Federal & State Cases, Combined
- United States Code Service – Titles 1 through 51
- State Codes, Constitutions, Court Rules & ALS, Combined
- Jurisprudences & Encyclopedias, Combined
LEXIS forces you to limit your results to up 250, which I did and using the same search as I ran on Westlaw yielded the following:
- 29 Cases
- 188 Statutes & Legislation
- 33 Treatises and Analytical Materials
I improved on these results after simplifying the search:
limitations commence repayment debt “when able” “when convenient” “when possible” “when practicable”
The example case from the ALR article most relevant to this question was within the first 5 cases. The secondary sources had several relevant articles mainly from AmJur 2d, as well as Limitation of Actions (Matthew Bender) and state-specific jurisprudence titles.
On ADVANCE I further modified the search to:
“statute of limitations” repay debt “when able” “when convenient” “when possible” “when practicable”
- 1,037,765 Cases
- 282,593 Statutes & Legislation
- 230,301 Treatises and Analytical Materials
The search might still be improved to lower the number of results, but in my discussions with the Lexis developers they admit that large numbers of results are often returned using ADVANCE. With ADVANCE’s method of filtering the results the large result set is not perceived as a major problem. Even so, 1 million cases is a grossly impractical number of hits.
That said, the first screen did have the most relevant cases including the sample case from the ALR article.
Terms and Connectors Searching (T&C): Westlaw
Search used: limitations /s (commence* begin* began start!) /s (debt note money repay repayment) /s (“when able” “when convenient” “when possible” “when practicable”)
I limited this search to the following databases:
- All Federal & State Cases (ALLCASES)
- United States Code Annotated (USCA)
- State Statutes – Annotated (ST-ANN-ALL)
- American Law Reports (ALR)
- American Jurisprudence – All (AMJUR-ALL)
- Corpus Juris Secundum (CJS)
This search on CLASSIC yielded 95 results, sorted according to these content types: Codes (alpha); Cases (reverse-chronological); Secondary Sources (alpha). The sample case used in the ALR article was on the first screen and the same ResultsPlus sources showed up along the right edge (right clicking on any of these will open these documents in a separate tab without losing your original results or search).
Generally the results were on-point and easily navigable, although CLASSIC complained about the phrase “when able” and suggested “when ABIL” instead, which I ignored.
NEXT returned fewer results but everything was on-point:
- 3 Corpus Juris Secundum
- 1 American Jurisprudence Trials
- 9 American Jurisprudence Proof of Facts
- 6 American Jurisprudence 2d
- 29 American Law Reports
- 0 Statutes & Court Rules
- 11 Cases
The one questionable result was returning zero state statutes.
Terms and Connectors Searching (T&C): Lexis
Search used: limitations w/s (commence* or begin* or began or start!) w/s (debt or note or money or repay or repayment) w/s (“when able” or “when convenient” or “when practicable” or “when possible”)
ADVANCE’s result set included:
- 14 Cases
- 18 Statutes & Regulations
- 7 Treatises and Analytical Materials
Most of the secondary sources hits came from AmJur 2d but they also included one on-point law review article. While several of the AmJur 2d articles cited the ALR that dealt extensively with this issue, the ALR article itself was not included in the results. In my talks with the Head of Platform Development at Lexis I was told that the process of migrating content over to ADVANCE is ongoing and the ALR content should be there in the coming months.
The ALR model case appeared early in the list of cases and the other cases were well focused on the issue.
LEXIS returned many more hits than ADVANCE but overall the results contained a much higher percentage of off-topic hits:
- 29 Cases
- 511 Statutes & Regulations
- 29 Treatises and Analytical Materials
The model case from the ALR did turn up but much lower in the results list although still appearing on the first screen. The problem was in the code and regulation sections – many, if not most, of these were not on point. This was also the case with the secondary sources. While there were some good articles, most of the hits were chaff.
The reason why the results were far less precise and returned a higher number of irrelevant hits was rooted in the fact that the term “when” was ignored as a stop-word by Lexis.com and “repay” was treated as “re pay” – this skewed the results significantly.
I changed the search to limitations w/15 (commence* or begin* or began or start!) w/30 (debt or note or money or repayment) w/15 (“when able” or “when convenient” or “when practicable” or “when possible”) which yielded much more targeted results, although with fewer hits overall:
- 8 Cases
- 28 Statutes & Regulations (Legislative)
- 8 Treatises & Analytical Materials
LEXIS still complained about the search term “when”, but the phrase “when able” was returned as part of the title of the ALR article that was the basis of my search.
Using the adjusted T&C search, ADVANCE returned one more case but fewer in the other categories:
- 9 Cases
- 19 Statutes & Regulations (Legislative)
- 7 Treatises & Analytical Materials
Conclusion
I found both NEXT and ADVANCE very impressive and generally represent an improvement over CLASSIC and LEXIS. But I would qualify that assessment by stating that both platforms appeared to produced more focused result sets using Terms and Connectors as opposed to Natural Language searching. However maximizing these platforms is a training issue and not an inherent weakness.