Evaluation report

What is measured here is the engine: the law it retrieves, the check of every citation at its reporter location, and the gate every paper passes. A language model drafts; the engine decides what reaches you. Every result is stated with its sample size, its run date and the record it was read from.

Kit 9.27 · evidence built September 13, 2026

Download the evaluation dataSecurity evidence

Results at a glance

Headline evaluation results with sample sizes, rates and run dates
EvaluationResultRate
Citations in a filed briefverified against the reporter · August 28, 202690 of 90100%
Citations in the engine’s answerschecked before output, none fabricated · September 10, 2026313 of 313100%
Invented citationscaught before output · September 13, 202617 of 17100%
Real citationsconfirmed at the reporter · September 13, 202634 of 3597.1%
Held-out drafting defectscaught by 6 safeguards · September 13, 202688 of 88100%
Held-out clean draftsleft alone · September 13, 202668 of 68100%

The engine’s answers were drafted by an open-weight language model, quantized to run on one workstation GPU we own. The engine does not take any model’s word for a citation: each one is checked at the reporter before it can reach you, so these results measure the engine rather than what a model remembers.

Citation integrity

A model writes citations; the engine checks each one at its reporter location before it can reach a draft. A citation that verifies is kept, one that cannot be verified is struck, and a fabricated citation does not reach the answer.

Citations the model offered in the engine's answers, and what the engine let through
The engine’s answersCitations offeredVerified and keptStruck as unverifiedFabricated in the answer
Grounded in retrieved law, 40 answers747040
Drafted without retrieval, 39 answers239209300
Citation check on a labelled set of real and invented citations
Labelled setResultRate
Real citations confirmed34 of 3597.1%
Invented citations caught17 of 17100%

Answers measured September 10, 2026. 10 reporter formats covered. Resolved against 18,123,757 reporter citations and 77,481,570 citation links.

Held-out defect detection

Each safeguard is graded on phrasings it was not built from. Every phrasing is then pinned as a drill that runs on every build.

Defects caught and clean drafts left alone by each drafting safeguard on held-out items
SafeguardItemsDefects caughtClean drafts left alone
Placeholders4424 of 2420 of 20
Relative dates3118 of 1813 of 13
Personal identifiers2111 of 1110 of 10
Exhibits159 of 96 of 6
Arithmetic2614 of 1412 of 12
Unsourced claims in chat1912 of 127 of 7
All 615688 of 8868 of 68

74 stages in 10 lanes

Every paper passes through the filing gate before it can be marked ready to file. Stages by lane, measured September 8, 2026.

  • Authority and citation18
  • Argument and craft15
  • Form, forum and filing9
  • Source and provenance8
  • Adversarial review7
  • Exhibits and service5
  • Release control5
  • Dates and clocks3
  • Parties and privacy2
  • Numbers2

Proven before it ships

Each release is tested against the defects it guards and installed as a client would install it before it is published.

213
safeguards in the kit, each shown catching its defect before it ships
the count cannot fall; floor raised September 12, 2026
97 of 97
engine witnesses passed, over 45 filing checks
kit 9.27
10 of 10
install steps passed in a clean-room rehearsal
version 9.27: 70 probes, 76 seconds
160
security test cases in 14 suites
102 test files in the platform

The corpus

Holdings measured September 12, 2026.

9,427,210
court opinions, federal and state, full text
77,481,570
citation links between them
18,123,757
reporter citations, each resolvable
123,321
treatise paragraphs, indexed to the page

Bracton, De Legibus et Consuetudinibus Angliae · Coke, Institutes of the Lawes of England · Blackstone, Commentaries — all four volumes · Story, Commentaries on Equity Jurisprudence · Pomeroy, Equity Jurisprudence · Black's Law Dictionary, 4th edition · Bouvier's Law Dictionary, 1856 · Vattel, The Law of Nations · Grotius, De Jure Belli ac Pacis

The build record

Measured from the repositories when this report was built.

1,964
commits to the legal engine
since March 20, 2026
336
commits to the platform
since March 25, 2026
177
days from the first commit to this report
102
automated test files in the platform

Sources

Each group of figures is read from the record named here, with the SHA-256 of that record when this page was built.

Source record and SHA-256 for each group of figures
FiguresRecordSHA-256
Citation existenceCitation existence test results89d2460446a4…
Filed brief, held-out tests, gate, releaseFiled-brief firewall record0f08fe3d2efa…
Citations, grounded answersCitation resolver run: grounded answerse1aac54ef2bd…
Citations, drafted without retrievalCitation resolver run: answers drafted without retrievalff7f97a13844…
CorpusPublished corpus figures55fe4f14c107…
CorpusCorpus holdings recordfa8e2beca877…

Every figure, with the record behind it.

Download the evaluation dataRequest access

Gage Law

Gage Green Group · Established 2009

HomeAboutMethodologyProofSecurityCorpusTrustPricingTermsPrivacylaw@gagegreengroup.com

Gage Law provides legal research tools, document preparation, and intelligence services. Gage Law does not provide legal advice, attorney representation, or guarantee any legal outcome. No attorney-client relationship is formed by use of this platform. Users are responsible for verifying all information and consulting qualified legal counsel before taking action.

All information is derived from primary source law, public records, and filed court documents. Results depend on the quality of input and the specific circumstances of each matter. Past performance of the platform does not guarantee future results.

By using this service, you acknowledge that you have read and agree to our Terms of Service and Privacy Policy.