HLL 0.1-TX
Grades, item by item
Every graded answer, every axis, every citation check. Scores are mechanical and recomputable. Public-split items show the blinded facts and the model's full answer; private-split items show scores and notes only. Weights: Standard 2, Authority 2, Outcome 2, Quote fidelity 2. A fabricated citation caps the item at 25%.
watch live|all runsdeepseek/deepseek-v4-flash · rawdeepseek/deepseek-v4-flash · juiceddeepseek/deepseek-v4-flash · dr2upstage/solar-pro4 · rawupstage/solar-pro4 · dr2openai/gpt-oss-120b · rawopenai/gpt-oss-20b · rawopenai/gpt-oss-120b · dr2openai/gpt-oss-20b · dr2google/gemini-3.7-flash · rawgoogle/gemini-3.7-flash · dr2
administrativeappellate-mandamusappellate-procedurearbitrationassault-iiedauto-accidentauto-insurance-uimchild-custodychild-supportcivil-litigationconstitutionalconstructionconsumer-dtpacontractsconversioncps-terminationcriminaldefamationdiscoverydivorce-propertyeasements-boundarieselectionseminent-domainemploymentevictionevidencefamilyforeclosurefraudgovernment-municipalgroundwaterhabeashealthcare-medmalhoa-condohomicideineffective-assistanceinsurancejurisdiction-traplaborlandlord-tenantlegal-malpracticelimitationsnuisance-trespassoil-gasopen-recordsotherpersonal-injurypremises-liabilityprobateproducts-liabilityprofessional-responsibilityreal-estate-brokersreal-propertyschool-lawsearch-seizuresovereign-immunitysummary-judgmenttaxtheft-fraud-crimestorttortious-interferencetruckingvenue-forumworkers-compwrongful-death
50%hll-cl11221159-4constructiondifficulty 5private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found390 S.W.3d 289 · in DocketRouter index
found539 S.W.3d 252 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
28053ms · graded 2026-08-28 22:23
50%hll-cl11221159-3constructiondifficulty 3private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found246 S.W.3d 621 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
27769ms · graded 2026-08-28 22:22
25%hll-cl11221159-1constructiondifficulty 4private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity0%×2
Citation checks
in opinion518 S.W.3d 318
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: TxDOT; it contains no requirement of direct contractual privity. Work is performed
unsupported for: TxDOT when it is done to fulfill TxDOT's statutory duties or under TxDOT’s oversight, approval, and standards pursuant to an intergovernmen
unsupported for: TxDOT. Furthermore, general road construction and the installation of integrated traffic signals fall squarely within the ordinary meaning
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
26394ms · graded 2026-08-28 22:22
50%hll-cl11221159-3constructiondifficulty 3private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found82 S.W.3d 322 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
21628ms · graded 2026-08-28 21:17
50%hll-cl11221159-4constructiondifficulty 5private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found833 S.W.2d 108 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
13602ms · graded 2026-08-28 21:17
25%hll-cl11221159-1constructiondifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity33%×2
Citation checks
unverified624 S.W.3d 214 · verifier request budget exhausted
found381 S.W.3d 430 · in DocketRouter index
found710 S.W.2d 59 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: highway, road, or street for the Texas Department of Transportation
unsupported for: A contractor who constructs or repairs a highway, road, or street for the Texas Department of Transportation is not liable to a claimant for
no passage710 S.W.2d 59 for: requirement into Section 97.002. The statute uses the phrase *
unsupported for: a contractor *under direct contract with* TxDOT.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
23564ms · graded 2026-08-28 21:17
25%hll-cl11221159-4constructiondifficulty 5private splitopenai/gpt-oss-20b · dr2
Axes
Outcome50%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found598 F.3d 388 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
37446ms · graded 2026-08-28 14:43
67%hll-cl11221159-3constructiondifficulty 3private splitopenai/gpt-oss-20b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found84 S.W.3d 198 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
supported for: construction or repair of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
52218ms · graded 2026-08-28 14:42
33%hll-cl11221159-1constructiondifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
in opinion679 S.W.3d 254
Quote fidelity (every quotation must exist verbatim in its source)
supported for: for the Texas Department of Transportation
supported for: for the Texas Department of Transportation
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
39422ms · graded 2026-08-28 14:42
25%hll-cl11221159-4constructiondifficulty 5private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: conclusively establish compliance with contract documents material to the proximate cause
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
56896ms · graded 2026-08-28 13:49
50%hll-cl11221159-3constructiondifficulty 3private splitopenai/gpt-oss-120b · dr2
Axes
Outcome50%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
supported for: constitutes the construction or repair of a highway for TxDOT
supported for: construction or repair of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
20661ms · graded 2026-08-28 13:48
67%hll-cl11221159-1constructiondifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
in opinion679 S.W.3d 254
in opinion627 S.W.3d 163
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street … for
supported for: construction or repair of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
52641ms · graded 2026-08-28 13:48
50%hll-cl11221159-4constructiondifficulty 5private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found164 S.W.3d 656 · in DocketRouter index
found113 S.W.3d 340 · in DocketRouter index
found353 S.W.3d 128 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
58111ms · graded 2026-08-28 11:28
67%hll-cl11221159-3constructiondifficulty 3private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found164 S.W.3d 656 · in DocketRouter index
found690 S.W.2d 546 · in DocketRouter index
found84 S.W.3d 212 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported164 S.W.3d 656 for: the construction or repair of a highway, road, or street
supported690 S.W.2d 546 for: the construction or repair of a highway, road, or street
supported for: construction or repair of a highway,
supported for: construction … of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
36322ms · graded 2026-08-28 11:27
50%hll-cl11221159-1constructiondifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion627 S.W.3d 163
in opinion511 S.W.3d 28
in opinion679 S.W.3d 254
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
33781ms · graded 2026-08-28 11:26
50%hll-cl11221159-4constructiondifficulty 5private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
59589ms · graded 2026-08-28 10:31
50%hll-cl11221159-3constructiondifficulty 3private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found84 S.W.3d 198 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
50819ms · graded 2026-08-28 10:30
50%hll-cl11221159-1constructiondifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion679 S.W.3d 254
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
30764ms · graded 2026-08-28 10:30
0%hll-cl11221159-4constructiondifficulty 5private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
50782ms · graded 2026-08-28 09:37
0%hll-cl11221159-3constructiondifficulty 3private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
48285ms · graded 2026-08-28 09:37
0%hll-cl11221159-1constructiondifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
33685ms · graded 2026-08-28 09:37
25%hll-cl11221159-4constructiondifficulty 5private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity33%×2
Citation checks
found352 S.W.3d 1 · in CourtListener bulk table
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: conclusively established compliance with contract documents material to the proximate cause of the accident.
supported for: constructs or repairs a highway, road, or street for the Texas Department of Transportation
unsupported for: unless the plaintiff proves that the contractor’s work was the proximate cause of the injury.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
61035ms · graded 2026-08-28 08:29
67%hll-cl11221159-1constructiondifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street.
supported for: construction or repair of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
7886ms · graded 2026-08-28 08:28
67%hll-cl11221159-3constructiondifficulty 3private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
unverified567 S.W.3d 123 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
supported for: construction or repair of a highway, road, or street
supported for: construction or repair of a highway, road, or street
supported for: construction or repair of a highway, road, or street
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
4799ms · graded 2026-08-28 08:28
25%hll-cl11221159-3constructiondifficulty 3private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity43%×2
Citation checks
found82 S.W.3d 314 · in DocketRouter index
found353 S.W.3d 128 · in DocketRouter index
found589 S.W.2d 671 · in DocketRouter index
unverified38 S.W.3d 637 · verifier request budget exhausted
unverified39 S.W.3d 107 · verifier request budget exhausted
unverified232 S.W.3d 584 · verifier request budget exhausted
found404 S.W.3d 552 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
unsupported for: within the meaning of the statute; (2) it
unsupported for: in the § 97.002 context, but the term is construed in light of the statute's purpose: to protect contractors performing infrastructure work
unsupported for: alone and encompasses roads and streets that are part of the public transportation network. *See* Black's Law Dictionary (11th ed. 2019) (d
supported for: Construction or Repair of a Highway, Road, or Street
supported for: construction … of a highway, road, or street
unsupported for: of a tollway does not remove it from the category of
no passage38 S.W.3d 637 for: TxDOT. The work here is performed on a project that is part of TxDOT's broader tollway initiative, with TxDOT retaining approval authority
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
140490ms · graded 2026-08-28 07:09
50%hll-cl11221159-4constructiondifficulty 5private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found113 S.W.3d 340 · in DocketRouter index
unverified9 S.W.3d 748 · verifier rate-limited
found589 S.W.2d 671 · in DocketRouter index
found881 S.W.2d 288 · in DocketRouter index
found82 S.W.3d 314 · in DocketRouter index
unverified973 S.W.2d 659 · verifier rate-limited
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
27462ms · graded 2026-08-28 07:07
25%hll-cl11221159-1constructiondifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity60%×2
Citation checks
unverified853 S.W.2d 910 · verifier request budget exhausted
unverified316 S.W.3d 294 · verifier request budget exhausted
found569 S.W.3d 841 · in DocketRouter index
found164 S.W.3d 656 · in DocketRouter index
unverified268 S.W.3d 779 · verifier request budget exhausted
found327 S.W.3d 118 · in DocketRouter index
found82 S.W.3d 314 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street.
no passage569 S.W.3d 841 for: is not defined in the statute, and Texas courts generally interpret
supported327 S.W.3d 118 for: for the Texas Department of Transportation.
unsupported for: submit plans for TxDOT review and approval.
unsupported for: which, under ordinary meaning, encompasses work performed on behalf of or subject to the authority of TxDOT, even absent direct contractual
supported for: construction or repair of a highway, road, or street,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
31990ms · graded 2026-08-28 07:06
0%hll-cl11221159-4constructiondifficulty 5private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
62657ms · graded 2026-08-28 06:56
25%hll-cl11221159-3constructiondifficulty 3private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity75%×2
Citation checks
found92 S.W.3d 477 · in DocketRouter index
found353 S.W.3d 128 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
unsupported for: A contractor who constructs or repairs a highway, road, or street for the Texas Department of Transportation is not liable to a claimant for
supported for: construction or repair of a highway, road, or street.
supported for: construction or repair of a highway, road, or street.
supported for: construction or repair of a highway, road, or street
unsupported for: requires a contractual relationship with the Department
supported for: construction or repair of a highway, road, or street,
supported for: construction or repair of a highway, road, or street,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
23541ms · graded 2026-08-28 06:55
21%hll-cl11221159-1constructiondifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority63%×2
Quote fidelity0%×2
Citation checks
found406 S.W.3d 539 · in DocketRouter index
found8 S.W.3d 636 · in DocketRouter index
found146 S.W.3d 637 · in DocketRouter index
unverified570 S.W.3d 691 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the Texas Department of Transportation (TxDOT) on a
unsupported for: at the direction of and under contract with
unsupported for: it would likely remand for consideration of whether the contractors’ work constituted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
13876ms · graded 2026-08-28 06:55
0%hll-flp11221159-2constructiondifficulty 4private splitblankdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
46107ms · graded 2026-08-27 21:11
88%hll-flp11221159-1constructiondifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity100%×2
Citation checks
in opinion511 S.W.3d 28
found381 S.W.3d 525 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage381 S.W.3d 525 for: does not require a direct contractual relationship with TxDOT
no passage381 S.W.3d 525 for: a contractor’s work is ‘for’ TxDOT when the work is performed on a highway, road, or street that is part of the state highway system and the
supported for: for the Texas Department of Transportation
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
18142ms · graded 2026-08-27 21:10
17%hll-flp11221159-2constructiondifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity50%×2
Citation checks
found501 S.W.3d 71 · in DocketRouter index
found8 S.W.3d 636 · in DocketRouter index
unverified257 S.W.3d 705 · search unavailable
Quote fidelity (every quotation must exist verbatim in its source)
supported for: construction or repair of a highway, road, or street
unsupported for: A contractor who constructs or repairs a highway, road, or street for the Texas Department of Transportation is not liable to a claimant for
no passage501 S.W.3d 71 for: The plain language of section 97.002 requires that the contractor be one who constructs or repairs a highway, road, or street ‘for’ TxDOT. A
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
120244ms · graded 2026-08-27 19:02
0%hll-flp11221159-1constructiondifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
118988ms · graded 2026-08-27 19:01