HLL 0.1-TX

Grades, item by item

Every graded answer, every axis, every citation check. Scores are mechanical and recomputable. Public-split items show the blinded facts and the model's full answer; private-split items show scores and notes only. Weights: Standard 2, Authority 2, Outcome 2, Quote fidelity 2. A fabricated citation caps the item at 25%.

watch live|all runs deepseek/deepseek-v4-flash · raw deepseek/deepseek-v4-flash · juiced deepseek/deepseek-v4-flash · dr2 upstage/solar-pro4 · raw upstage/solar-pro4 · dr2 openai/gpt-oss-120b · raw openai/gpt-oss-20b · raw openai/gpt-oss-120b · dr2 openai/gpt-oss-20b · dr2 google/gemini-3.7-flash · raw google/gemini-3.7-flash · dr2

administrative appellate-mandamus appellate-procedure arbitration assault-iied auto-accident auto-insurance-uim child-custody child-support civil-litigation constitutional construction consumer-dtpa contracts conversion cps-termination criminal defamation discovery divorce-property easements-boundaries elections eminent-domain employment eviction evidence family foreclosure fraud government-municipal groundwater habeas healthcare-medmal hoa-condo homicide ineffective-assistance insurance jurisdiction-trap labor landlord-tenant legal-malpractice limitations nuisance-trespass oil-gas open-records other personal-injury premises-liability probate products-liability professional-responsibility real-estate-brokers real-property school-law search-seizure sovereign-immunity summary-judgment tax theft-fraud-crimes tort tortious-interference trucking venue-forum workers-comp wrongful-death

50%hll-cl11080877-4labordifficulty 4private splitgoogle/gemini-3.7-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

found133 S.W.3d 217 · in DocketRouter index

in opinion852 S.W.2d 440

in opinion432 U.S. 333

in opinion554 U.S. 269

in opinion925 S.W.2d 696

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

32630ms · graded 2026-08-28 20:16

88%hll-cl11080877-1labordifficulty 4private splitgoogle/gemini-3.7-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority75%×2

Quote fidelity-×2

Citation checks

in opinion512 U.S. 246

in opinion486 U.S. 399

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

38022ms · graded 2026-08-28 20:15

50%hll-cl11080877-4labordifficulty 4private splitgoogle/gemini-3.7-flash · raw

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

in opinion852 S.W.2d 440

in opinion432 U.S. 333

in opinion146 S.W.3d 79

in opinion925 S.W.2d 696

found308 S.W.3d 909 · in DocketRouter index

in opinion554 U.S. 269

found133 S.W.3d 217 · in DocketRouter index

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

17403ms · graded 2026-08-28 18:54

25%hll-cl11080877-1labordifficulty 4private splitgoogle/gemini-3.7-flash · raw

Axes

Outcome100%×2

Standard-×2

Authority75%×2

Quote fidelity0%×2

Citation checks

in opinion512 U.S. 246

in opinion486 U.S. 399

unverified691 S.W.3d 442 · verifier rate-limited

found536 F.3d 344 · in CourtListener bulk table

found133 S.W.3d 217 · in DocketRouter index

unverified245 S.W.3d 609 · verifier rate-limited

Quote fidelity (every quotation must exist verbatim in its source)

unsupported512 U.S. 246 for: (interpretation or application of existing CBAs). *Hawaiian Airlines, Inc. v. Norris*, 512 U.S. 246, 252–53 (1994). A state-law claim is pr

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

18362ms · graded 2026-08-28 18:54

50%hll-cl11080877-4labordifficulty 4private splitopenai/gpt-oss-20b · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

found474 U.S. 900 · in DocketRouter index

found168 S.W.3d 802 · in DocketRouter index

found463 S.W.3d 42 · in DocketRouter index

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

23447ms · graded 2026-08-28 12:36

0%hll-cl11080877-1labordifficulty 4private splitopenai/gpt-oss-20b · dr2

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity0%×2

Citation checks

found312 U.S. 52 · in DocketRouter index

found481 U.S. 41 · in DocketRouter index

found359 U.S. 236 · in DocketRouter index

found505 U.S. 504 · in DocketRouter index

found518 U.S. 470 · in DocketRouter index

Quote fidelity (every quotation must exist verbatim in its source)

unsupported for: involve the interpretation or application of a collective bargaining agreement

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

40616ms · graded 2026-08-28 12:33

50%hll-cl11080877-4labordifficulty 4private splitopenai/gpt-oss-120b · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

found746 F.2d 839 · in DocketRouter index

found945 S.W.2d 812 · in DocketRouter index

found307 S.W.3d 762 · in DocketRouter index

found168 S.W.3d 802 · in DocketRouter index

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

49448ms · graded 2026-08-28 11:54

0%hll-cl11080877-1labordifficulty 4private splitopenai/gpt-oss-120b · dr2

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity0%×2

Citation checks

found359 U.S. 236 · in DocketRouter index

Quote fidelity (every quotation must exist verbatim in its source)

unsupported for: necessitates the interpretation of a collective‑bargaining agreement

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

98746ms · graded 2026-08-28 11:52

0%hll-cl11080877-1labordifficulty 4private splitopenai/gpt-oss-20b · raw

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

no citations offered

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

180009ms · graded 2026-08-28 09:25

0%hll-cl11080877-4labordifficulty 4private splitblankopenai/gpt-oss-20b · raw

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

no citations offered

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

31467ms · graded 2026-08-28 09:23

50%hll-cl11080877-4labordifficulty 4private splitupstage/solar-pro4 · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

in opinion432 U.S. 333

in opinion422 U.S. 490

found477 U.S. 274 · in DocketRouter index

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

26543ms · graded 2026-08-28 08:38

50%hll-cl11080877-1labordifficulty 4private splitupstage/solar-pro4 · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

found359 U.S. 236 · in DocketRouter index

in opinion372 U.S. 682

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

37605ms · graded 2026-08-28 08:35

0%hll-cl11080877-4labordifficulty 4private splitopenai/gpt-oss-120b · raw

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

in opinion432 U.S. 333

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

64118ms · graded 2026-08-28 08:20

0%hll-cl11080877-1labordifficulty 4private splitblankopenai/gpt-oss-120b · raw

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

no citations offered

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

32016ms · graded 2026-08-28 08:19

25%hll-cl11080877-4labordifficulty 4private splitdeepseek/deepseek-v4-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity0%×2

Citation checks

found146 S.W.3d 637 · in DocketRouter index

found642 S.W.3d 502 · in DocketRouter index

in opinion432 U.S. 333

Quote fidelity (every quotation must exist verbatim in its source)

unsupported432 U.S. 333 for: steps into the shoes of the assignor

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

54306ms · graded 2026-08-28 08:18

81%hll-cl11080877-1labordifficulty 4private splitdeepseek/deepseek-v4-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority63%×2

Quote fidelity-×2

Citation checks

found967 S.W.2d 360 · in DocketRouter index

found505 U.S. 504 · in DocketRouter index

in opinion512 U.S. 246

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

39897ms · graded 2026-08-28 08:15

50%hll-cl11080877-4labordifficulty 4private splitupstage/solar-pro4 · raw

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

in opinion432 U.S. 333

in opinion852 S.W.2d 440

unverified237 S.W.3d 226 · verifier request budget exhausted

unverified275 S.W.3d 264 · verifier request budget exhausted

unverified180 S.W.3d 759 · verifier request budget exhausted

unverified252 S.W.3d 301 · verifier request budget exhausted

unverified353 S.W.3d 804 · verifier request budget exhausted

found16 S.W.3d 662 · in CourtListener bulk table

unverified471 U.S. 554 · verifier request budget exhausted

in opinion486 U.S. 399

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

36165ms · graded 2026-08-28 06:49

25%hll-cl11080877-1labordifficulty 4private splitupstage/solar-pro4 · raw

Axes

Outcome100%×2

Standard-×2

Authority63%×2

Quote fidelity0%×2

Citation checks

in opinion486 U.S. 399

in opinion481 U.S. 58

found469 U.S. 111 · in DocketRouter index

unverified826 F.2d 522 · verifier request budget exhausted

found133 S.W.3d 217 · in DocketRouter index

unverified273 S.W.3d 901 · verifier request budget exhausted

in opinion432 U.S. 333

Quote fidelity (every quotation must exist verbatim in its source)

unsupported for: ), 45 U.S.C. § 151 *et seq.*, preempts state-law claims for fraudulent and negligent misrepresentation, tortious interference, negligence, a

unsupported486 U.S. 399 for: meaning that state-law claims that fall within the RLA's substantive scope are recharacterized as federal claims and may be removed to fede

unsupported for: substantially dependent upon analysis of a collective-bargaining agreement.

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

36069ms · graded 2026-08-28 06:48

94%hll-cl11080877-1labordifficulty 4private splitdeepseek/deepseek-v4-flash · raw

Axes

Outcome100%×2

Standard-×2

Authority88%×2

Quote fidelity-×2

Citation checks

in opinion512 U.S. 246

in opinion486 U.S. 399

found512 U.S. 107 · in DocketRouter index

found896 S.W.2d 143 · in DocketRouter index

found248 S.W.3d 444 · in DocketRouter index

in opinion471 U.S. 202

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

98330ms · graded 2026-08-28 06:45

0%hll-cl11080877-4labordifficulty 4private splitdeepseek/deepseek-v4-flash · raw

Axes

Outcome0%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

no citations offered

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

31059ms · graded 2026-08-28 06:44

25%hll-flp11080877-2labordifficulty 5private splitdeepseek/deepseek-v4-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority83%×2

Quote fidelity50%×2

Citation checks

in opinion237 S.W.3d 680

in opinion486 U.S. 399

in opinion512 U.S. 246

in opinion845 S.W.2d 240

Quote fidelity (every quotation must exist verbatim in its source)

supported512 U.S. 246 for: is substantially dependent upon analysis of the terms of

unsupported845 S.W.2d 240 for: cannot be resolved without interpreting the CBA

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

33037ms · graded 2026-08-27 20:50

89%hll-flp11080877-4labordifficulty 3private splitdeepseek/deepseek-v4-flash · dr2

Axes

Outcome100%×2

Standard100%×2

Authority67%×2

Quote fidelity-×2

Citation checks

found146 S.W.3d 637 · in DocketRouter index

found136 S.W.3d 635 · in DocketRouter index

in opinion852 S.W.2d 440

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

14416ms · graded 2026-08-27 20:50

50%hll-flp11080877-1labordifficulty 4private splitdeepseek/deepseek-v4-flash · dr2

Axes

Outcome100%×2

Standard-×2

Authority0%×2

Quote fidelity-×2

Citation checks

no citations offered

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

17601ms · graded 2026-08-27 20:49

33%hll-flp11080877-4labordifficulty 3private splitdeepseek/deepseek-v4-flash · raw

Axes

Outcome100%×2

Standard0%×2

Authority0%×2

Quote fidelity-×2

Citation checks

unverified631 S.W.3d 173 · search unavailable

unverified642 S.W.3d 527 · search unavailable

found268 S.W.3d 1 · in DocketRouter index

Quote fidelity (every quotation must exist verbatim in its source)

no passage642 S.W.3d 527 for: A dismissal for lack of standing is a dismissal for lack of subject-matter jurisdiction and should be without prejudice.

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

30234ms · graded 2026-08-27 18:59

92%hll-flp11080877-2labordifficulty 5private splitdeepseek/deepseek-v4-flash · raw

Axes

Outcome100%×2

Standard-×2

Authority83%×2

Quote fidelity-×2

Citation checks

in opinion512 U.S. 246

in opinion486 U.S. 399

in opinion482 U.S. 386

found51 S.W.3d 573 · in DocketRouter index

unverified944 F.2d 658 · search unavailable

found133 S.W.3d 217 · in DocketRouter index

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

28702ms · graded 2026-08-27 18:59

100%hll-flp11080877-1labordifficulty 4private splitdeepseek/deepseek-v4-flash · raw

Axes

Outcome100%×2

Standard-×2

Authority100%×2

Quote fidelity-×2

Citation checks

in opinion512 U.S. 246

in opinion486 U.S. 399

found480 U.S. 557 · in DocketRouter index

in opinion925 S.W.2d 696

found129 S.W.3d 530 · in DocketRouter index

unverified383 S.W.3d 151 · search unavailable

in opinion852 S.W.2d 440

Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.

29306ms · graded 2026-08-27 18:58