HLL 0.1-TX
Grades, item by item
Every graded answer, every axis, every citation check. Scores are mechanical and recomputable. Public-split items show the blinded facts and the model's full answer; private-split items show scores and notes only. Weights: Standard 2, Authority 2, Outcome 2, Quote fidelity 2. A fabricated citation caps the item at 25%.
watch live|all runsdeepseek/deepseek-v4-flash · rawdeepseek/deepseek-v4-flash · juiceddeepseek/deepseek-v4-flash · dr2upstage/solar-pro4 · rawupstage/solar-pro4 · dr2openai/gpt-oss-120b · rawopenai/gpt-oss-20b · rawopenai/gpt-oss-120b · dr2openai/gpt-oss-20b · dr2google/gemini-3.7-flash · rawgoogle/gemini-3.7-flash · dr2
administrativeappellate-mandamusappellate-procedurearbitrationassault-iiedauto-accidentauto-insurance-uimchild-custodychild-supportcivil-litigationconstitutionalconstructionconsumer-dtpacontractsconversioncps-terminationcriminaldefamationdiscoverydivorce-propertyeasements-boundarieselectionseminent-domainemploymentevictionevidencefamilyforeclosurefraudgovernment-municipalgroundwaterhabeashealthcare-medmalhoa-condohomicideineffective-assistanceinsurancejurisdiction-traplaborlandlord-tenantlegal-malpracticelimitationsnuisance-trespassoil-gasopen-recordsotherpersonal-injurypremises-liabilityprobateproducts-liabilityprofessional-responsibilityreal-estate-brokersreal-propertyschool-lawsearch-seizuresovereign-immunitysummary-judgmenttaxtheft-fraud-crimestorttortious-interferencetruckingvenue-forumworkers-compwrongful-death
88%hll-cl11410163-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity-×2
Citation checks
in opinion95 S.W.3d 234
found128 S.W.3d 223 · in DocketRouter index
found907 S.W.2d 517 · in DocketRouter index
found180 S.W.3d 127 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
162420ms · graded 2026-08-28 23:30
25%hll-cl11410163-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found339 S.W.3d 84 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
in opinion497 S.W.3d 490
Quote fidelity (every quotation must exist verbatim in its source)
no passage128 S.W.3d 223 for: decides matters not submitted to him
no passage128 S.W.3d 223 for: is contrary to the express language of the agreement
unsupported497 S.W.3d 490 for: The arbitrator shall interpret and apply these rules insofar as they relate to the arbitrator’s powers and duties.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
82457ms · graded 2026-08-28 23:27
79%hll-cl11410163-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority58%×2
Quote fidelity-×2
Citation checks
found126 S.W.3d 257 · in DocketRouter index
found164 S.W.3d 438 · in DocketRouter index
found178 S.W.3d 256 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
68297ms · graded 2026-08-28 23:26
83%hll-cl11238656-4arbitrationdifficulty 5private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found842 S.W.2d 266 · in DocketRouter index
found155 S.W.3d 202 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
33588ms · graded 2026-08-28 22:47
50%hll-cl11238656-3arbitrationdifficulty 3private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
found827 S.W.2d 833 · in DocketRouter index
in opinion128 S.W.3d 223
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
29600ms · graded 2026-08-28 22:47
81%hll-cl11238656-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found842 S.W.2d 266 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
27657ms · graded 2026-08-28 22:46
81%hll-cl11238656-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found166 S.W.3d 732 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
26698ms · graded 2026-08-28 22:46
88%hll-cl11410163-3arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity-×2
Citation checks
found209 S.W.3d 888 · in DocketRouter index
in opinion497 S.W.3d 490
in opinion95 S.W.3d 234
found124 S.W.3d 422 · in DocketRouter index
found226 S.W.3d 459 · in DocketRouter index
unverified442 S.W.3d 751 · verifier request budget exhausted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
16359ms · graded 2026-08-28 22:37
83%hll-cl11410163-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion497 S.W.3d 490
found209 S.W.3d 888 · in DocketRouter index
found294 S.W.3d 818 · in DocketRouter index
found572 U.S. 25 · in DocketRouter index
in opinion518 S.W.3d 422
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
25237ms · graded 2026-08-28 22:37
83%hll-cl11410163-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
found291 S.W.3d 490 · in DocketRouter index
found126 S.W.3d 232 · in DocketRouter index
found340 F.3d 209 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
17508ms · graded 2026-08-28 22:37
0%hll-cl11335146-3arbitrationdifficulty 5private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found166 S.W.3d 732 · in DocketRouter index
in opinion180 S.W.3d 127
found519 S.W.3d 95 · in DocketRouter index
found995 S.W.2d 647 · in DocketRouter index
in opinion162 S.W.3d 801
found214 S.W.3d 148 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
21720ms · graded 2026-08-28 21:58
0%hll-cl11335146-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion547 S.W.3d 624
found128 S.W.3d 223 · in DocketRouter index
found334 S.W.3d 220 · in DocketRouter index
found166 S.W.3d 732 · in DocketRouter index
in opinion180 S.W.3d 127
found458 S.W.3d 502 · in DocketRouter index
found348 S.W.3d 221 · in DocketRouter index
found56 S.W.3d 872 · in DocketRouter index
found600 S.W.3d 381 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
23223ms · graded 2026-08-28 21:58
92%hll-cl11324660-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority83%×2
Quote fidelity-×2
Citation checks
found547 S.W.3d 624 · in DocketRouter index
in opinion166 S.W.3d 732
in opinion180 S.W.3d 127
in opinion458 S.W.3d 502
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
22727ms · graded 2026-08-28 21:38
92%hll-cl11324660-4arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard100%×2
Authority75%×2
Quote fidelity-×2
Citation checks
in opinion458 S.W.3d 502
found128 S.W.3d 223 · in DocketRouter index
found258 S.W.3d 580 · in DocketRouter index
in opinion166 S.W.3d 732
in opinion180 S.W.3d 127
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
16702ms · graded 2026-08-28 21:38
25%hll-cl11324660-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority88%×2
Quote fidelity0%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
in opinion551 S.W.3d 111
found547 S.W.3d 624 · in DocketRouter index
in opinion166 S.W.3d 732
found556 U.S. 624 · in DocketRouter index
in opinion180 S.W.3d 127
in opinion458 S.W.3d 502
in opinion672 S.W.3d 367
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the fact that the claims touch upon matters related to the agreement does not mean they arise from it.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
19884ms · graded 2026-08-28 21:38
33%hll-cl11319870-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion602 U.S. 143
found144 S. Ct. 1186 · in DocketRouter index
found642 S.W.3d 583 · in DocketRouter index
found293 S.W.3d 182 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
found172 S.W.3d 603 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
22235ms · graded 2026-08-28 21:37
25%hll-cl11319870-3arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found543 S.W.3d 755 · in DocketRouter index
found519 S.W.3d 95 · in DocketRouter index
found590 S.W.3d 471 · in DocketRouter index
found317 S.W.2d 30 · in DocketRouter index
found341 S.W.3d 323 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: relating to the goods and services listed in its Schedule A.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
15500ms · graded 2026-08-28 21:37
88%hll-cl11296835-4arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity-×2
Citation checks
found416 S.W.3d 708 · in DocketRouter index
found307 S.W.3d 267 · in DocketRouter index
found95 S.W.3d 234 · in DocketRouter index
in opinion497 S.W.3d 490
found552 U.S. 576 · in DocketRouter index
found294 S.W.3d 818 · in DocketRouter index
found314 S.W.3d 677 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage314 S.W.3d 677 for: The issue is whether the arbitrator had authority to decide the issue, not whether the arbitrator decided the issue correctly.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
21845ms · graded 2026-08-28 21:32
67%hll-cl11296835-3arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found416 S.W.3d 708 · in DocketRouter index
found95 S.W.3d 234 · in DocketRouter index
found149 S.W.3d 796 · in DocketRouter index
found874 S.W.2d 776 · in DocketRouter index
found257 S.W.3d 692 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported95 S.W.3d 234 for: the party did not participate in the arbitration hearing without raising the objection.
no passage257 S.W.3d 692 for: A party may not participate in an arbitration and then, after an adverse award, complain that the dispute was not arbitrable.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
22765ms · graded 2026-08-28 21:31
50%hll-cl11296835-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found95 S.W.3d 234 · in DocketRouter index
in opinion497 S.W.3d 490
found290 S.W.3d 554 · in DocketRouter index
found126 S.W.3d 257 · in DocketRouter index
found874 S.W.2d 776 · in DocketRouter index
found955 S.W.2d 270 · in DocketRouter index
found280 S.W.3d 334 · in DocketRouter index
found960 S.W.2d 629 · in DocketRouter index
found437 S.W.3d 518 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
18347ms · graded 2026-08-28 21:31
25%hll-cl11296835-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
in opinion497 S.W.3d 490
found95 S.W.3d 234 · in DocketRouter index
found300 S.W.3d 386 · in DocketRouter index
found63 S.W.3d 807 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: refused to postpone the hearing after a showing of sufficient cause for the postponement.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
15568ms · graded 2026-08-28 21:31
83%hll-cl11238656-4arbitrationdifficulty 5private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
in opinion172 S.W.3d 603
found221 S.W.3d 632 · in DocketRouter index
unverified63 S.W.3d 503 · The operation was aborted due to timeout
unverified118 S.W.3d 787 · The operation was aborted due to timeout
found323 S.W.3d 151 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
43767ms · graded 2026-08-28 21:21
81%hll-cl11238656-1arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found334 S.W.3d 220 · in DocketRouter index
found221 S.W.3d 632 · in DocketRouter index
in opinion172 S.W.3d 603
in opinion340 S.W.3d 444
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
27147ms · graded 2026-08-28 21:21
81%hll-cl11238656-2arbitrationdifficulty 4private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity-×2
Citation checks
in opinion195 S.W.3d 672
in opinion128 S.W.3d 223
found166 S.W.3d 732 · in DocketRouter index
found545 S.W.3d 479 · in DocketRouter index
found221 S.W.3d 632 · in DocketRouter index
found323 S.W.3d 151 · in DocketRouter index
found155 S.W.3d 202 · in DocketRouter index
in opinion340 S.W.3d 444
found289 S.W.3d 836 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
23218ms · graded 2026-08-28 21:21
83%hll-cl11238656-3arbitrationdifficulty 3private splitgoogle/gemini-3.7-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion340 S.W.3d 444
in opinion195 S.W.3d 672
in opinion128 S.W.3d 223
found718 F.3d 448 · in DocketRouter index
found323 S.W.3d 151 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
16554ms · graded 2026-08-28 21:21
0%hll-cl11335146-3arbitrationdifficulty 5private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found166 S.W.3d 732 · in DocketRouter index
found192 S.W.3d 759 · in DocketRouter index
in opinion540 S.W.3d 539
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
29244ms · graded 2026-08-28 20:09
0%hll-cl11335146-1arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion909 S.W.2d 896
in opinion842 S.W.2d 266
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
53277ms · graded 2026-08-28 20:08
0%hll-cl11324660-4arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard0%×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
43439ms · graded 2026-08-28 19:18
0%hll-cl11324660-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
67652ms · graded 2026-08-28 19:18
50%hll-cl11324660-1arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
in opinion551 S.W.3d 111
found196 S.W.3d 161 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
41122ms · graded 2026-08-28 19:16
0%hll-cl11319870-3arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
77641ms · graded 2026-08-28 19:04
0%hll-cl11319870-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
68620ms · graded 2026-08-28 19:03
25%hll-cl11335146-3arbitrationdifficulty 5private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found166 S.W.3d 732 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
in opinion540 S.W.3d 539
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: all disputes shall be resolved by binding arbitration.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
83987ms · graded 2026-08-28 17:52
50%hll-cl11335146-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
49941ms · graded 2026-08-28 17:51
50%hll-cl11296835-4arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found552 U.S. 576 · in DocketRouter index
found128 S.Ct. 1396 · in CourtListener bulk table
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
37038ms · graded 2026-08-28 17:38
50%hll-cl11296835-3arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
40027ms · graded 2026-08-28 17:37
0%hll-cl11296835-2arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found960 S.W.2d 629 · in DocketRouter index
found314 S.W.3d 677 · in DocketRouter index
found74 S.W.3d 527 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: Should the award be against appellant or also include the defendant companies?
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
53778ms · graded 2026-08-28 17:36
0%hll-cl11296835-1arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found133 S.W.3d 217 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
41734ms · graded 2026-08-28 17:36
0%hll-cl11324660-4arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard0%×2
Authority0%×2
Quote fidelity-×2
Citation checks
found279 S.W.3d 640 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
31447ms · graded 2026-08-28 17:17
25%hll-cl11324660-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
found210 F.3d 524 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: requires a party to seek a direct benefit from the contract itself, not merely an incidental benefit
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
46819ms · graded 2026-08-28 17:16
50%hll-cl11324660-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found514 U.S. 938 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
50250ms · graded 2026-08-28 17:16
0%hll-cl11319870-3arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found258 S.W.3d 580 · in DocketRouter index
found337 S.W.3d 860 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: all other agreements *relating to* the goods and services listed in Schedule A,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
46150ms · graded 2026-08-28 17:06
0%hll-cl11319870-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found514 U.S. 938 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
found52 S.W.3d 749 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
59421ms · graded 2026-08-28 17:06
50%hll-cl11296835-4arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found552 U.S. 576 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
47855ms · graded 2026-08-28 16:15
0%hll-cl11296835-3arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found886 S.W.2d 515 · in DocketRouter index
found262 S.W.3d 337 · in DocketRouter index
found563 U.S. 333 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
41960ms · graded 2026-08-28 16:14
25%hll-cl11296835-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found393 U.S. 145 · in DocketRouter index
found79 S.W.3d 30 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: evident partiality or corruption in the arbitrators
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
57208ms · graded 2026-08-28 16:13
0%hll-cl11296835-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found284 S.W.3d 366 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
43230ms · graded 2026-08-28 16:12
67%hll-cl11335146-3arbitrationdifficulty 5private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
in opinion842 S.W.2d 266
in opinion540 S.W.3d 539
Quote fidelity (every quotation must exist verbatim in its source)
supported for: Under direct benefits estoppel, a non-signatory plaintiff seeking the benefits of a contract is estopped from simultaneously attempting to a
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
27349ms · graded 2026-08-28 16:02
50%hll-cl11335146-1arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion842 S.W.2d 266
in opinion909 S.W.2d 896
found924 S.W.2d 943 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
135495ms · graded 2026-08-28 16:01
50%hll-cl11335146-3arbitrationdifficulty 5private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
39677ms · graded 2026-08-28 16:04
0%hll-cl11335146-1arbitrationdifficulty 4private splitblankdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
75962ms · graded 2026-08-28 16:03
50%hll-cl11238656-4arbitrationdifficulty 5private splitopenai/gpt-oss-20b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion195 S.W.3d 672
found842 S.W.2d 266 · in DocketRouter index
in opinion52 S.W.3d 749
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
100044ms · graded 2026-08-28 15:35
0%hll-cl11238656-3arbitrationdifficulty 3private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
found968 S.W.2d 916 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
26738ms · graded 2026-08-28 15:33
0%hll-cl11238656-2arbitrationdifficulty 4private splitopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found419 S.W.3d 516 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: A party seeking to compel arbitration must establish the existence of a valid arbitration agreement and show that the claims asserted fall w
unsupported for: A contract reference to a document containing an arbitration clause is an arbitration agreement if the contract is in writing and the refere
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
90953ms · graded 2026-08-28 15:33
0%hll-cl11238656-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
71312ms · graded 2026-08-28 15:31
75%hll-cl11324660-4arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard50%×2
Authority75%×2
Quote fidelity-×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
in opinion166 S.W.3d 732
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
47193ms · graded 2026-08-28 15:19
25%hll-cl11324660-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority83%×2
Quote fidelity0%×2
Citation checks
found196 S.W.3d 774 · in DocketRouter index
found547 S.W.3d 624 · in DocketRouter index
found403 S.W.3d 840 · in DocketRouter index
in opinion180 S.W.3d 127
in opinion166 S.W.3d 732
Quote fidelity (every quotation must exist verbatim in its source)
unsupported180 S.W.3d 127 for: seeks to enforce the contract’s terms
unsupported180 S.W.3d 127 for: depends on the contract’s existence and cannot stand independently
unsupported166 S.W.3d 732 for: seek a direct benefit from the contract
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
36854ms · graded 2026-08-28 15:18
88%hll-cl11324660-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity-×2
Citation checks
found279 S.W.3d 640 · in DocketRouter index
in opinion166 S.W.3d 732
found52 S.W.3d 749 · in DocketRouter index
in opinion180 S.W.3d 127
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
77373ms · graded 2026-08-28 15:17
0%hll-cl11319870-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found258 S.W.3d 580 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: [C]ourts should resolve any doubts as to the agreement’s scope, waiver, and other issues unrelated to its validity in favor of arbitration.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
41570ms · graded 2026-08-28 15:00
25%hll-cl11319870-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found166 S.W.3d 732 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
found561 U.S. 287 · in DocketRouter index
in opinion561 U.S. 63
Quote fidelity (every quotation must exist verbatim in its source)
unsupported561 U.S. 63 for: To satisfy itself that such an agreement exists, the court must resolve any issue that calls into question the specific arbitration clause t
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
45469ms · graded 2026-08-28 15:00
50%hll-cl11324660-4arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard50%×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
126363ms · graded 2026-08-28 14:57
61%hll-cl11324660-2arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome0%×2
Standard-×2
Authority83%×2
Quote fidelity100%×2
Citation checks
found827 S.W.2d 833 · in DocketRouter index
found514 U.S. 938 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
found196 S.W.3d 161 · in DocketRouter index
found236 S.W.3d 761 · in DocketRouter index
in opinion551 S.W.3d 111
in opinion166 S.W.3d 732
in opinion180 S.W.3d 127
Quote fidelity (every quotation must exist verbatim in its source)
supported551 S.W.3d 111 for: presume the existence of the written agreement
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
163704ms · graded 2026-08-28 14:55
67%hll-cl11324660-1arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found934 S.W.2d 87 · in DocketRouter index
found514 U.S. 938 · in DocketRouter index
found489 U.S. 468 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: presume the existence of the written agreement
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
53099ms · graded 2026-08-28 14:52
25%hll-cl11319870-3arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found337 S.W.3d 860 · in DocketRouter index
found258 S.W.3d 580 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: intentional relinquishment of a known right or interest,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
40542ms · graded 2026-08-28 14:35
50%hll-cl11319870-2arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found128 S.W.3d 223 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
found561 U.S. 297 · in DocketRouter index
found514 U.S. 938 · in DocketRouter index
found388 U.S. 395 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
69091ms · graded 2026-08-28 14:34
83%hll-cl11238656-4arbitrationdifficulty 5private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found842 S.W.2d 266 · in DocketRouter index
in opinion934 S.W.2d 87
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
53110ms · graded 2026-08-28 14:32
0%hll-cl11238656-3arbitrationdifficulty 3private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the petition for writ of mandamus is dismissed without prejudice to the filing of a timely accelerated notice of appeal per Tex. R. App. P.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
31190ms · graded 2026-08-28 14:31
50%hll-cl11238656-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found827 S.W.2d 833 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage827 S.W.2d 833 for: establish the existence of a valid arbitration agreement and show that the claims asserted fall within the scope of that agreement
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
57461ms · graded 2026-08-28 14:31
0%hll-cl11238656-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
69796ms · graded 2026-08-28 14:30
50%hll-cl11296835-4arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found95 S.W.3d 234 · in DocketRouter index
found552 U.S. 576 · in DocketRouter index
in opinion339 S.W.3d 84
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
38925ms · graded 2026-08-28 14:06
50%hll-cl11296835-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion339 S.W.3d 84
found95 S.W.3d 234 · in DocketRouter index
found52 S.W.3d 749 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
42903ms · graded 2026-08-28 14:05
50%hll-cl11296835-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found95 S.W.3d 234 · in DocketRouter index
found345 S.W.3d 672 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage345 S.W.3d 672 for: there was evident partiality by an arbitrator appointed as a neutral arbitrator.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
51840ms · graded 2026-08-28 14:04
0%hll-cl11296835-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found95 S.W.3d 234 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the arbitrator . . . refused to postpone the hearing after a showing of sufficient cause for the postponement.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
30960ms · graded 2026-08-28 14:03
50%hll-cl11296835-4arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found552 U.S. 576 · in DocketRouter index
found95 S.W.3d 234 · in DocketRouter index
in opinion339 S.W.3d 84
found827 S.W.2d 833 · in DocketRouter index
found842 S.W.2d 266 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
49503ms · graded 2026-08-28 13:25
50%hll-cl11296835-3arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found168 S.W.3d 802 · in DocketRouter index
found827 S.W.2d 833 · in DocketRouter index
found128 S.W.3d 223 · in DocketRouter index
found563 U.S. 333 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
53888ms · graded 2026-08-28 13:24
50%hll-cl11296835-2arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
62759ms · graded 2026-08-28 13:23
0%hll-cl11296835-1arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found34 S.W.3d 547 · in DocketRouter index
found39 S.W.3d 191 · in DocketRouter index
found74 S.W.3d 849 · in DocketRouter index
found852 S.W.2d 440 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the arbitrators were guilty of misconduct in refusing to postpone the hearing, upon sufficient cause shown, or in refusing to hear evidence
unsupported for: the court shall vacate an award if ... the arbitrator ... refused to postpone the hearing after a showing of sufficient cause for the postpo
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
116082ms · graded 2026-08-28 13:22
33%hll-cl11238656-4arbitrationdifficulty 5private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found155 S.W.3d 202 · in DocketRouter index
found813 F.2d 60 · in DocketRouter index
found148 S.W.3d 124 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
35342ms · graded 2026-08-28 12:13
0%hll-cl11238656-3arbitrationdifficulty 3private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found827 S.W.2d 833 · in DocketRouter index
found80 S.W.3d 566 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage80 S.W.3d 566 for: nothing in the procedures for interlocutory appeals and mandamus actions prevents us from treating this appeal as a petition for writ of man
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
90603ms · graded 2026-08-28 12:13
81%hll-cl11238656-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority63%×2
Quote fidelity-×2
Citation checks
in opinion128 S.W.3d 223
found419 S.W.3d 516 · in DocketRouter index
found827 S.W.2d 833 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
75027ms · graded 2026-08-28 12:11
25%hll-cl11238656-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found148 S.W.3d 124 · in DocketRouter index
found827 S.W.2d 833 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
found166 S.W.3d 732 · in DocketRouter index
found155 S.W.3d 202 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: a party cannot be compelled to arbitrate unless it has agreed to do so.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
88024ms · graded 2026-08-28 12:10
33%hll-cl11238656-4arbitrationdifficulty 5private splitupstage/solar-pro4 · dr2
Axes
Outcome0%×2
Standard-×2
Authority67%×2
Quote fidelity-×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
found909 S.W.2d 896 · in DocketRouter index
in opinion128 S.W.3d 223
in opinion934 S.W.2d 87
found813 F.2d 60 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
176229ms · graded 2026-08-28 11:19
0%hll-cl11238656-3arbitrationdifficulty 3private splitupstage/solar-pro4 · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found842 S.W.2d 266 · in DocketRouter index
found827 S.W.2d 833 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
35877ms · graded 2026-08-28 11:16
0%hll-cl11238656-2arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found419 S.W.3d 516 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
67115ms · graded 2026-08-28 11:16
50%hll-cl11238656-1arbitrationdifficulty 4private splitupstage/solar-pro4 · dr2
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found262 S.W.3d 446 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
136227ms · graded 2026-08-28 11:15
0%hll-cl11410163-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
74694ms · graded 2026-08-28 11:14
0%hll-cl11410163-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
33976ms · graded 2026-08-28 11:13
0%hll-cl11410163-3arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
4340ms · graded 2026-08-28 11:13
0%hll-cl11335146-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
58236ms · graded 2026-08-28 10:15
0%hll-cl11335146-3arbitrationdifficulty 5private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
16564ms · graded 2026-08-28 10:14
0%hll-cl11324660-4arbitrationdifficulty 4private splitopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard0%×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
180007ms · graded 2026-08-28 10:10
0%hll-cl11410163-3arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
180008ms · graded 2026-08-28 10:13
25%hll-cl11410163-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found201 S.W.3d 1 · in CourtListener bulk table
unverified201 S.W.3d 102 · verifier rate-limited
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: to correct a clerical error, supply a missing portion, or otherwise clarify the award
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
96284ms · graded 2026-08-28 10:12
25%hll-cl11410163-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found475 U.S. 643 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: A party may move for clarification, correction, or modification of an award within 30 days after receipt of the award.
unsupported for: shall be deemed part of the original award.
unsupported for: A party may file a motion for clarification of the award within 30 days after receipt. The arbitrator may issue a clarification award, which
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
83788ms · graded 2026-08-28 10:12
0%hll-cl11324660-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
82991ms · graded 2026-08-28 10:08
0%hll-cl11324660-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
44771ms · graded 2026-08-28 10:08
0%hll-cl11319870-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
57720ms · graded 2026-08-28 10:06
0%hll-cl11319870-3arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
30021ms · graded 2026-08-28 10:05
0%hll-cl11296835-4arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
73989ms · graded 2026-08-28 09:57
0%hll-cl11296835-3arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
62814ms · graded 2026-08-28 09:57
0%hll-cl11296835-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
41788ms · graded 2026-08-28 09:56
0%hll-cl11296835-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
38018ms · graded 2026-08-28 09:56
0%hll-cl11238656-2arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
49574ms · graded 2026-08-28 09:42
0%hll-cl11238656-3arbitrationdifficulty 3private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
45293ms · graded 2026-08-28 09:42
0%hll-cl11238656-1arbitrationdifficulty 4private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
42756ms · graded 2026-08-28 09:41
0%hll-cl11238656-4arbitrationdifficulty 5private splitblankopenai/gpt-oss-20b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
3436ms · graded 2026-08-28 09:41
25%hll-cl11335146-3arbitrationdifficulty 5private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
unverified539 S.W.3d 236 · verifier request budget exhausted
unverified201 S.W.3d 123 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: any dispute arising out of or relating to this agreement
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
76687ms · graded 2026-08-28 09:12
0%hll-cl11335146-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found563 U.S. 333 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage563 U.S. 333 for: any dispute arising out of or relating to
unsupported for: any dispute arising out of or relating to this agreement shall be resolved by binding arbitration.
unsupported for: arising out of or relating to
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
55496ms · graded 2026-08-28 09:12
50%hll-cl11410163-1arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found196 S.W.3d 774 · in DocketRouter index
unverified116 S.W.3d 409 · verifier request budget exhausted
unverified148 S.W.3d 231 · verifier request budget exhausted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
115725ms · graded 2026-08-28 09:06
25%hll-cl11410163-3arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity0%×2
Citation checks
unverified127 S.W.3d 627 · verifier request budget exhausted
unverified258 S.W.3d 767 · verifier request budget exhausted
unverified148 S.W.3d 231 · verifier request budget exhausted
unverified202 S.W.3d 853 · verifier request budget exhausted
found352 S.W.3d 462 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: is not subject to confirmation because it does not resolve the parties' dispute with sufficient clarity to be enforced. *See* § 171.087(a)
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
67817ms · graded 2026-08-28 09:06
25%hll-cl11410163-2arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found22 S.W.3d 398 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: Modification or Correction of an Award.
unsupported for: any miscalculation of figures, any clerical error, or any oversights or omission
unsupported for: of the award upon request within 20 days, and that a clarification
unsupported for: shall not be deemed an award on the merits,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
35320ms · graded 2026-08-28 09:05
0%hll-cl11324660-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: A benefit is ‘direct’ when it is the very object of the contract and is conferred on the non‑signatory in a manner that the parties contempl
unsupported for: the estoppel analysis is fact‑intensive and hinges on the parties’ intent.
unsupported for: determines the rights of the parties with respect to the arbitration clause.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
89095ms · graded 2026-08-28 09:05
25%hll-cl11324660-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the doctrine of direct‑benefits estoppel requires a direct relationship between the claim and the contract containing the arbitration clause
unsupported for: the party must be an intended third‑party beneficiary of the arbitration clause
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
78822ms · graded 2026-08-28 09:05
67%hll-cl11324660-4arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard100%×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
56292ms · graded 2026-08-28 09:05
7%hll-cl11319870-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity20%×2
Citation checks
found475 U.S. 643 · in DocketRouter index
found420 U.S. 371 · in CourtListener bulk table
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the question of whether an arbitration clause is enforceable is a matter for the court unless the parties have expressly delegated that deci
supported for: replaces all other agreements relating to
unsupported for: replaces all other agreements *relating to* the goods and services listed in Schedule A.
unsupported for: the arbitration clause in the 2022 agreement is terminated
unsupported for: the parties waive arbitration for all matters arising from the 2022 burial.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
77015ms · graded 2026-08-28 09:03
25%hll-cl11319870-3arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity25%×2
Citation checks
found71 S.W.3d 1 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported for: relating to the goods and services listed in Schedule A
unsupported for: replaces all other agreements *relating to* the goods and services listed in Schedule A,
unsupported for: the written contract is the exclusive evidence of the parties’ agreement
unsupported for: determines a party’s right to proceed in a particular manner
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
70478ms · graded 2026-08-28 09:03
0%hll-cl11296835-4arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
112190ms · graded 2026-08-28 08:54
25%hll-cl11296835-3arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
no citations offered
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: waits until after the award to assert that the arbitration agreement is void for unconscionability
unsupported for: unconscionable because it omitted any requirement that the parties record the agreement.
unsupported for: failed to require recording, outline evidence handling, or require disclosure of conflicts
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
83465ms · graded 2026-08-28 08:53
0%hll-cl11296835-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found123 S.W.3d 123 · in CourtListener bulk table
unverified563 U.S. 132 · verifier rate-limited
Quote fidelity (every quotation must exist verbatim in its source)
no passage123 S.W.3d 123 for: guilty of evident partiality or corruption.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
73321ms · graded 2026-08-28 08:53
25%hll-cl11296835-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found274 S.W.3d 1 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: A refusal to grant a continuance, absent proof of bias or other misconduct, is not a statutory ground for vacatur.
unsupported for: agreed to submit all claims to binding arbitration.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
6297ms · graded 2026-08-28 08:52
50%hll-cl11238656-4arbitrationdifficulty 5private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
78274ms · graded 2026-08-28 08:34
0%hll-cl11238656-1arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found332 S.W.3d 1 · in CourtListener bulk table
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
100061ms · graded 2026-08-28 08:34
0%hll-cl11238656-3arbitrationdifficulty 3private splitopenai/gpt-oss-120b · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
20101ms · graded 2026-08-28 08:33
50%hll-cl11238656-2arbitrationdifficulty 4private splitopenai/gpt-oss-120b · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified539 S.W.3d 236 · verifier rate-limited
found202 S.W.3d 1 · in CourtListener bulk table
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
13152ms · graded 2026-08-28 08:33
38%hll-cl11410163-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority75%×2
Quote fidelity-×2
Citation checks
found604 S.W.2d 391 · in CourtListener bulk table
found874 S.W.2d 776 · in DocketRouter index
in opinion95 S.W.3d 234
found330 S.W.3d 11 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
35711ms · graded 2026-08-28 08:07
0%hll-cl11410163-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found56 F.3d 844 · in CourtListener bulk table
unverified666 F.2d 789 · verifier rate-limited
found943 F.2d 327 · in DocketRouter index
unverified900 S.W.2d 94 · verifier rate-limited
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: where the arbitrator[] exceeded [his] powers, or so imperfectly executed them that a mutual, final, and definite award upon the subject matt
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
39287ms · graded 2026-08-28 08:07
25%hll-cl11410163-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority58%×2
Quote fidelity0%×2
Citation checks
in opinion95 S.W.3d 234
found793 S.W.2d 948 · in DocketRouter index
unverified725 S.W.2d 787 · verifier request budget exhausted
found843 S.W.2d 289 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported95 S.W.3d 234 for: from the parties' agreement or the arbitration submission. *See* *CVN Group, Inc. v. Delgado*, 95 S.W.3d 234, 238 (Tex. 2002) (per curiam)
unsupported for: on January 29, 2025. The critical question is whether the motion to modify was timely under § 171.054(a). If the motion was filed more than
unsupported for: ), and the clarification used actual names. If the names correspond exactly to the designations, this is a mere form correction permissible
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
20197ms · graded 2026-08-28 08:07
0%hll-cl11335146-3arbitrationdifficulty 5private splitupstage/solar-pro4 · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified142 S.W.3d 216 · verifier request budget exhausted
found537 U.S. 79 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
unverified541 S.W.3d 763 · verifier request budget exhausted
unverified206 S.W.3d 464 · verifier request budget exhausted
found312 S.W.3d 687 · in DocketRouter index
found327 S.W.3d 118 · in DocketRouter index
found393 S.W.3d 246 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
140669ms · graded 2026-08-28 07:59
0%hll-cl11335146-1arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found475 U.S. 574 · in DocketRouter index
unverified196 S.W.3d 395 · verifier rate-limited
unverified148 S.W.3d 296 · verifier rate-limited
unverified180 S.W.3d 759 · verifier rate-limited
found460 U.S. 1 · in DocketRouter index
unverified334 S.W.3d 613 · verifier rate-limited
unverified287 S.W.2d 592 · verifier rate-limited
unverified818 S.W.2d 137 · verifier rate-limited
unverified275 S.W.3d 654 · verifier rate-limited
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
56219ms · graded 2026-08-28 07:57
25%hll-cl11324660-4arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard50%×2
Authority0%×2
Quote fidelity0%×2
Citation checks
unverified284 S.W.3d 127 · verifier request budget exhausted
found196 S.W.3d 774 · in DocketRouter index
unverified525 S.W.3d 521 · verifier request budget exhausted
unverified236 S.W.3d 480 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: have its cake and eat it too
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
147127ms · graded 2026-08-28 07:50
50%hll-cl11324660-1arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found460 U.S. 1 · in DocketRouter index
unverified29 S.W.3d 125 · verifier rate-limited
unverified293 S.W.3d 343 · verifier rate-limited
unverified672 S.W.3d 221 · verifier rate-limited
found152 S.W.3d 121 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage672 S.W.3d 221 for: the contract with the arbitration clause. The theory prevents a party from
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
131942ms · graded 2026-08-28 07:50
0%hll-cl11319870-3arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
180003ms · graded 2026-08-28 07:49
67%hll-cl11324660-2arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity100%×2
Citation checks
found460 U.S. 1 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
unverified180 S.W.3d 759 · verifier rate-limited
found129 S.W.3d 250 · in DocketRouter index
unverified556 U.S. 627 · verifier rate-limited
unverified203 S.W.3d 512 · verifier rate-limited
unverified202 S.W.3d 342 · verifier rate-limited
Quote fidelity (every quotation must exist verbatim in its source)
no passage203 S.W.3d 512 for: derives a direct benefit from the contract.
supported for: derive a direct benefit from the contract
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
50279ms · graded 2026-08-28 07:48
23%hll-cl11319870-2arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome50%×2
Standard-×2
Authority0%×2
Quote fidelity20%×2
Citation checks
found460 U.S. 1 · in DocketRouter index
found470 U.S. 213 · in DocketRouter index
found388 U.S. 395 · in DocketRouter index
unverified537 U.S. 793 · verifier request budget exhausted
in opinion561 U.S. 63
in opinion546 U.S. 440
unverified228 S.W.3d 331 · verifier request budget exhausted
unverified196 S.W.3d 344 · verifier request budget exhausted
found514 U.S. 938 · in DocketRouter index
unverified922 F.3d 200 · verifier request budget exhausted
unverified236 S.W.3d 758 · verifier request budget exhausted
found400 S.W.3d 635 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
supported460 U.S. 1 for: valid, irrevocable, and enforceable, save upon such grounds as exist at law or in equity for the revocation of any contract.
unsupported561 U.S. 63 for: whether the parties agreed to arbitrate
unsupported561 U.S. 63 for: whether the agreement to arbitrate is enforceable
no passage196 S.W.3d 344 for: clause stating that the later agreement
unsupported for: the goods and services in its Schedule A, which listed only
unsupported for: any dispute regarding the interpretation or enforcement of this Agreement,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
43214ms · graded 2026-08-28 07:46
25%hll-cl11296835-2arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
unverified196 S.W.3d 352 · verifier request budget exhausted
unverified922 S.W.2d 107 · verifier request budget exhausted
unverified124 S.W.3d 127 · verifier request budget exhausted
found393 U.S. 145 · in DocketRouter index
unverified937 F.2d 875 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: the award was procured by corruption, fraud, or other undue means
no passage393 U.S. 145 for: requires more than a mere appearance of bias; it requires a
no passage393 U.S. 145 for: *See* *Commonwealth Coatings Corp. v. Continental Cas. Co.*, 393 U.S. 145, 148 (1968); *see also* *Lucille v. United States*, 937 F.2d 875,
no passage937 F.2d 875 for: standard). The Fifth Circuit has held that
no passage937 F.2d 875 for: exists where the arbitrator has a direct, personal, substantial, and pecuniary interest in the outcome, or where there is a
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
185886ms · graded 2026-08-28 07:37
25%hll-cl11296835-1arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found196 S.W.3d 774 · in DocketRouter index
unverified951 S.W.2d 407 · verifier request budget exhausted
found413 S.W.3d 649 · in CourtListener bulk table
Quote fidelity (every quotation must exist verbatim in its source)
no passage196 S.W.3d 774 for: refused to postpone the hearing upon sufficient cause.
unsupported for: This is a critical defect. Under the TAA, an arbitration agreement must be in writing. Tex. Civ. Prac. & Rem. Code § 171.001(1). The trial
unsupported for: refused to postpone the hearing upon sufficient cause.
unsupported for: Under § 171.087(2), vacatur is warranted where the arbitrator was partial or prejudiced. Texas courts have interpreted
unsupported for: no written arbitration agreement existed in any of the contracts.
unsupported for: no written arbitration agreement existed in any of the contracts,
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
148802ms · graded 2026-08-28 07:36
25%hll-cl11296835-4arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity25%×2
Citation checks
found196 S.W.3d 774 · in DocketRouter index
found552 U.S. 576 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: An award may not be vacated for errors of fact or law.
unsupported for: [A]n arbitrator’s erroneous factual or legal conclusions are not grounds for vacatur.
supported552 U.S. 576 for: exceeded their powers, or so imperfectly executed them that a mutual, final, and definite award upon the subject matter submitted was not ma
unsupported for: exceeded his powers by making mistakes of fact
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
103625ms · graded 2026-08-28 07:36
50%hll-cl11296835-3arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified924 S.W.2d 659 · verifier request budget exhausted
found905 S.W.2d 655 · in DocketRouter index
found460 U.S. 1 · in DocketRouter index
unverified523 U.S. 79 · verifier request budget exhausted
found514 U.S. 938 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
30147ms · graded 2026-08-28 07:35
0%hll-cl11238656-2arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
180006ms · graded 2026-08-28 07:17
50%hll-cl11238656-4arbitrationdifficulty 5private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found951 S.W.2d 408 · in DocketRouter index
unverified475 U.S. 612 · verifier request budget exhausted
unverified325 S.W.3d 238 · verifier request budget exhausted
unverified363 S.W.3d 846 · verifier request budget exhausted
found196 S.W.3d 774 · in DocketRouter index
found236 S.W.3d 761 · in DocketRouter index
unverified140 S.W.3d 828 · verifier request budget exhausted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
48898ms · graded 2026-08-28 07:15
25%hll-cl11238656-1arbitrationdifficulty 4private splitupstage/solar-pro4 · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity50%×2
Citation checks
found127 S.W.3d 220 · in DocketRouter index
unverified529 S.W.3d 530 · verifier request budget exhausted
found149 S.W.3d 147 · in DocketRouter index
unverified236 S.W.3d 758 · verifier request budget exhausted
unverified148 S.W.3d 295 · verifier request budget exhausted
unverified524 S.W.3d 435 · verifier request budget exhausted
unverified128 S.W.3d 196 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
supported for: denying a motion to compel arbitration.
unsupported for: section on printed invoices, in all capital letters, followed by an
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
40282ms · graded 2026-08-28 07:14
0%hll-cl11238656-3arbitrationdifficulty 3private splitupstage/solar-pro4 · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified914 S.W.2d 963 · verifier request budget exhausted
unverified140 S.W.3d 606 · verifier request budget exhausted
unverified210 S.W.3d 748 · verifier request budget exhausted
unverified202 S.W.3d 923 · verifier request budget exhausted
unverified205 S.W.3d 200 · verifier request budget exhausted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
10916ms · graded 2026-08-28 07:14
25%hll-cl11335146-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found465 U.S. 1 · in DocketRouter index
found166 S.W.3d 732 · in DocketRouter index
in opinion180 S.W.3d 127
found195 S.W.3d 672 · in DocketRouter index
found570 S.W.3d 716 · in DocketRouter index
in opinion279 S.W.3d 640
in opinion52 S.W.3d 749
found465 S.W.3d 693 · in DocketRouter index
found80 S.W.3d 566 · in DocketRouter index
unverified647 S.W.3d 393 · verifier request budget exhausted
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: arising out of or relating to
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
21336ms · graded 2026-08-28 07:27
0%hll-cl11335146-3arbitrationdifficulty 5private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found166 S.W.3d 732 · in DocketRouter index
found235 S.W.3d 185 · in DocketRouter index
found995 S.W.2d 647 · in DocketRouter index
in opinion180 S.W.3d 127
found334 S.W.3d 220 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
12815ms · graded 2026-08-28 07:27
25%hll-cl11324660-4arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard100%×2
Authority75%×2
Quote fidelity0%×2
Citation checks
found547 S.W.3d 624 · in DocketRouter index
found279 S.W.3d 640 · in DocketRouter index
in opinion166 S.W.3d 732
in opinion180 S.W.3d 127
found293 S.W.3d 182 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported180 S.W.3d 127 for: the contract containing the arbitration clause. *In re Weekley Homes, L.P.*, 180 S.W.3d 127, 131–32 (Tex. 2005) (orig. proceeding). The doc
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
56127ms · graded 2026-08-28 07:23
0%hll-cl11319870-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
180003ms · graded 2026-08-28 07:23
25%hll-cl11324660-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority83%×2
Quote fidelity0%×2
Citation checks
in opinion166 S.W.3d 732
in opinion180 S.W.3d 127
found293 S.W.3d 182 · in DocketRouter index
found315 S.W.3d 888 · in DocketRouter index
found334 S.W.3d 220 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: merely being a third-party beneficiary to, or being mentioned in, a contract does not suffice.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
45468ms · graded 2026-08-28 07:22
92%hll-cl11324660-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity100%×2
Citation checks
in opinion166 S.W.3d 732
found293 S.W.3d 182 · in DocketRouter index
in opinion180 S.W.3d 127
found334 S.W.3d 220 · in DocketRouter index
found279 S.W.3d 640 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage293 S.W.3d 182 for: seeks to enforce a contract containing an arbitration clause against a nonsignatory
no passage293 S.W.3d 182 for: the claims are based on that contract
supported293 S.W.3d 182 for: must be determined by reference to
no passage334 S.W.3d 220 for: so intertwined with the agreement containing the arbitration clause that it would be unfair to allow the plaintiff to rely on the agreement
no passage279 S.W.3d 640 for: denies an application to compel arbitration made under Section 171.021.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
37797ms · graded 2026-08-28 07:22
0%hll-cl11319870-2arbitrationdifficulty 4private splitblankdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
no citations offered
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
69772ms · graded 2026-08-28 07:21
25%hll-cl11296835-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found437 S.W.3d 518 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
unsupported for: evident partiality by an arbitrator appointed as a neutral arbitrator.
unsupported for: Should the award be against appellant, or also include the defendant companies?
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
123994ms · graded 2026-08-28 07:15
50%hll-cl11296835-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified142 S.W.3d 366 · verifier request budget exhausted
found916 S.W.2d 32 · in DocketRouter index
found95 S.W.3d 234 · in DocketRouter index
found52 S.W.3d 749 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage142 S.W.3d 366 for: refused to postpone the hearing after sufficient cause shown.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
68462ms · graded 2026-08-28 07:14
25%hll-cl11296835-4arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority75%×2
Quote fidelity0%×2
Citation checks
in opinion339 S.W.3d 84
found292 S.W.3d 14 · in DocketRouter index
found95 S.W.3d 234 · in DocketRouter index
in opinion497 S.W.3d 490
Quote fidelity (every quotation must exist verbatim in its source)
unsupported339 S.W.3d 84 for: [A]n arbitrator’s error of law or fact is not a ground for vacating an award.
no passage292 S.W.3d 14 for: clearly violates a well-defined and dominant public policy.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
51944ms · graded 2026-08-28 07:14
50%hll-cl11296835-3arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found196 S.W.3d 774 · in DocketRouter index
unverified641 S.W.3d 533 · verifier rate-limited
unverified260 S.W.3d 680 · verifier rate-limited
unverified518 S.W.3d 437 · verifier rate-limited
Quote fidelity (every quotation must exist verbatim in its source)
no passage518 S.W.3d 437 for: reciting the parties’ agreement to arbitrate.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
31569ms · graded 2026-08-28 07:13
0%hll-cl11238656-2arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity0%×2
Citation checks
found196 S.W.3d 161 · in DocketRouter index
in opinion195 S.W.3d 672
found155 S.W.3d 202 · in DocketRouter index
in opinion172 S.W.3d 603
Quote fidelity (every quotation must exist verbatim in its source)
unsupported172 S.W.3d 603 for: received notice of the arbitration agreement and accepted it.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
84977ms · graded 2026-08-28 07:02
50%hll-cl11238656-4arbitrationdifficulty 5private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome100%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
found166 S.W.3d 732 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
in opinion52 S.W.3d 749
in opinion195 S.W.3d 672
found155 S.W.3d 202 · in DocketRouter index
found180 S.W.3d 127 · in DocketRouter index
found80 S.W.3d 566 · in DocketRouter index
found250 S.W.3d 66 · in DocketRouter index
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
40896ms · graded 2026-08-28 07:01
0%hll-cl11238656-3arbitrationdifficulty 3private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
unverified647 S.W.3d 179 · verifier request budget exhausted
found262 S.W.3d 337 · in DocketRouter index
found196 S.W.3d 774 · in DocketRouter index
Quote fidelity (every quotation must exist verbatim in its source)
no passage196 S.W.3d 774 for: [a] party cannot use mandamus as a substitute for an appeal when an adequate appellate remedy exists.
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
35933ms · graded 2026-08-28 07:01
0%hll-cl11238656-1arbitrationdifficulty 4private splitdeepseek/deepseek-v4-flash · raw
Axes
Outcome0%×2
Standard-×2
Authority0%×2
Quote fidelity-×2
Citation checks
in opinion195 S.W.3d 672
unverified466 S.W.3d 189 · verifier request budget exhausted
unverified249 S.W.3d 398 · verifier request budget exhausted
found155 S.W.3d 202 · in DocketRouter index
found148 S.W.3d 124 · in DocketRouter index
unverified200 S.W.3d 795 · verifier request budget exhausted
Private-split item: facts, answer key and answer withheld so the leaderboard stays uncontaminated. The scores above are complete.
31762ms · graded 2026-08-28 07:01