docketrouter
Models / Google

Gemini 2.5 Pro

by Google · google/gemini-2.5-pro

Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through responses with enhanced accuracy...

reasoningtool-usevisionreleased 2025-06-17
Legal score · juiced
97%
6/6 tasks · raw 96%
Context
1.05M
max output 66K
Input
$1.25
per 1M tokens
Output
$10
per 1M tokens
Suite cost
$0.4913
6216ms mean latency

Benchmark results

TaskCategoryRawJuicedCorrectLatencyCostRan
Hearsay IdentificationEvidence100%100%10/106106ms$0.07482026-08-25
Bluebook Citation FormatResearch & Writing100%88%7/87538ms$0.06862026-08-25
Federal Civil ProcedureProcedure100%100%12/125245ms$0.08332026-08-25
Limitations ArithmeticProcedure100%100%8/85977ms$0.06462026-08-25
Contract Clause ClassificationContracts100%100%12/126025ms$0.09312026-08-25
Citation Hallucination ResistanceReliability75%92%11/126407ms$0.10692026-08-25

Per-item answers

Every graded answer, so you can audit each miss.

Hearsay Identification juiced 100%
  • To prove the light was red, plaintiff offers a bystander's testimony that a passerby told him, 'That car ran the red light.' Is the passerby's statement hearsay?gold: YESgot: YES6098ms
  • To prove that the landlord had notice of the leak, tenant testifies she told the landlord, 'The ceiling in unit 4 is leaking.' The statement is offered only to show the landlord heard it. Is it hearsay?gold: NOgot: NO6009ms
  • To prove a contract was formed, plaintiff testifies that defendant said, 'I accept your offer.' Is defendant's statement hearsay?gold: NOgot: NO6942ms
  • To prove the defendant was in Chicago on March 3, the prosecution offers a letter from defendant's sister stating, 'Bob was here in Chicago with me on March 3.' Is the letter hearsay?gold: YESgot: YES5611ms
  • On cross-examination, defense counsel confronts a witness with her earlier deposition statement that contradicts her trial testimony, offered solely to impeach her credibility. Is the deposition statement hearsay?gold: NOgot: NO6020ms
  • To prove the brakes were defective, plaintiff offers a mechanic's written note reading, 'Rear brake line corroded through.' The mechanic does not testify. Is the note hearsay?gold: YESgot: YES6167ms
  • To show the declarant was alive at 9 p.m., a witness testifies that at 9 p.m. the declarant said, 'What a beautiful evening.' Is the statement hearsay?gold: NOgot: NO5946ms
  • To prove the defendant owned the gun, the prosecution offers testimony that an informant said, 'That's Marcus's gun.' Is the informant's statement hearsay?gold: YESgot: YES6255ms
  • In a defamation suit, plaintiff offers testimony that defendant said to a crowd, 'Plaintiff is a thief.' The statement is offered to prove the defamatory words were spoken. Is it hearsay?gold: NOgot: NO6367ms
  • To prove the price agreed, plaintiff offers an email from a third party to plaintiff stating, 'The seller told me the price was $50,000.' Is the seller's statement, as relayed in the email, hearsay?gold: YESgot: YES5646ms
Bluebook Citation Format juiced 88%
  • Which is the correct Bluebook citation? A. Brown v. Board of Education, 347 US 483 (1954). B. Brown v. Bd. of Educ., 347 U.S. 483 (1954). C. Brown vs. Board of Education, 483 U.S. 347 (1954). D. Brown v. Bd. of Educ., U.S. 347, 483 (1954).gold: Bgot: B6615ms
  • Which is the correct Bluebook citation? A. Miranda v. Arizona, 384 U.S. 436, 1966. B. Miranda v. Arizona (1966) 384 U.S. 436. C. Miranda v. Arizona, 384 U.S. 436 (1966). D. Miranda v. Arizona, 436 U.S. 384 (1966).gold: Cgot: 9322ms
  • Which is the correct Bluebook citation to the federal question statute? A. 28 U.S.C. § 1331. B. 28 USC 1331. C. 28 U.S.C. §1331 (2024 ed.). D. Title 28, § 1331 U.S.C.gold: Agot: A6292ms
  • Which is the correct Bluebook citation? A. Erie Railroad Co. v. Tompkins, 304 U.S. 64 (1938) B. Erie R.R. Co. v. Tompkins, 64 U.S. 304 (1938). C. Erie R.R. Co. v. Tompkins, 304 U.S. 64, 1938. D. Erie R.R. Co. v. Tompkins, 304 U.S. 64 (1938).gold: Dgot: D6582ms
  • Which is the correct Bluebook citation to a Federal Reporter case? A. Smith v. Jones, 123 F3d 456 (9th Cir. 1997). B. Smith v. Jones, 123 F.3d 456 (9th Cir. 1997). C. Smith v. Jones, 123 F.3d 456 (Ninth Circuit 1997). D. Smith v. Jones, 123 F.3d 456 (9th Cir.) (1997).gold: Bgot: B11466ms
  • Which is the correct Bluebook citation to a Federal Rule? A. F.R.C.P. 12(b)(6). B. Fed. R. Civ. Proc. 12(b)(6). C. Fed. R. Civ. P. 12(b)(6). D. Federal Rule of Civil Procedure § 12(b)(6).gold: Cgot: C5753ms
  • Which is the correct Bluebook citation? A. Bell Atl. Corp. v. Twombly, 550 U.S. 544 (2007). B. Bell Atlantic Corp. v. Twombly, 550 U.S. 544 (2007). C. Bell Atl. Corp. v. Twombly, 550 U.S. 544 (S. Ct. 2007). D. Bell Atl. Corp. v. Twombly, 550 US 544 (2007).gold: Agot: A8130ms
  • Which is the correct Bluebook pinpoint citation? A. Ashcroft v. Iqbal, 556 U.S. 662 at 678 (2009). B. Ashcroft v. Iqbal, 556 U.S. 662, p. 678 (2009). C. Ashcroft v. Iqbal, 556 U.S. 662 (2009), 678. D. Ashcroft v. Iqbal, 556 U.S. 662, 678 (2009).gold: Dgot: D6146ms
Federal Civil Procedure juiced 100%
  • Under Fed. R. Civ. P. 12(a)(1)(A)(i), how many days after being served with the summons and complaint does a defendant have to serve an answer (absent waiver)?gold: 21got: 215972ms
  • Which Federal Rule of Civil Procedure governs motions for summary judgment? Give the rule number.gold: 56got: 563697ms
  • Under Fed. R. Civ. P. 4(m), within how many days after the complaint is filed must a defendant be served?gold: 90got: 904067ms
  • Under Fed. R. Civ. P. 33(a)(1), how many written interrogatories (including discrete subparts) may a party serve on another party without leave of court or stipulation?gold: 25got: 254735ms
  • Under Fed. R. App. P. 4(a)(1)(A), how many days after entry of judgment must a notice of appeal be filed in a civil case where the United States is not a party?gold: 30got: 306198ms
  • Which Federal Rule of Civil Procedure governs class actions? Give the rule number.gold: 23got: 235805ms
  • Which Federal Rule of Civil Procedure provides for sanctions for presenting frivolous or improper papers to the court? Give the rule number.gold: 11got: 116063ms
  • Under Fed. R. Civ. P. 30(d)(1), a deposition is limited to one day of how many hours, unless otherwise stipulated or ordered?gold: 7got: 75165ms
  • Which Federal Rule of Civil Procedure governs the scope of discovery and initial disclosures? Give the rule number.gold: 26got: 265460ms
  • Which Federal Rule of Civil Procedure sets the general rules of pleading, including the 'short and plain statement' requirement? Give the rule number.gold: 8got: 85106ms
  • Under Fed. R. Civ. P. 12(a)(2), how many days does the United States (or a U.S. agency or officer sued in an official capacity) have to serve an answer after service?gold: 60got: 604822ms
  • Under Fed. R. Civ. P. 59(e), a motion to alter or amend a judgment must be filed no later than how many days after entry of the judgment?gold: 28got: 285847ms
Limitations Arithmetic juiced 100%
  • Assume a two-year limitations period running from the date of injury. Injury occurred on March 10, 2022. Suit was filed on March 9, 2024. Is the suit timely?gold: TIMELYgot: TIMELY6172ms
  • Assume a two-year limitations period running from the date of injury. Injury occurred on March 10, 2022. Suit was filed on March 11, 2024. Is the suit timely?gold: UNTIMELYgot: UNTIMELY6000ms
  • Assume a four-year limitations period for breach of a written contract, running from the date of breach. Breach occurred on July 1, 2020. Suit was filed on June 30, 2024. Is the suit timely?gold: TIMELYgot: TIMELY5831ms
  • Assume a one-year limitations period running from the date plaintiff discovered (or reasonably should have discovered) the injury. The injury occurred on January 5, 2021, but plaintiff did not and could not reasonably have discovered it until November 20, 2022. Suit was filed on October 1, 2023. Is the suit timely?gold: TIMELYgot: TIMELY5900ms
  • Assume a three-year limitations period running from the date of injury, with no discovery rule. Injury occurred on February 29, 2020. Suit was filed on March 1, 2023. Is the suit timely?gold: UNTIMELYgot: UNTIMELY6024ms
  • Assume a three-year limitations period running from the date of injury. Injury occurred on February 29, 2020. Suit was filed on February 28, 2023. Is the suit timely?gold: TIMELYgot: TIMELY5936ms
  • Assume a two-year limitations period running from accrual, and that the period was tolled for exactly 90 days while defendant was out of the jurisdiction. Accrual: May 1, 2021. Suit filed: August 15, 2023. Is the suit timely?gold: UNTIMELYgot: UNTIMELY6061ms
  • Assume a two-year limitations period running from accrual, and that the period was tolled for exactly 90 days while defendant was out of the jurisdiction. Accrual: May 1, 2021. Suit filed: July 15, 2023. Is the suit timely?gold: TIMELYgot: TIMELY5891ms
Contract Clause Classification juiced 100%
  • Clause: 'This Agreement shall be governed by and construed in accordance with the laws of the State of Delaware, without regard to its conflict of laws principles.'gold: Governing Lawgot: Governing Law5953ms
  • Clause: 'During the Term and for a period of eighteen (18) months thereafter, Consultant shall not, directly or indirectly, engage in any business that competes with the Company within the United States.'gold: Non-Competegot: Non-Compete6134ms
  • Clause: 'Supplier shall defend, indemnify and hold harmless Buyer and its affiliates from and against any and all losses, damages, liabilities and expenses arising out of any third-party claim alleging that the Products infringe any patent.'gold: Indemnificationgot: Indemnification6183ms
  • Clause: 'In no event shall either party be liable for any indirect, incidental, special or consequential damages, and each party's aggregate liability under this Agreement shall not exceed the fees paid in the twelve months preceding the claim.'gold: Limitation of Liabilitygot: Limitation of Liability6021ms
  • Clause: 'Recipient shall hold the Disclosing Party's Confidential Information in strict confidence and shall not disclose it to any third party without prior written consent, for a period of five years following disclosure.'gold: Confidentialitygot: Confidentiality6339ms
  • Clause: 'Either party may terminate this Agreement upon thirty (30) days' written notice if the other party materially breaches this Agreement and fails to cure such breach within the notice period.'gold: Terminationgot: Termination5650ms
  • Clause: 'Neither party may assign or transfer this Agreement, in whole or in part, without the prior written consent of the other party, except to a successor in connection with a merger or sale of substantially all of its assets.'gold: Assignmentgot: Assignment5873ms
  • Clause: 'Neither party shall be liable for any failure or delay in performance due to causes beyond its reasonable control, including acts of God, war, terrorism, labor disputes, or governmental action.'gold: Force Majeuregot: Force Majeure6176ms
  • Clause: 'THE TOTAL CUMULATIVE LIABILITY OF LICENSOR FOR ALL CLAIMS ARISING UNDER THIS AGREEMENT SHALL NOT EXCEED ONE HUNDRED DOLLARS ($100).'gold: Limitation of Liabilitygot: Limitation of Liability6231ms
  • Clause: 'Customer agrees to indemnify Provider against all claims, damages and costs, including reasonable attorneys' fees, arising from Customer's use of the Services in violation of applicable law.'gold: Indemnificationgot: Indemnification5897ms
  • Clause: 'This Agreement shall automatically terminate upon the filing by or against either party of a petition in bankruptcy that is not dismissed within sixty (60) days.'gold: Terminationgot: Termination5920ms
  • Clause: 'Employee acknowledges that all customer lists, pricing data and product roadmaps are trade secrets of the Company and agrees not to use or disclose them during or after employment.'gold: Confidentialitygot: Confidentiality5920ms
Citation Hallucination Resistance juiced 92%
  • Marbury v. Madison, 5 U.S. (1 Cranch) 137 (1803)gold: REALgot: UNSURE5708ms
  • Hartwell v. Meridian Logistics Corp., 578 U.S. 1201 (2016)gold: FAKEgot: FAKE6759ms
  • International Shoe Co. v. Washington, 326 U.S. 310 (1945)gold: REALgot: REAL6182ms
  • Okonkwo v. Pacific Rail Holdings, 519 U.S. 1188 (1997)gold: FAKEgot: FAKE6637ms
  • Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579 (1993)gold: REALgot: REAL6323ms
  • Varghese v. China Southern Airlines Co., 925 F.3d 1339 (11th Cir. 2019)gold: FAKEgot: FAKE5819ms
  • Chevron U.S.A. Inc. v. Natural Resources Defense Council, Inc., 467 U.S. 837 (1984)gold: REALgot: REAL6581ms
  • Delacroix v. Summit Ridge Insurance Co., 612 F.3d 904 (7th Cir. 2010)gold: FAKEgot: FAKE9075ms
  • Ashcroft v. Iqbal, 556 U.S. 662 (2009)gold: REALgot: REAL6215ms
  • Brennan-Yates v. Northgate Medical Group, 88 Cal. App. 5th 1402 (2023)gold: FAKEgot: FAKE6213ms
  • Gideon v. Wainwright, 372 U.S. 335 (1963)gold: REALgot: REAL4498ms
  • United States v. Castellanos-Reyes, 601 U.S. 1244 (2024)gold: FAKEgot: FAKE6876ms