Register Now
Register for the shared track LLM as a Judge?: From Statute Prediction to Sycophancy Detection in Law. Fill out the form below to receive training data and participate.
Form not loading? If the embedded form above doesn't display, click the button below to open it in a new tab.
Open Registration Form in New TabThe form opens in a new browser tab. After completing it, return to this page to continue.
How to Participate
Fill Out This Form
Provide your name, email, affiliation, and team details. Select which task(s) you wish to participate in. By submitting, you agree to the CC-BY-4.0 licensing terms and data usage restrictions described in the form.
Download Training Data
After registration, you will receive an email with the training data (525 cases for Task 1, ~7,380 instances for Task 2) and detailed instructions.
Build Your System
Develop a model that predicts applicable IPC sections, grounds them in facts, and generates legal reasoning (Task 1), or detects sycophantic behavior in LLM responses (Task 2).
Submit Predictions
Upload your JSONL submission file to CodaBench and check your score on the leaderboard. Submissions open on 25 July 2026.
Read the full task descriptions before registering: