FIRE 2026 TRACK

Registrations Closed

Registration for LLM as a Judge?: From Statute Prediction to Sycophancy Detection in Law is now closed. The evaluation is complete and the final results have been declared.

Closed: The registration form is no longer accepting responses. Run submissions closed on 5 August 2026 and the final results were declared on 31 August 2026. View the final leaderboard →

Final Results & Leaderboard Working Notes Submission

What Happens Now

1

Results Are Final

The final evaluation results for both tasks were declared on 31 August 2026 and verified thereafter. No further result submissions or corrections are accepted. The results page is the authoritative source for rankings.

2

Submit Your Working Notes

Participating teams submit Working Notes through Microsoft CMT by 15 September 2026, selecting the SYCOLEX track during submission and using the CUR template on Overleaf. Please do not mention your rank in the paper.

3

Camera-Ready & Conference

Camera-ready copies are due 5 October 2026, ahead of the FIRE 2026 conference in December 2026. Instructions for the final draft stage follow after the Working Notes deadline.

The full task descriptions remain available:

Task 1: Explainable Statute Prediction Task 2: Sycophancy Detection