Track: LLM as a Judge?

Organizers

Meet the team behind the FIRE 2026 shared track on statute prediction and sycophancy detection.

§ 01 · ORGANIZING TEAM

Organizing Team

KG
Kripabandhu Ghosh
IISER Kolkata, India
Track Co-Organizer

Expert in legal informatics and information retrieval, with extensive experience organizing FIRE shared tasks on Indian legal texts.

LE
Liana Ermakova
Université de Bretagne Occidentale, France
Track Co-Organizer

Specialist in natural language processing and summarization, with deep involvement in CLEF evaluation campaigns over many years.

SS
Shuvam Banerji Seal
IISER Kolkata, India
Task Organizer

Researcher focused on legal NLP and AI for Indian law, contributing to dataset curation and evaluation methodology.

SA
Subinay Adhikary
IISER Kolkata, India
Task Organizer

Researcher working on legal AI and information retrieval, supporting data annotation and baseline development.

JK
Jaap Kamps
University of Amsterdam, Netherlands
Track Co-Organizer

Veteran information retrieval researcher with decades of experience organizing evaluation campaigns at INEX, TREC, and CLEF.


§ 02 · PRIOR EXPERIENCE

Prior Experience

The organizing team brings extensive experience from major information retrieval evaluation campaigns worldwide.

Kripabandhu Ghosh
IISER Kolkata, India
  • Co-organized FIRE shared tasks: IRMiDiS, IRLeD, AILA, AISoMe
  • Part of the FIRE organizational committee
Liana Ermakova
Université de Bretagne Occidentale, France
  • Co-organized CLEF SimpleText Track (2021–2026)
  • Co-organized CLEF JOKER Track (2022–2026)
  • Attended multiple FIRE editions
Jaap Kamps
University of Amsterdam, Netherlands
  • Organized tracks at INEX (2007–2014)
  • Organized tracks at TREC (2012–2016)
  • Organized tracks at CLEF (2005–2006, 2012–2016, 2021–2026)
  • Regular FIRE attendee