Speaker
Maik Fröbe
(U Jena)
Description
TIRA is a platform to organize shared tasks with software
submissions, mostly in information retrieval and natural language
processing. Due to the software submissions, TIRA allows blinded
experimentation on (confidential) datasets to which participants have no
access. After a shared task, the artifacts of the shared tasks, i.e.,
research data in the form of submitted software, inputs, and outputs to
systems, or ground-truth labels, can be made publicly accessible if
desired. Archiving of software and data artifacts in TIRA aims to
improve experimental results' reproducibility and simplify comparisons
against strong baselines in future research.
