Benchmarking Multimedia Technologies with the CAMOMILE Platform: the Case of Multimodal Person Discovery at MediaEval 2015

Johann Poignant (1) , Hervé Bredin (1) , Claude Barras (1) , Mickael Stefas (2) , Pierrick Bruneau (2) , Thomas Tamisier (2)

1 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
2 LIST - Luxembourg Institute of Science and Technology

In this paper, we claim that the CAMOMILE collaborative annotation platform (developed in the framework of the eponymous CHIST-ERA project) eases the organization of multimedia technology benchmarks, automating most of the campaign technical workflow and enabling collaborative (hence faster and cheaper) annotation of the evaluation data. This is demonstrated through the successful organization of a new multimedia task at MediaEval 2015, Multimodal Person Discovery in Broadcast TV.

Keywords: evaluation campaign; collaborative annotation; multimedia

Domains: Computer Science [cs]; Multimedia [cs.MM]

Johann Poignant, Hervé Bredin, Claude Barras, Mickael Stefas, Pierrick Bruneau, et al.. Benchmarking Multimedia Technologies with the CAMOMILE Platform: the Case of Multimodal Person Discovery at MediaEval 2015. LREC 2016, May 2016, Portorož, Slovenia. ⟨hal-01690277⟩