An Adaption of BIOASQ Question Answering dataset for Machine Reading systems by Manual Annotations of Answer Spans.

Sanjay Kamath (1, 2) , Brigitte Grau (3, 2) , Yue Ma (1)

1 LaHDAK - LRI - Données et Connaissances Massives et Hétérogènes (LRI)
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
3 ENSIIE - Ecole Nationale Supérieure d'Informatique pour l'Industrie et l'Entreprise

BIOASQ Task B Phase B challenge focuses on extracting answers from snippets for a given question. The dataset provided by the organizers contains answers, but not all their variants. Henceforth a manual annotation was performed to extract all forms of correct answers. This article shows the impact of using all occurrences of correct answers for training on the evaluation scores which are improved significantly.

Keywords: Machine Reading; Biomedical Domain; Question Answering

Domains: Computer Science [cs]; Computer Science [cs]; Computation and Language [cs.CL]

Sanjay Kamath, Brigitte Grau, Yue Ma. An Adaption of BIOASQ Question Answering dataset for Machine Reading systems by Manual Annotations of Answer Spans.. BIOASQ - A challenge on large-scale biomedical semantic indexing and question answering, Nov 2018, Brussels - BE, Unknown Region. pp.7, ⟨10.18653/v1/w18-5309⟩. ⟨hal-02284466⟩