BioASQ challenge on biomedical IR, QA, summarization (task 1b) about to start

[George Paliouras]

[ please distribute - apologies for multiple postings ]

 

BioASQ challenge on large-scale biomedical semantic indexing and question
answering

(BioASQ workshop after CLEF 2013 in Valencia, Spain on September 27, 2013)

 

                   Web site: http://bioasq.org/

                twitter: https://twitter.com/bioasq

 

The second task of the BioASQ challenge (Task 1B: biomedical question
answering) will start on Wednesday June 19, 2013. The task is related to:

* information retrieval, including document and snippet retrieval, 

* question answering for document collections and ontologies, 

* summarization from documents and structured information.

 

Task 1B will use benchmark datasets containing English questions and gold
standard (reference) answers. The datasets are being constructed by a team
of biomedical experts from around Europe. Task 1B will run in two phases:

- Phase A: BioASQ will release questions from the benchmark datasets. The
participants will have to respond with relevant concepts (from designated
terminologies and ontologies), relevant articles (in English, from
designated article repositories), relevant snippets (from the relevant
articles), and relevant RDF triples (from designated ontologies).

- Phase B: BioASQ will release questions and gold (correct) relevant
concepts, articles, snippets, and RDF triples from the benchmark datasets.
The participants will have to respond with "exact" answers (e.g., named
entities in the case of factoid questions) and "ideal" answers
(paragraph-sized summaries), both in English. 

 

It is allowed to participate in both or only one of the phases, and in each
phase it is allowed to return all or only some of the expected answers
(e.g., only snippets in Phase A, only exact answers in Phase B).

 

A development dataset of 29 questions and gold answers is already available
at: http://bioasq.lip6.fr/general_information/Task1b/#developmentDataset

 

To make participating in Task 1B easier, the task will run in three
consecutive periods (batches), one every 3 weeks. It is allowed to
participate in some or all of the batches. 

 

Prizes will be awarded to the winners of each batch. Check the following
page for more information: http://www.bioasq.org/participate/prizes

 

For each batch, first only the questions of the batch will be released, and
the participants will have to submit their answers for Phase A (concepts,
articles, snippets, RDF triples) within 24 hours; then the gold concepts,
articles, snippets, and RDF triples for the questions of the batch will also
be provided, and the participants will again have 24 hours to submit their
answers for Phase B ("exact" and "ideal" answers of different types,
depending on the question). More information about the task can be found at:
http://bioasq.lip6.fr/general_information/Task1b/

 

Registration for Task 1B is open and will remain open until the end of the
challenge in August. In order to register and participate, please visit the
BioASQ participants area: http://bioasq.lip6.fr/

 

Important dates:

June 19, 2013: Start of Task 1B - first batch

July 10, 2013: Second batch of Task 1B

July 31, 2013: Third batch of Task 1B

September 27, 2013: BioASQ Workshop (collocated with CLEF 2013, Valencia,
Spain).

 

Good luck from the BioASQ team!

 

The BioASQ challenge and workshop are organised by the BioASQ project,
supported by the European Commission within the 7th Framework Programme
(Grant Agreement No. 318652).

 

-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <https://lists.tu-clausthal.de/cgi-bin/mailman/private/ifi-ci-event/attachments/20130606/94641011/attachment.html>