Call for participation in GikiCLEF 2009

Nuno Cardoso ncardoso at xldb.di.fc.ul.pt
Mo Jan 19 10:06:05 CET 2009


Apologies for cross-postings 

=========================================================================
GikiCLEF - Cross-language Geographic Information Retrieval from Wikipedia
A CLEF 2009 track
=========================================================================
http://www.linguateca.pt/GikiCLEF/

----------------------
Call for Participation
----------------------

You are invited to participate in GikiCLEF 2009, a CLEF track (http://www.clef-campaign.org/), whose aim is to evaluate systems which find Wikipedia entries / documents that answer a particular information need which requires geographical reasoning of some sort.

GikiCLEF is the follow-up of the GikiP 2008 pilot task which ran under GeoCLEF 2008, and is one of the tracks under CLEF, whose workshop will take place in Corfu Greece in connection with ECDL 2009.

TASK DESCRIPTION:
=================

Systems will receive a list of 50 questions and will have to return a list of answers (in the form of titles of Wikipedia entries) for each, from the GikiCLEF collection. 

GikiCLEF LANGUAGES:
===================
Questions and answers are to be found in the nine languages (and ten Wikipedia versions) below:

Bulgarian (BG), Dutch (NL), English (EN), German (DE), Italian (IT), Norwegian (NN and NO), Portuguese (PT), Romanian (RO) and Spanish (ES).

Systems may participate in any language subset, although the best system would have to process all languages.

GikiCLEF COLLECTION:
===================

The GikiCLEF collection comprehends the June 2008 Wikipedia document collections for the above mentioned languages, processed by the WikiXML tool developed by the University of Amsterdam (http://ilps.science.uva.nl/WikiXML/xmlformat.php). Also available to the participants are the June 2008 MediaWiki SQL and HTML dumps for the GikiCLEF languages.

TOPICS:
=======

Topics (or rather, questions) will be released early March 2009, in all GikiCLEF languages. The topic choice committee will devise topics with crosslingual and cultural interest, so that the need for looking in Wikipedia in different languages is not artificial.

See the Web site for topic examples and previous GikiP topics.

EVALUATION:
===========

After pooling all answers returned by the participant systems,
they will be manually assessed by the organization.
The systems will be evaluated according to the number of correct hits
and precision in all languages, so that multilinguality is rewarded.

IMPORTANT DATES:
================

18 January 2009: Final registration required.
February 2009: Discussion / Publication of the final definition of the GikiCLEF task.
March 2009: Topic release and run submission.
(2 weeks after topic release): Deadline for run submission.
June 2009: Assessment and GikiCLEF results made available.
14 August 2009: Submission of Papers for Working Notes
30 Sep/2 Oct 2009: CLEF Workshop (in Corfu, Greece)





Mehr Informationen über die Mailingliste IFI-CI-Event