We propose a competitive shared evaluation task for Surface Realisation in Spanish. The task would be carried out in 2012. It would involve the generation of text in Spanish from a common ground input shared by all systems. Separate corpora for training/development (composed of pairs of common ground input and expected string result) and testing (only common ground input) will be provided. Automatic evaluation procedures will be provided. Submitted results will also be subject to human evaluation. The present proposal is tentative in two different ways. First, the authors intend to revise the proposal in view of the experience and feedback of the Surface Realisation Pilot Task currently in process for English, once its results are made public in August. Second, the authors are willing to colaborate both with organizers of equivalent tasks for other languages or more researchers interested in surface realisation for Spanish.

Miguel Ballesteros will give a brief presentation of our task proposal at UCNLG+Eval Workshop that will be held at EMNLP 2011

"A Proposal for a Spanish Surface Realization Shared Task" which we submitted to the GenChal'11 Future Task Proposals Track has been accepted for presentation at the GenChal'11 Session at ENLG'11 and publication in the ENLG'11 proceedings. Surface Realisation 2011

With a view to applying for funding to this aim, it would help us to have an early estimate of the number of potential participants. If you would like to support this initiative, please write to us (pgervas@sip.ucm.es, miballes@fdi.ucm.es). Support may be in the form of volunteering a potential entry, collaborating on the design of the ground input or the evaluation procedures, or simply expressing an interest in the task. As mentioned above, it would help us to hear from interested parties before the 2011 meeting of the Generation Challenges initiative, which will take place during ENLG in Nancy on 28 - 30 September 20011 (http://talc.loria.fr/13th-European-Workshop-on-Natural.html). Expressions of interest are not binding. Please use subject line "EoI SR Spanish", and include a brief description of your potential submission.

Posted by Pablo Gervás on June 14, 2011  •   •  Expression of Interest