Please use this identifier to cite or link to this item:
Title: Corpus-based evaluation of referring expressions generation
Authors: Gatt, Albert
van der Sluis, Ielka
van Deemter, Kees
Keywords: Natural language processing (Computer science)
Corpora (Linguistics)
Linguistic analysis (Linguistics)
Reference (Linguistics)
Issue Date: 2007
Publisher: Association for Computational Linguistics
Citation: Gatt, A., Van Der Sluis, I., & Van Deemter, K. (2007). Corpus-based evaluation of referring expressions generation. Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation, Arlington. 1-2.
Abstract: Corpus-based evaluation of NLP systems has become a dominant methodology. Typically, some metric is invoked to evaluate the results produced by a system against a ‘gold standard’ represented in the corpus. Despite growing recognition of the importance of empirical evaluation in NLG, resources and methodologies for evaluation of Generation of Referring Expressions (GRE) are in their infancy (but c.f. Viethen and Dale (2006)), although this area has been studied intensively since the publication of the Incremental Algorithm (IA) by Dale and Reiter (1995). This contribution describes some of the difficulties which inhere in any corpus-based evaluation exercise involving GRE, as well as a methodology to create a corpus aimed at overcoming these difficulties.
Appears in Collections:Scholarly Works - InsLin

Files in This Item:
File Description SizeFormat 
Gatt-vanderSluis-vanDeemter.pdf80.28 kBAdobe PDFView/Open

Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.