Please use this identifier to cite or link to this item:
Title: A prototype for a conversational companion for reminiscing about images
Authors: Wilks, Yorick
Catizone, Roberta
Worgan, Simon
Dingli, Alexiei
Moore, Roger
Field, Debora
Cheng, Weiwei
Keywords: Human-computer interaction
Intelligent personal assistants (Computer software)
Knowledge management
Virtual computer systems
Issue Date: 2011-04
Publisher: Elsevier
Citation: Wilks, Y., Catizone, R., Worgan, S., Dingli, A., Moore, R., Field, D., & Cheng, W. (2011). A prototype for a conversational companion for reminiscing about images. Computer Speech & Language, 25(2), 140-157.
Abstract: This paper describes an initial prototype of the Companions project ( the Senior Companion (SC), designed to be a platform to display novel approaches to: (1) The use of Information Extraction (IE) techniques to extract the content of incoming dialogue utterances after an ASR phase. (2) The conversion of the input to RDF form to allow the generation of new facts from existing ones, under the control of a Dialogue Manager (DM), that also has access to stored knowledge and knowledge accessed in real time from the web, all in RDF form. (3) A DM expressed as a stack and network virtual machine that models mixed initiative in dialogue control. (4) A tuned dialogue act detector based on corpus evidence. The prototype platform was evaluated, and we describe this; it is also designed to support more extensive forms of emotion detection carried by both speech and lexical content, as well as extended forms of machine learning. We describe preliminary studies and results for these, in particular a novel approach to enabling reinforcement learning for open dialogue systems through the detection of emotion in the speech signal and its deployment as a form of a learned DM, at a higher level than the DM virtual machine and able to direct the SC’s responses to a more emotionally appropriate part of its repertoire. © 2010 Elsevier Ltd. All rights reserved.
Description: This work was funded by the COMPANIONS project sponsored by the European Commission as part of the Information Society Technologies (IST) programme under EC grant number IST-FP6-034434. Companions demonstrators can be seen at:∼roberta/companions/Web/.
Appears in Collections:Scholarly Works - FacICTAI

Files in This Item:
File Description SizeFormat 
OA - A prototype for a Conversational Companion for reminiscing about images.3-20.pdfA prototype for a conversational companion for reminiscing about images502.69 kBAdobe PDFView/Open

Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.