Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/22011
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Tanti, Marc | - |
dc.contributor.author | Gatt, Albert | - |
dc.contributor.author | Camilleri, Kenneth P. | - |
dc.date.accessioned | 2017-09-26T10:31:22Z | - |
dc.date.available | 2017-09-26T10:31:22Z | - |
dc.date.issued | 2017 | - |
dc.identifier.citation | Tanti, M., Gatt, A., & Camilleri, K. P. (2017). Where to put the Image in an Image Caption Generator. Natural Language Engineering, 24 (3), 467–489. | en_GB |
dc.identifier.uri | https://www.um.edu.mt/library/oar//handle/123456789/22011 | - |
dc.description.abstract | When a neural language model is used for caption generation, the image information can be fed to the neural network either by directly in- corporating it in a recurrent neural network { conditioning the language model by injecting image features { or in a layer following the recurrent neural network { conditioning the language model by merging the image features. While merging implies that visual features are bound at the end of the caption generation process, injecting can bind the visual features at a variety stages. In this paper we empirically show that late binding is superior to early binding in terms of di erent evaluation metrics. This suggests that the di erent modalities (visual and linguistic) for caption generation should not be jointly encoded by the RNN; rather, the multi- modal integration should be delayed to a subsequent stage. Furthermore, this suggests that recurrent neural networks should not be viewed as actu- ally generating text, but only as encoding it for prediction in a subsequent layer. | en_GB |
dc.language.iso | en | en_GB |
dc.publisher | Cambridge University Press | - |
dc.rights | info:eu-repo/semantics/openAccess | en_GB |
dc.subject | Computational intelligence | en_GB |
dc.subject | Image analysis | en_GB |
dc.subject | Computer network architectures | en_GB |
dc.title | Where to put the image in an image caption generator | en_GB |
dc.type | article | en_GB |
dc.rights.holder | The copyright of this work belongs to the author(s)/publisher. The rights of this work are as defined by the appropriate Copyright Legislation or as modified by any successive legislation. Users may access this work and can make use of the information contained in accordance with the Copyright Legislation provided that the author must be properly acknowledged. Further distribution or reproduction in any format is prohibited without the prior permission of the copyright holder | en_GB |
dc.description.reviewed | peer-reviewed | en_GB |
dc.identifier.doi | 10.1017/S1351324918000098 | - |
dc.publication.title | Natural Language Engineering | - |
Appears in Collections: | Scholarly Works - InsLin |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Where_to_put_the_image_in_an_image_caption_generator(2017).pdf | 396.47 kB | Adobe PDF | View/Open |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.