Skip to main navigation Skip to search Skip to main content

ChatPainter: Improving text to image generation using dialogue

  • Microsoft USA
  • Université de Montréal

Research output: Contribution to conference types › Conference Paper › peer-review

64 Citations (Scopus)

Abstract

Synthesizing realistic images from text descriptions on a dataset like Microsoft Common Objects in Context (COCO), where each image can contain several objects, is a challenging task. Prior work has used text captions to generate images. However, captions might not be informative enough to capture the entire image and insufficient for the model to be able to understand which objects in the images correspond to which words in the captions. We show that adding a dialogue that further describes the scene leads to significant improvement in the inception score and in the quality of generated images on the COCO dataset.

Original languageEnglish
Publication statusPublished - 2018
Externally publishedYes
Event6th International Conference on Learning Representations, ICLR 2018 - Vancouver, Canada
Duration: 30 Apr 2018 → 3 May 2018

Conference

Conference6th International Conference on Learning Representations, ICLR 2018
Country/TerritoryCanada
CityVancouver
Period30/04/18 → 3/05/18

ASJC Scopus subject areas

  • Education
  • Computer Science Applications
  • Linguistics and Language
  • Language and Linguistics

Fingerprint

Dive into the research topics of 'ChatPainter: Improving text to image generation using dialogue'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this