Generated Contents Enrichment

  • 2024-05-06 18:14:09
  • Mahdi Naseri, Jiayan Qiu, Zhou Wang
  • 0

Abstract

In this paper, we investigate a novel artificial intelligence generationtask, termed as generated contents enrichment (GCE). Different fromconventional artificial intelligence contents generation task that enriches thegiven textual description implicitly with limited semantics for generatingvisually real content, our proposed GCE strives to perform content enrichmentexplicitly on both the visual and textual domain, from which the enrichedcontents are visually real, structurally reasonable, and semantically abundant.Towards to solve GCE, we propose a deep end-to-end method that explicitlyexplores the semantics and inter-semantic relationships during the enrichment.Specifically, we first model the input description as a semantic graph, whereineach node represents an object and each edge corresponds to the inter-objectrelationship. We then adopt Graph Convolutional Networks on top of the inputscene description to predict the enriching objects and their relationships withthe input objects. Finally, the enriched graph is fed into an image synthesismodel to carry out the visual contents generation. Our experiments conducted onthe Visual Genome dataset exhibit promising and visually plausible results.

 

Quick Read (beta)

loading the full paper ...