Photo Realistic Generation from Arabic Text Description Based on Generative Adversarial Networks

Abstract

Generating accurate high-resolution images from text representations is a difficult problem in computer vision that has a wide range of functional applications. Text-to-image conversion is not dissimilar to the difficulties inherent in language processing. For example, each text meaning can be encoded in two distinct human languages, while photographs and text are two distinct encoding languages for similar data. However, these are two distinct issues, since text-to-image or image-to-text conversions are extremely multimodal in nature. The proposed model for creating 256 × 256 realistic images from Arabic text descriptions is discussed in this article. The relationship between an Arabic word in a sentence and its component in a picture as introduced in this paper using the DAMSM model. This model teaches two neural networks how to map the Arabic picture and word sub-regions of a full sentence to a shared semantic model. It performs well as an Arabic-text encoder and a picture encoder. We start with the Modified-Arabic dataset and train the model from scratch. The proposed model establishes a new standard for the conversion of Arabic text to realistic pictures. A mutation happens when Arabic is used as the primary language for converting Arabic texts to real images. The inception score of the newly introduced model reported by 3.42 ± .05 on the CUB database.