text-to-image generator

REF

• Text-to-Art Generator
  • blog: How I built an AI Text-to-Art Generator
  • github
  • colab
• clipit

Introduction

• CLIP(Contrastive Image-Language Pretraining): to score image.In short, CLIP is able to score how well an image matched a caption or vice versa
• VQGAN (Vector Quantized GAN): transformer image generator
  • The Illustrated VQGAN

work principle

VQGAN generate, and CLIP measure.

refer:

As the generator, VQGAN can be replaced by any kind of generator, such as StyleCLIP, CLIPDraw

Generating Art with VQGAN+CLIP with Code

backend

CLIP only

• Text2Image in 17 Lines of Python