arXiv (Cornell University)
CLIPDraw++: Text-to-Sketch Synthesis with Simple Primitives
December 2023 • Nityanand Mathur, Shyam Marjit, Abhra Chaudhuri, Anjan Dutta
With the goal of understanding the visual concepts that CLIP associates with text prompts, we show that the latent space of CLIP can be visualized solely in terms of linear transformations on simple geometric primitives like straight lines and circles. Although existing approaches achieve this by sketch-synthesis-through-optimization, they do so on the space of higher order Bézier curves, which exhibit a wastefully large set of structures that they can evolve into, as most of them are non-essential for generating …