CLIPDraw++: Text-to-Sketch Synthesis with Simple Primitives Article Swipe
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2312.02345
With the goal of understanding the visual concepts that CLIP associates with text prompts, we show that the latent space of CLIP can be visualized solely in terms of linear transformations on simple geometric primitives like straight lines and circles. Although existing approaches achieve this by sketch-synthesis-through-optimization, they do so on the space of higher order Bézier curves, which exhibit a wastefully large set of structures that they can evolve into, as most of them are non-essential for generating meaningful sketches. We present CLIPDraw++, an algorithm that provides significantly better visualizations for CLIP text embeddings, using only simple primitive shapes like straight lines and circles. This constrains the set of possible outputs to linear transformations on these primitives, thereby exhibiting an inherently simpler mathematical form. The synthesis process of CLIPDraw++ can be tracked end-to-end, with each visual concept being expressed exclusively in terms of primitives. Project Page: https://clipdrawx.github.io/.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2312.02345
- https://arxiv.org/pdf/2312.02345
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4389421235
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4389421235Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2312.02345Digital Object Identifier
- Title
-
CLIPDraw++: Text-to-Sketch Synthesis with Simple PrimitivesWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2023Year of publication
- Publication date
-
2023-12-04Full publication date if available
- Authors
-
Nityanand Mathur, Shyam Marjit, Abhra Chaudhuri, Anjan DuttaList of authors in order
- Landing page
-
https://arxiv.org/abs/2312.02345Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2312.02345Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2312.02345Direct OA link when available
- Concepts
-
Sketch, Computer science, Simple (philosophy), Set (abstract data type), Space (punctuation), Process (computing), Geometric primitive, Linear space, Theoretical computer science, Artificial intelligence, Programming language, Algorithm, Mathematics, Discrete mathematics, Philosophy, Epistemology, Operating systemTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4389421235 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2312.02345 |
| ids.doi | https://doi.org/10.48550/arxiv.2312.02345 |
| ids.openalex | https://openalex.org/W4389421235 |
| fwci | |
| type | preprint |
| title | CLIPDraw++: Text-to-Sketch Synthesis with Simple Primitives |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12290 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.9929999709129333 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2207 |
| topics[0].subfield.display_name | Control and Systems Engineering |
| topics[0].display_name | Human Motion and Animation |
| topics[1].id | https://openalex.org/T10481 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9915000200271606 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1704 |
| topics[1].subfield.display_name | Computer Graphics and Computer-Aided Design |
| topics[1].display_name | Computer Graphics and Visualization Techniques |
| topics[2].id | https://openalex.org/T10719 |
| topics[2].field.id | https://openalex.org/fields/22 |
| topics[2].field.display_name | Engineering |
| topics[2].score | 0.9865000247955322 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2206 |
| topics[2].subfield.display_name | Computational Mechanics |
| topics[2].display_name | 3D Shape Modeling and Analysis |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2779231336 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9407163262367249 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q7534724 |
| concepts[0].display_name | Sketch |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.7962494492530823 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C2780586882 |
| concepts[2].level | 2 |
| concepts[2].score | 0.7467331886291504 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q7520643 |
| concepts[2].display_name | Simple (philosophy) |
| concepts[3].id | https://openalex.org/C177264268 |
| concepts[3].level | 2 |
| concepts[3].score | 0.7224191427230835 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1514741 |
| concepts[3].display_name | Set (abstract data type) |
| concepts[4].id | https://openalex.org/C2778572836 |
| concepts[4].level | 2 |
| concepts[4].score | 0.6110905408859253 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q380933 |
| concepts[4].display_name | Space (punctuation) |
| concepts[5].id | https://openalex.org/C98045186 |
| concepts[5].level | 2 |
| concepts[5].score | 0.508948564529419 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q205663 |
| concepts[5].display_name | Process (computing) |
| concepts[6].id | https://openalex.org/C181095308 |
| concepts[6].level | 2 |
| concepts[6].score | 0.4866853356361389 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1541599 |
| concepts[6].display_name | Geometric primitive |
| concepts[7].id | https://openalex.org/C176370821 |
| concepts[7].level | 2 |
| concepts[7].score | 0.44493240118026733 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q1826459 |
| concepts[7].display_name | Linear space |
| concepts[8].id | https://openalex.org/C80444323 |
| concepts[8].level | 1 |
| concepts[8].score | 0.4287705421447754 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q2878974 |
| concepts[8].display_name | Theoretical computer science |
| concepts[9].id | https://openalex.org/C154945302 |
| concepts[9].level | 1 |
| concepts[9].score | 0.3913455307483673 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[9].display_name | Artificial intelligence |
| concepts[10].id | https://openalex.org/C199360897 |
| concepts[10].level | 1 |
| concepts[10].score | 0.31132441759109497 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[10].display_name | Programming language |
| concepts[11].id | https://openalex.org/C11413529 |
| concepts[11].level | 1 |
| concepts[11].score | 0.3067249655723572 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q8366 |
| concepts[11].display_name | Algorithm |
| concepts[12].id | https://openalex.org/C33923547 |
| concepts[12].level | 0 |
| concepts[12].score | 0.15008601546287537 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[12].display_name | Mathematics |
| concepts[13].id | https://openalex.org/C118615104 |
| concepts[13].level | 1 |
| concepts[13].score | 0.14518091082572937 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q121416 |
| concepts[13].display_name | Discrete mathematics |
| concepts[14].id | https://openalex.org/C138885662 |
| concepts[14].level | 0 |
| concepts[14].score | 0.0 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[14].display_name | Philosophy |
| concepts[15].id | https://openalex.org/C111472728 |
| concepts[15].level | 1 |
| concepts[15].score | 0.0 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q9471 |
| concepts[15].display_name | Epistemology |
| concepts[16].id | https://openalex.org/C111919701 |
| concepts[16].level | 1 |
| concepts[16].score | 0.0 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q9135 |
| concepts[16].display_name | Operating system |
| keywords[0].id | https://openalex.org/keywords/sketch |
| keywords[0].score | 0.9407163262367249 |
| keywords[0].display_name | Sketch |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.7962494492530823 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/simple |
| keywords[2].score | 0.7467331886291504 |
| keywords[2].display_name | Simple (philosophy) |
| keywords[3].id | https://openalex.org/keywords/set |
| keywords[3].score | 0.7224191427230835 |
| keywords[3].display_name | Set (abstract data type) |
| keywords[4].id | https://openalex.org/keywords/space |
| keywords[4].score | 0.6110905408859253 |
| keywords[4].display_name | Space (punctuation) |
| keywords[5].id | https://openalex.org/keywords/process |
| keywords[5].score | 0.508948564529419 |
| keywords[5].display_name | Process (computing) |
| keywords[6].id | https://openalex.org/keywords/geometric-primitive |
| keywords[6].score | 0.4866853356361389 |
| keywords[6].display_name | Geometric primitive |
| keywords[7].id | https://openalex.org/keywords/linear-space |
| keywords[7].score | 0.44493240118026733 |
| keywords[7].display_name | Linear space |
| keywords[8].id | https://openalex.org/keywords/theoretical-computer-science |
| keywords[8].score | 0.4287705421447754 |
| keywords[8].display_name | Theoretical computer science |
| keywords[9].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[9].score | 0.3913455307483673 |
| keywords[9].display_name | Artificial intelligence |
| keywords[10].id | https://openalex.org/keywords/programming-language |
| keywords[10].score | 0.31132441759109497 |
| keywords[10].display_name | Programming language |
| keywords[11].id | https://openalex.org/keywords/algorithm |
| keywords[11].score | 0.3067249655723572 |
| keywords[11].display_name | Algorithm |
| keywords[12].id | https://openalex.org/keywords/mathematics |
| keywords[12].score | 0.15008601546287537 |
| keywords[12].display_name | Mathematics |
| keywords[13].id | https://openalex.org/keywords/discrete-mathematics |
| keywords[13].score | 0.14518091082572937 |
| keywords[13].display_name | Discrete mathematics |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2312.02345 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2312.02345 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2312.02345 |
| locations[1].id | doi:10.48550/arxiv.2312.02345 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2312.02345 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5102623859 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Nityanand Mathur |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Mathur, Nityanand |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5072834529 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-7385-4432 |
| authorships[1].author.display_name | Shyam Marjit |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Marjit, Shyam |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5085117078 |
| authorships[2].author.orcid | https://orcid.org/0009-0004-3723-668X |
| authorships[2].author.display_name | Abhra Chaudhuri |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Chaudhuri, Abhra |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5008386240 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-1667-2245 |
| authorships[3].author.display_name | Anjan Dutta |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Dutta, Anjan |
| authorships[3].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2312.02345 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2023-12-07T00:00:00 |
| display_name | CLIPDraw++: Text-to-Sketch Synthesis with Simple Primitives |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12290 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.9929999709129333 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2207 |
| primary_topic.subfield.display_name | Control and Systems Engineering |
| primary_topic.display_name | Human Motion and Animation |
| related_works | https://openalex.org/W2378994405, https://openalex.org/W2385974820, https://openalex.org/W2373478030, https://openalex.org/W2378679551, https://openalex.org/W3149739944, https://openalex.org/W2392363776, https://openalex.org/W2063051341, https://openalex.org/W2591066345, https://openalex.org/W1494563618, https://openalex.org/W2357022711 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2312.02345 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2312.02345 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2312.02345 |
| primary_location.id | pmh:oai:arXiv.org:2312.02345 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2312.02345 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2312.02345 |
| publication_date | 2023-12-04 |
| publication_year | 2023 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 60 |
| abstract_inverted_index.We | 81 |
| abstract_inverted_index.an | 84, 120 |
| abstract_inverted_index.as | 71 |
| abstract_inverted_index.be | 23, 131 |
| abstract_inverted_index.by | 45 |
| abstract_inverted_index.do | 48 |
| abstract_inverted_index.in | 26, 141 |
| abstract_inverted_index.of | 3, 20, 28, 53, 64, 73, 109, 128, 143 |
| abstract_inverted_index.on | 31, 50, 115 |
| abstract_inverted_index.so | 49 |
| abstract_inverted_index.to | 112 |
| abstract_inverted_index.we | 14 |
| abstract_inverted_index.The | 125 |
| abstract_inverted_index.and | 38, 103 |
| abstract_inverted_index.are | 75 |
| abstract_inverted_index.can | 22, 68, 130 |
| abstract_inverted_index.for | 77, 91 |
| abstract_inverted_index.set | 63, 108 |
| abstract_inverted_index.the | 1, 5, 17, 51, 107 |
| abstract_inverted_index.CLIP | 9, 21, 92 |
| abstract_inverted_index.This | 105 |
| abstract_inverted_index.With | 0 |
| abstract_inverted_index.each | 135 |
| abstract_inverted_index.goal | 2 |
| abstract_inverted_index.like | 35, 100 |
| abstract_inverted_index.most | 72 |
| abstract_inverted_index.only | 96 |
| abstract_inverted_index.show | 15 |
| abstract_inverted_index.text | 12, 93 |
| abstract_inverted_index.that | 8, 16, 66, 86 |
| abstract_inverted_index.them | 74 |
| abstract_inverted_index.they | 47, 67 |
| abstract_inverted_index.this | 44 |
| abstract_inverted_index.with | 11, 134 |
| abstract_inverted_index.Page: | 146 |
| abstract_inverted_index.being | 138 |
| abstract_inverted_index.form. | 124 |
| abstract_inverted_index.into, | 70 |
| abstract_inverted_index.large | 62 |
| abstract_inverted_index.lines | 37, 102 |
| abstract_inverted_index.order | 55 |
| abstract_inverted_index.space | 19, 52 |
| abstract_inverted_index.terms | 27, 142 |
| abstract_inverted_index.these | 116 |
| abstract_inverted_index.using | 95 |
| abstract_inverted_index.which | 58 |
| abstract_inverted_index.better | 89 |
| abstract_inverted_index.evolve | 69 |
| abstract_inverted_index.higher | 54 |
| abstract_inverted_index.latent | 18 |
| abstract_inverted_index.linear | 29, 113 |
| abstract_inverted_index.shapes | 99 |
| abstract_inverted_index.simple | 32, 97 |
| abstract_inverted_index.solely | 25 |
| abstract_inverted_index.visual | 6, 136 |
| abstract_inverted_index.Bézier | 56 |
| abstract_inverted_index.Project | 145 |
| abstract_inverted_index.achieve | 43 |
| abstract_inverted_index.concept | 137 |
| abstract_inverted_index.curves, | 57 |
| abstract_inverted_index.exhibit | 59 |
| abstract_inverted_index.outputs | 111 |
| abstract_inverted_index.present | 82 |
| abstract_inverted_index.process | 127 |
| abstract_inverted_index.simpler | 122 |
| abstract_inverted_index.thereby | 118 |
| abstract_inverted_index.tracked | 132 |
| abstract_inverted_index.Although | 40 |
| abstract_inverted_index.circles. | 39, 104 |
| abstract_inverted_index.concepts | 7 |
| abstract_inverted_index.existing | 41 |
| abstract_inverted_index.possible | 110 |
| abstract_inverted_index.prompts, | 13 |
| abstract_inverted_index.provides | 87 |
| abstract_inverted_index.straight | 36, 101 |
| abstract_inverted_index.algorithm | 85 |
| abstract_inverted_index.expressed | 139 |
| abstract_inverted_index.geometric | 33 |
| abstract_inverted_index.primitive | 98 |
| abstract_inverted_index.sketches. | 80 |
| abstract_inverted_index.synthesis | 126 |
| abstract_inverted_index.CLIPDraw++ | 129 |
| abstract_inverted_index.approaches | 42 |
| abstract_inverted_index.associates | 10 |
| abstract_inverted_index.constrains | 106 |
| abstract_inverted_index.exhibiting | 119 |
| abstract_inverted_index.generating | 78 |
| abstract_inverted_index.inherently | 121 |
| abstract_inverted_index.meaningful | 79 |
| abstract_inverted_index.primitives | 34 |
| abstract_inverted_index.structures | 65 |
| abstract_inverted_index.visualized | 24 |
| abstract_inverted_index.wastefully | 61 |
| abstract_inverted_index.CLIPDraw++, | 83 |
| abstract_inverted_index.embeddings, | 94 |
| abstract_inverted_index.end-to-end, | 133 |
| abstract_inverted_index.exclusively | 140 |
| abstract_inverted_index.primitives, | 117 |
| abstract_inverted_index.primitives. | 144 |
| abstract_inverted_index.mathematical | 123 |
| abstract_inverted_index.non-essential | 76 |
| abstract_inverted_index.significantly | 88 |
| abstract_inverted_index.understanding | 4 |
| abstract_inverted_index.visualizations | 90 |
| abstract_inverted_index.transformations | 30, 114 |
| abstract_inverted_index.https://clipdrawx.github.io/. | 147 |
| abstract_inverted_index.sketch-synthesis-through-optimization, | 46 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 4 |
| citation_normalized_percentile |