ComposerX: Multi-Agent Symbolic Music Composition with LLMs Article Swipe
Qixin Deng
,
Qikai Yang
,
Ruibin Yuan
,
Yipeng Huang
,
Yi Wang
,
Xubo Liu
,
Zeyue Tian
,
Jiahao Pan
,
Ge Zhang
,
Hanfeng Lin
,
Yi‐Zhi Li
,
Yinghao Ma
,
Jie Fu
,
Chenghua Lin
,
Emmanouil Benetos
,
Wenwu Wang
,
Guangyu Xia
,
Wei Xue
,
Yike Guo
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2404.18081
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2404.18081
Music composition represents the creative side of humanity, and itself is a complex task that requires abilities to understand and generate information with long dependency and harmony constraints. While demonstrating impressive capabilities in STEM subjects, current LLMs easily fail in this task, generating ill-written music even when equipped with modern techniques like In-Context-Learning and Chain-of-Thoughts. To further explore and enhance LLMs' potential in music composition by leveraging their reasoning ability and the large knowledge base in music history and theory, we propose ComposerX, an agent-based symbolic music generation framework. We find that applying a multi-agent approach significantly improves the music composition quality of GPT-4. The results demonstrate that ComposerX is capable of producing coherent polyphonic music compositions with captivating melodies, while adhering to user instructions.
Related Topics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2404.18081
- https://arxiv.org/pdf/2404.18081
- OA Status
- green
- Cited By
- 6
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4396819664
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4396819664Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2404.18081Digital Object Identifier
- Title
-
ComposerX: Multi-Agent Symbolic Music Composition with LLMsWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-04-28Full publication date if available
- Authors
-
Qixin Deng, Qikai Yang, Ruibin Yuan, Yipeng Huang, Yi Wang, Xubo Liu, Zeyue Tian, Jiahao Pan, Ge Zhang, Hanfeng Lin, Yi‐Zhi Li, Yinghao Ma, Jie Fu, Chenghua Lin, Emmanouil Benetos, Wenwu Wang, Guangyu Xia, Wei Xue, Yike GuoList of authors in order
- Landing page
-
https://arxiv.org/abs/2404.18081Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2404.18081Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2404.18081Direct OA link when available
- Concepts
-
Composition (language), Computer science, Literature, ArtTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
6Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 2, 2024: 4Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4396819664 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2404.18081 |
| ids.doi | https://doi.org/10.48550/arxiv.2404.18081 |
| ids.openalex | https://openalex.org/W4396819664 |
| fwci | 0.0 |
| type | preprint |
| title | ComposerX: Multi-Agent Symbolic Music Composition with LLMs |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11309 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9962999820709229 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1711 |
| topics[0].subfield.display_name | Signal Processing |
| topics[0].display_name | Music and Audio Processing |
| topics[1].id | https://openalex.org/T11349 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9944000244140625 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1707 |
| topics[1].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[1].display_name | Music Technology and Sound Studies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C40231798 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7050237655639648 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1333743 |
| concepts[0].display_name | Composition (language) |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.3463810682296753 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C124952713 |
| concepts[2].level | 1 |
| concepts[2].score | 0.21434369683265686 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q8242 |
| concepts[2].display_name | Literature |
| concepts[3].id | https://openalex.org/C142362112 |
| concepts[3].level | 0 |
| concepts[3].score | 0.15899962186813354 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q735 |
| concepts[3].display_name | Art |
| keywords[0].id | https://openalex.org/keywords/composition |
| keywords[0].score | 0.7050237655639648 |
| keywords[0].display_name | Composition (language) |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.3463810682296753 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/literature |
| keywords[2].score | 0.21434369683265686 |
| keywords[2].display_name | Literature |
| keywords[3].id | https://openalex.org/keywords/art |
| keywords[3].score | 0.15899962186813354 |
| keywords[3].display_name | Art |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2404.18081 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2404.18081 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2404.18081 |
| locations[1].id | doi:10.48550/arxiv.2404.18081 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2404.18081 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5112119397 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Qixin Deng |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Deng, Qixin |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5100577167 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Qikai Yang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Yang, Qikai |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5067150934 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Ruibin Yuan |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Yuan, Ruibin |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5060545672 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-3171-6901 |
| authorships[3].author.display_name | Yipeng Huang |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Huang, Yipeng |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5100364886 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-1347-7030 |
| authorships[4].author.display_name | Yi Wang |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Wang, Yi |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5080214850 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-2558-0959 |
| authorships[5].author.display_name | Xubo Liu |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Liu, Xubo |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5007431589 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Zeyue Tian |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Tian, Zeyue |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5102684542 |
| authorships[7].author.orcid | |
| authorships[7].author.display_name | Jiahao Pan |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Pan, Jiahao |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5111595965 |
| authorships[8].author.orcid | |
| authorships[8].author.display_name | Ge Zhang |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Zhang, Ge |
| authorships[8].is_corresponding | False |
| authorships[9].author.id | https://openalex.org/A5083461430 |
| authorships[9].author.orcid | https://orcid.org/0000-0002-7437-1037 |
| authorships[9].author.display_name | Hanfeng Lin |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Lin, Hanfeng |
| authorships[9].is_corresponding | False |
| authorships[10].author.id | https://openalex.org/A5101559603 |
| authorships[10].author.orcid | https://orcid.org/0000-0002-8795-6528 |
| authorships[10].author.display_name | Yi‐Zhi Li |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Li, Yizhi |
| authorships[10].is_corresponding | False |
| authorships[11].author.id | https://openalex.org/A5111279796 |
| authorships[11].author.orcid | |
| authorships[11].author.display_name | Yinghao Ma |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Ma, Yinghao |
| authorships[11].is_corresponding | False |
| authorships[12].author.id | https://openalex.org/A5101771527 |
| authorships[12].author.orcid | https://orcid.org/0000-0003-2608-1147 |
| authorships[12].author.display_name | Jie Fu |
| authorships[12].author_position | middle |
| authorships[12].raw_author_name | Fu, Jie |
| authorships[12].is_corresponding | False |
| authorships[13].author.id | https://openalex.org/A5024599321 |
| authorships[13].author.orcid | https://orcid.org/0000-0003-3454-2468 |
| authorships[13].author.display_name | Chenghua Lin |
| authorships[13].author_position | middle |
| authorships[13].raw_author_name | Lin, Chenghua |
| authorships[13].is_corresponding | False |
| authorships[14].author.id | https://openalex.org/A5084672392 |
| authorships[14].author.orcid | |
| authorships[14].author.display_name | Emmanouil Benetos |
| authorships[14].author_position | middle |
| authorships[14].raw_author_name | Benetos, Emmanouil |
| authorships[14].is_corresponding | False |
| authorships[15].author.id | https://openalex.org/A5100676721 |
| authorships[15].author.orcid | https://orcid.org/0000-0002-8393-5703 |
| authorships[15].author.display_name | Wenwu Wang |
| authorships[15].author_position | middle |
| authorships[15].raw_author_name | Wang, Wenwu |
| authorships[15].is_corresponding | False |
| authorships[16].author.id | https://openalex.org/A5111193672 |
| authorships[16].author.orcid | |
| authorships[16].author.display_name | Guangyu Xia |
| authorships[16].author_position | middle |
| authorships[16].raw_author_name | Xia, Guangyu |
| authorships[16].is_corresponding | False |
| authorships[17].author.id | https://openalex.org/A5100422542 |
| authorships[17].author.orcid | https://orcid.org/0000-0001-6550-5366 |
| authorships[17].author.display_name | Wei Xue |
| authorships[17].author_position | middle |
| authorships[17].raw_author_name | Xue, Wei |
| authorships[17].is_corresponding | False |
| authorships[18].author.id | https://openalex.org/A5113017352 |
| authorships[18].author.orcid | |
| authorships[18].author.display_name | Yike Guo |
| authorships[18].author_position | last |
| authorships[18].raw_author_name | Guo, Yike |
| authorships[18].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2404.18081 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | ComposerX: Multi-Agent Symbolic Music Composition with LLMs |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T11309 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9962999820709229 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1711 |
| primary_topic.subfield.display_name | Signal Processing |
| primary_topic.display_name | Music and Audio Processing |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W2390279801, https://openalex.org/W2358668433, https://openalex.org/W4396701345, https://openalex.org/W2376932109, https://openalex.org/W2001405890, https://openalex.org/W4396696052, https://openalex.org/W2382290278, https://openalex.org/W4395014643 |
| cited_by_count | 6 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 2 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 4 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2404.18081 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2404.18081 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2404.18081 |
| primary_location.id | pmh:oai:arXiv.org:2404.18081 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2404.18081 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2404.18081 |
| publication_date | 2024-04-28 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 11, 93 |
| abstract_inverted_index.To | 55 |
| abstract_inverted_index.We | 89 |
| abstract_inverted_index.an | 83 |
| abstract_inverted_index.by | 65 |
| abstract_inverted_index.in | 32, 39, 62, 75 |
| abstract_inverted_index.is | 10, 109 |
| abstract_inverted_index.of | 6, 102, 111 |
| abstract_inverted_index.to | 17, 122 |
| abstract_inverted_index.we | 80 |
| abstract_inverted_index.The | 104 |
| abstract_inverted_index.and | 8, 19, 25, 53, 58, 70, 78 |
| abstract_inverted_index.the | 3, 71, 98 |
| abstract_inverted_index.LLMs | 36 |
| abstract_inverted_index.STEM | 33 |
| abstract_inverted_index.base | 74 |
| abstract_inverted_index.even | 45 |
| abstract_inverted_index.fail | 38 |
| abstract_inverted_index.find | 90 |
| abstract_inverted_index.like | 51 |
| abstract_inverted_index.long | 23 |
| abstract_inverted_index.side | 5 |
| abstract_inverted_index.task | 13 |
| abstract_inverted_index.that | 14, 91, 107 |
| abstract_inverted_index.this | 40 |
| abstract_inverted_index.user | 123 |
| abstract_inverted_index.when | 46 |
| abstract_inverted_index.with | 22, 48, 117 |
| abstract_inverted_index.LLMs' | 60 |
| abstract_inverted_index.Music | 0 |
| abstract_inverted_index.While | 28 |
| abstract_inverted_index.large | 72 |
| abstract_inverted_index.music | 44, 63, 76, 86, 99, 115 |
| abstract_inverted_index.task, | 41 |
| abstract_inverted_index.their | 67 |
| abstract_inverted_index.while | 120 |
| abstract_inverted_index.GPT-4. | 103 |
| abstract_inverted_index.easily | 37 |
| abstract_inverted_index.itself | 9 |
| abstract_inverted_index.modern | 49 |
| abstract_inverted_index.ability | 69 |
| abstract_inverted_index.capable | 110 |
| abstract_inverted_index.complex | 12 |
| abstract_inverted_index.current | 35 |
| abstract_inverted_index.enhance | 59 |
| abstract_inverted_index.explore | 57 |
| abstract_inverted_index.further | 56 |
| abstract_inverted_index.harmony | 26 |
| abstract_inverted_index.history | 77 |
| abstract_inverted_index.propose | 81 |
| abstract_inverted_index.quality | 101 |
| abstract_inverted_index.results | 105 |
| abstract_inverted_index.theory, | 79 |
| abstract_inverted_index.adhering | 121 |
| abstract_inverted_index.applying | 92 |
| abstract_inverted_index.approach | 95 |
| abstract_inverted_index.coherent | 113 |
| abstract_inverted_index.creative | 4 |
| abstract_inverted_index.equipped | 47 |
| abstract_inverted_index.generate | 20 |
| abstract_inverted_index.improves | 97 |
| abstract_inverted_index.requires | 15 |
| abstract_inverted_index.symbolic | 85 |
| abstract_inverted_index.ComposerX | 108 |
| abstract_inverted_index.abilities | 16 |
| abstract_inverted_index.humanity, | 7 |
| abstract_inverted_index.knowledge | 73 |
| abstract_inverted_index.melodies, | 119 |
| abstract_inverted_index.potential | 61 |
| abstract_inverted_index.producing | 112 |
| abstract_inverted_index.reasoning | 68 |
| abstract_inverted_index.subjects, | 34 |
| abstract_inverted_index.ComposerX, | 82 |
| abstract_inverted_index.dependency | 24 |
| abstract_inverted_index.framework. | 88 |
| abstract_inverted_index.generating | 42 |
| abstract_inverted_index.generation | 87 |
| abstract_inverted_index.impressive | 30 |
| abstract_inverted_index.leveraging | 66 |
| abstract_inverted_index.polyphonic | 114 |
| abstract_inverted_index.represents | 2 |
| abstract_inverted_index.techniques | 50 |
| abstract_inverted_index.understand | 18 |
| abstract_inverted_index.agent-based | 84 |
| abstract_inverted_index.captivating | 118 |
| abstract_inverted_index.composition | 1, 64, 100 |
| abstract_inverted_index.demonstrate | 106 |
| abstract_inverted_index.ill-written | 43 |
| abstract_inverted_index.information | 21 |
| abstract_inverted_index.multi-agent | 94 |
| abstract_inverted_index.capabilities | 31 |
| abstract_inverted_index.compositions | 116 |
| abstract_inverted_index.constraints. | 27 |
| abstract_inverted_index.demonstrating | 29 |
| abstract_inverted_index.instructions. | 124 |
| abstract_inverted_index.significantly | 96 |
| abstract_inverted_index.Chain-of-Thoughts. | 54 |
| abstract_inverted_index.In-Context-Learning | 52 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 19 |
| citation_normalized_percentile |