LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents Article Swipe
Ke Zhang
,
Chenxi Zhang
,
Chong Wang
,
Chi Zhang
,
Yadi Wu
,
Z. Z. Xing
,
Liu Yang
,
Qingshan Li
,
Xin Peng
·
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2503.15079
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2503.15079
Automated testing for REST APIs has become essential for ensuring the correctness and reliability of modern web services. While existing approaches primarily focus on detecting server crashes and error codes, they often overlook logical issues that arise due to evolving business logic and domain-specific requirements. To address this limitation, we propose LogiAgent, a novel approach for logical testing of REST systems. Built upon a large language model (LLM)-driven multi-agent framework, LogiAgent integrates a Test Scenario Generator, API Request Executor, and API Response Validator to collaboratively generate, execute, and validate API test scenarios. Unlike traditional testing methods that focus on status codes like 5xx, LogiAgent incorporates logical oracles that assess responses based on business logic, ensuring more comprehensive testing. The system is further enhanced by an Execution Memory component that stores historical API execution data for contextual consistency. We conduct extensive experiments across 12 real-world REST systems, demonstrating that LogiAgent effectively identifies 234 logical issues with an accuracy of 66.19%. Additionally, it basically excels in detecting server crashes and achieves superior test coverage compared to four state-of-the-art REST API testing tools. An ablation study confirms the significant contribution of LogiAgent's memory components to improving test coverage.
Related Topics
Concepts
No concepts available.
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2503.15079
- https://arxiv.org/pdf/2503.15079
- OA Status
- green
- OpenAlex ID
- https://openalex.org/W4414902662
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4414902662Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2503.15079Digital Object Identifier
- Title
-
LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-AgentsWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-03-19Full publication date if available
- Authors
-
Ke Zhang, Chenxi Zhang, Chong Wang, Chi Zhang, Yadi Wu, Z. Z. Xing, Liu Yang, Qingshan Li, Xin PengList of authors in order
- Landing page
-
https://arxiv.org/abs/2503.15079Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2503.15079Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2503.15079Direct OA link when available
- Cited by
-
0Total citation count in OpenAlex
Full payload
| id | https://openalex.org/W4414902662 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2503.15079 |
| ids.doi | https://doi.org/10.48550/arxiv.2503.15079 |
| ids.openalex | https://openalex.org/W4414902662 |
| fwci | |
| type | preprint |
| title | LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10743 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9915000200271606 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1712 |
| topics[0].subfield.display_name | Software |
| topics[0].display_name | Software Testing and Debugging Techniques |
| topics[1].id | https://openalex.org/T10142 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9847999811172485 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1703 |
| topics[1].subfield.display_name | Computational Theory and Mathematics |
| topics[1].display_name | Formal Methods in Verification |
| topics[2].id | https://openalex.org/T10215 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9764000177383423 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Semantic Web and Ontologies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2503.15079 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2503.15079 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2503.15079 |
| locations[1].id | doi:10.48550/arxiv.2503.15079 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2503.15079 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5090132694 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-8874-5282 |
| authorships[0].author.display_name | Ke Zhang |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Zhang, Ke |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5100361485 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-2670-3885 |
| authorships[1].author.display_name | Chenxi Zhang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Zhang, Chenxi |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5115596078 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-1513-6053 |
| authorships[2].author.display_name | Chong Wang |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Wang, Chong |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5024472849 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-8540-3655 |
| authorships[3].author.display_name | Chi Zhang |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Zhang, Chi |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5003894121 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-8204-1962 |
| authorships[4].author.display_name | Yadi Wu |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Wu, YaChen |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5018267231 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-4650-1751 |
| authorships[5].author.display_name | Z. Z. Xing |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Xing, Zhenchang |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5100757367 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-4816-5942 |
| authorships[6].author.display_name | Liu Yang |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Liu, Yang |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5100404965 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-9550-3238 |
| authorships[7].author.display_name | Qingshan Li |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Li, Qingshan |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5101854992 |
| authorships[8].author.orcid | https://orcid.org/0000-0003-3376-2581 |
| authorships[8].author.display_name | Xin Peng |
| authorships[8].author_position | last |
| authorships[8].raw_author_name | Peng, Xin |
| authorships[8].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2503.15079 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10743 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9915000200271606 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1712 |
| primary_topic.subfield.display_name | Software |
| primary_topic.display_name | Software Testing and Debugging Techniques |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2503.15079 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2503.15079 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2503.15079 |
| primary_location.id | pmh:oai:arXiv.org:2503.15079 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2503.15079 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2503.15079 |
| publication_date | 2025-03-19 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 52, 63, 72 |
| abstract_inverted_index.12 | 142 |
| abstract_inverted_index.An | 180 |
| abstract_inverted_index.To | 45 |
| abstract_inverted_index.We | 137 |
| abstract_inverted_index.an | 124, 155 |
| abstract_inverted_index.by | 123 |
| abstract_inverted_index.in | 163 |
| abstract_inverted_index.is | 120 |
| abstract_inverted_index.it | 160 |
| abstract_inverted_index.of | 14, 58, 157, 187 |
| abstract_inverted_index.on | 23, 98, 111 |
| abstract_inverted_index.to | 38, 83, 173, 191 |
| abstract_inverted_index.we | 49 |
| abstract_inverted_index.234 | 151 |
| abstract_inverted_index.API | 76, 80, 89, 131, 177 |
| abstract_inverted_index.The | 118 |
| abstract_inverted_index.and | 12, 27, 42, 79, 87, 167 |
| abstract_inverted_index.due | 37 |
| abstract_inverted_index.for | 2, 8, 55, 134 |
| abstract_inverted_index.has | 5 |
| abstract_inverted_index.the | 10, 184 |
| abstract_inverted_index.web | 16 |
| abstract_inverted_index.5xx, | 102 |
| abstract_inverted_index.APIs | 4 |
| abstract_inverted_index.REST | 3, 59, 144, 176 |
| abstract_inverted_index.Test | 73 |
| abstract_inverted_index.data | 133 |
| abstract_inverted_index.four | 174 |
| abstract_inverted_index.like | 101 |
| abstract_inverted_index.more | 115 |
| abstract_inverted_index.test | 90, 170, 193 |
| abstract_inverted_index.that | 35, 96, 107, 128, 147 |
| abstract_inverted_index.they | 30 |
| abstract_inverted_index.this | 47 |
| abstract_inverted_index.upon | 62 |
| abstract_inverted_index.with | 154 |
| abstract_inverted_index.Built | 61 |
| abstract_inverted_index.While | 18 |
| abstract_inverted_index.arise | 36 |
| abstract_inverted_index.based | 110 |
| abstract_inverted_index.codes | 100 |
| abstract_inverted_index.error | 28 |
| abstract_inverted_index.focus | 22, 97 |
| abstract_inverted_index.large | 64 |
| abstract_inverted_index.logic | 41 |
| abstract_inverted_index.model | 66 |
| abstract_inverted_index.novel | 53 |
| abstract_inverted_index.often | 31 |
| abstract_inverted_index.study | 182 |
| abstract_inverted_index.Memory | 126 |
| abstract_inverted_index.Unlike | 92 |
| abstract_inverted_index.across | 141 |
| abstract_inverted_index.assess | 108 |
| abstract_inverted_index.become | 6 |
| abstract_inverted_index.codes, | 29 |
| abstract_inverted_index.excels | 162 |
| abstract_inverted_index.issues | 34, 153 |
| abstract_inverted_index.logic, | 113 |
| abstract_inverted_index.memory | 189 |
| abstract_inverted_index.modern | 15 |
| abstract_inverted_index.server | 25, 165 |
| abstract_inverted_index.status | 99 |
| abstract_inverted_index.stores | 129 |
| abstract_inverted_index.system | 119 |
| abstract_inverted_index.tools. | 179 |
| abstract_inverted_index.66.19%. | 158 |
| abstract_inverted_index.Request | 77 |
| abstract_inverted_index.address | 46 |
| abstract_inverted_index.conduct | 138 |
| abstract_inverted_index.crashes | 26, 166 |
| abstract_inverted_index.further | 121 |
| abstract_inverted_index.logical | 33, 56, 105, 152 |
| abstract_inverted_index.methods | 95 |
| abstract_inverted_index.oracles | 106 |
| abstract_inverted_index.propose | 50 |
| abstract_inverted_index.testing | 1, 57, 94, 178 |
| abstract_inverted_index.Response | 81 |
| abstract_inverted_index.Scenario | 74 |
| abstract_inverted_index.ablation | 181 |
| abstract_inverted_index.accuracy | 156 |
| abstract_inverted_index.achieves | 168 |
| abstract_inverted_index.approach | 54 |
| abstract_inverted_index.business | 40, 112 |
| abstract_inverted_index.compared | 172 |
| abstract_inverted_index.confirms | 183 |
| abstract_inverted_index.coverage | 171 |
| abstract_inverted_index.enhanced | 122 |
| abstract_inverted_index.ensuring | 9, 114 |
| abstract_inverted_index.evolving | 39 |
| abstract_inverted_index.execute, | 86 |
| abstract_inverted_index.existing | 19 |
| abstract_inverted_index.language | 65 |
| abstract_inverted_index.overlook | 32 |
| abstract_inverted_index.superior | 169 |
| abstract_inverted_index.systems, | 145 |
| abstract_inverted_index.systems. | 60 |
| abstract_inverted_index.testing. | 117 |
| abstract_inverted_index.validate | 88 |
| abstract_inverted_index.Automated | 0 |
| abstract_inverted_index.Execution | 125 |
| abstract_inverted_index.Executor, | 78 |
| abstract_inverted_index.LogiAgent | 70, 103, 148 |
| abstract_inverted_index.Validator | 82 |
| abstract_inverted_index.basically | 161 |
| abstract_inverted_index.component | 127 |
| abstract_inverted_index.coverage. | 194 |
| abstract_inverted_index.detecting | 24, 164 |
| abstract_inverted_index.essential | 7 |
| abstract_inverted_index.execution | 132 |
| abstract_inverted_index.extensive | 139 |
| abstract_inverted_index.generate, | 85 |
| abstract_inverted_index.improving | 192 |
| abstract_inverted_index.primarily | 21 |
| abstract_inverted_index.responses | 109 |
| abstract_inverted_index.services. | 17 |
| abstract_inverted_index.Generator, | 75 |
| abstract_inverted_index.LogiAgent, | 51 |
| abstract_inverted_index.approaches | 20 |
| abstract_inverted_index.components | 190 |
| abstract_inverted_index.contextual | 135 |
| abstract_inverted_index.framework, | 69 |
| abstract_inverted_index.historical | 130 |
| abstract_inverted_index.identifies | 150 |
| abstract_inverted_index.integrates | 71 |
| abstract_inverted_index.real-world | 143 |
| abstract_inverted_index.scenarios. | 91 |
| abstract_inverted_index.LogiAgent's | 188 |
| abstract_inverted_index.correctness | 11 |
| abstract_inverted_index.effectively | 149 |
| abstract_inverted_index.experiments | 140 |
| abstract_inverted_index.limitation, | 48 |
| abstract_inverted_index.multi-agent | 68 |
| abstract_inverted_index.reliability | 13 |
| abstract_inverted_index.significant | 185 |
| abstract_inverted_index.traditional | 93 |
| abstract_inverted_index.(LLM)-driven | 67 |
| abstract_inverted_index.consistency. | 136 |
| abstract_inverted_index.contribution | 186 |
| abstract_inverted_index.incorporates | 104 |
| abstract_inverted_index.Additionally, | 159 |
| abstract_inverted_index.comprehensive | 116 |
| abstract_inverted_index.demonstrating | 146 |
| abstract_inverted_index.requirements. | 44 |
| abstract_inverted_index.collaboratively | 84 |
| abstract_inverted_index.domain-specific | 43 |
| abstract_inverted_index.state-of-the-art | 175 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 9 |
| citation_normalized_percentile |