Adversarial attack classification and robustness testing for large language models for code Article Swipe

View

Yang Liu , Armstrong Foundjem , Foutse Khomh , Heng Li ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.1007/s10664-025-10693-3

Related Topics

Computer Science

Artificial Intelligence

Programming Language

Biology

Biochemistry

Concepts

Computer science Robustness (evolution) Adversarial system Artificial intelligence Programming language Biology Gene Biochemistry

Metadata

Type: article
Language: en
Landing Page: https://doi.org/10.1007/s10664-025-10693-3
OA Status: green
References: 26
Related Works: 10
OpenAlex ID: https://openalex.org/W4413219439

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4413219439

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.1007/s10664-025-10693-3

Digital Object Identifier
Title: Adversarial attack classification and robustness testing for large language models for code

Work title
Type: article

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-08-11

Full publication date if available
Authors: Yang Liu, Armstrong Foundjem, Foutse Khomh, Heng Li

List of authors in order
Landing page: https://doi.org/10.1007/s10664-025-10693-3

Publisher landing page
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2506.07942

Direct OA link when available
Concepts: Computer science, Robustness (evolution), Adversarial system, Artificial intelligence, Programming language, Biology, Gene, Biochemistry

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
References (count): 26

Number of works referenced by this work
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4413219439
doi	https://doi.org/10.1007/s10664-025-10693-3
ids.doi	https://doi.org/10.1007/s10664-025-10693-3
ids.openalex	https://openalex.org/W4413219439
fwci	0.0
type	article
title	Adversarial attack classification and robustness testing for large language models for code
biblio.issue	5
biblio.volume	30
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T11689
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9995999932289124
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Adversarial Robustness in Machine Learning
topics[1].id	https://openalex.org/T11241
topics[1].field.id	https://openalex.org/fields/17
topics[1].field.display_name	Computer Science
topics[1].score	0.9970999956130981
topics[1].domain.id	https://openalex.org/domains/3
topics[1].domain.display_name	Physical Sciences
topics[1].subfield.id	https://openalex.org/subfields/1711
topics[1].subfield.display_name	Signal Processing
topics[1].display_name	Advanced Malware Detection Techniques
topics[2].id	https://openalex.org/T11424
topics[2].field.id	https://openalex.org/fields/17
topics[2].field.display_name	Computer Science
topics[2].score	0.9800999760627747
topics[2].domain.id	https://openalex.org/domains/3
topics[2].domain.display_name	Physical Sciences
topics[2].subfield.id	https://openalex.org/subfields/1702
topics[2].subfield.display_name	Artificial Intelligence
topics[2].display_name	Security and Verification in Computing
is_xpac	False
apc_list.value	2290
apc_list.currency	EUR
apc_list.value_usd	2890
apc_paid
concepts[0].id	https://openalex.org/C41008148
concepts[0].level	0
concepts[0].score	0.6881240606307983
concepts[0].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[0].display_name	Computer science
concepts[1].id	https://openalex.org/C63479239
concepts[1].level	3
concepts[1].score	0.6796346306800842
concepts[1].wikidata	https://www.wikidata.org/wiki/Q7353546
concepts[1].display_name	Robustness (evolution)
concepts[2].id	https://openalex.org/C37736160
concepts[2].level	2
concepts[2].score	0.578810453414917
concepts[2].wikidata	https://www.wikidata.org/wiki/Q1801315
concepts[2].display_name	Adversarial system
concepts[3].id	https://openalex.org/C154945302
concepts[3].level	1
concepts[3].score	0.34665125608444214
concepts[3].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[3].display_name	Artificial intelligence
concepts[4].id	https://openalex.org/C199360897
concepts[4].level	1
concepts[4].score	0.3374103307723999
concepts[4].wikidata	https://www.wikidata.org/wiki/Q9143
concepts[4].display_name	Programming language
concepts[5].id	https://openalex.org/C86803240
concepts[5].level	0
concepts[5].score	0.08399546146392822
concepts[5].wikidata	https://www.wikidata.org/wiki/Q420
concepts[5].display_name	Biology
concepts[6].id	https://openalex.org/C104317684
concepts[6].level	2
concepts[6].score	0.0
concepts[6].wikidata	https://www.wikidata.org/wiki/Q7187
concepts[6].display_name	Gene
concepts[7].id	https://openalex.org/C55493867
concepts[7].level	1
concepts[7].score	0.0
concepts[7].wikidata	https://www.wikidata.org/wiki/Q7094
concepts[7].display_name	Biochemistry
keywords[0].id	https://openalex.org/keywords/computer-science
keywords[0].score	0.6881240606307983
keywords[0].display_name	Computer science
keywords[1].id	https://openalex.org/keywords/robustness
keywords[1].score	0.6796346306800842
keywords[1].display_name	Robustness (evolution)
keywords[2].id	https://openalex.org/keywords/adversarial-system
keywords[2].score	0.578810453414917
keywords[2].display_name	Adversarial system
keywords[3].id	https://openalex.org/keywords/artificial-intelligence
keywords[3].score	0.34665125608444214
keywords[3].display_name	Artificial intelligence
keywords[4].id	https://openalex.org/keywords/programming-language
keywords[4].score	0.3374103307723999
keywords[4].display_name	Programming language
keywords[5].id	https://openalex.org/keywords/biology
keywords[5].score	0.08399546146392822
keywords[5].display_name	Biology
language	en
locations[0].id	doi:10.1007/s10664-025-10693-3
locations[0].is_oa	False
locations[0].source.id	https://openalex.org/S109852484
locations[0].source.issn	1382-3256, 1573-7616
locations[0].source.type	journal
locations[0].source.is_oa	False
locations[0].source.issn_l	1382-3256
locations[0].source.is_core	True
locations[0].source.is_in_doaj	False
locations[0].source.display_name	Empirical Software Engineering
locations[0].source.host_organization	https://openalex.org/P4310319900
locations[0].source.host_organization_name	Springer Science+Business Media
locations[0].source.host_organization_lineage	https://openalex.org/P4310319900, https://openalex.org/P4310319965
locations[0].source.host_organization_lineage_names	Springer Science+Business Media, Springer Nature
locations[0].license
locations[0].pdf_url
locations[0].version	publishedVersion
locations[0].raw_type	journal-article
locations[0].license_id
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	Empirical Software Engineering
locations[0].landing_page_url	https://doi.org/10.1007/s10664-025-10693-3
locations[1].id	pmh:oai:publications.polymtl.ca:67672
locations[1].is_oa	False
locations[1].source.id	https://openalex.org/S4306401013
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	False
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	PolyPublie (École Polytechnique de Montréal)
locations[1].source.host_organization	https://openalex.org/I45683168
locations[1].source.host_organization_name	Polytechnique Montréal
locations[1].source.host_organization_lineage	https://openalex.org/I45683168
locations[1].license
locations[1].pdf_url
locations[1].version	acceptedVersion
locations[1].raw_type	PeerReviewed
locations[1].license_id
locations[1].is_accepted	True
locations[1].is_published	False
locations[1].raw_source_name
locations[1].landing_page_url
locations[2].id	pmh:oai:arXiv.org:2506.07942
locations[2].is_oa	True
locations[2].source.id	https://openalex.org/S4306400194
locations[2].source.issn
locations[2].source.type	repository
locations[2].source.is_oa	True
locations[2].source.issn_l
locations[2].source.is_core	False
locations[2].source.is_in_doaj	False
locations[2].source.display_name	arXiv (Cornell University)
locations[2].source.host_organization	https://openalex.org/I205783295
locations[2].source.host_organization_name	Cornell University
locations[2].source.host_organization_lineage	https://openalex.org/I205783295
locations[2].license
locations[2].pdf_url	https://arxiv.org/pdf/2506.07942
locations[2].version	submittedVersion
locations[2].raw_type	text
locations[2].license_id
locations[2].is_accepted	False
locations[2].is_published	False
locations[2].raw_source_name
locations[2].landing_page_url	http://arxiv.org/abs/2506.07942
indexed_in	arxiv, crossref
authorships[0].author.id	https://openalex.org/A5088963844
authorships[0].author.orcid	https://orcid.org/0009-0009-4801-8107
authorships[0].author.display_name	Yang Liu
authorships[0].countries	CA
authorships[0].affiliations[0].institution_ids	https://openalex.org/I45683168
authorships[0].affiliations[0].raw_affiliation_string	Polytechnique Montréal, Montréal, Canada
authorships[0].institutions[0].id	https://openalex.org/I45683168
authorships[0].institutions[0].ror	https://ror.org/05f8d4e86
authorships[0].institutions[0].type	education
authorships[0].institutions[0].lineage	https://openalex.org/I45683168
authorships[0].institutions[0].country_code	CA
authorships[0].institutions[0].display_name	Polytechnique Montréal
authorships[0].author_position	first
authorships[0].raw_author_name	Yang Liu
authorships[0].is_corresponding	True
authorships[0].raw_affiliation_strings	Polytechnique Montréal, Montréal, Canada
authorships[1].author.id	https://openalex.org/A5005515943
authorships[1].author.orcid	https://orcid.org/0000-0001-6356-1938
authorships[1].author.display_name	Armstrong Foundjem
authorships[1].countries	CA
authorships[1].affiliations[0].institution_ids	https://openalex.org/I45683168
authorships[1].affiliations[0].raw_affiliation_string	Polytechnique Montréal, Montréal, Canada
authorships[1].institutions[0].id	https://openalex.org/I45683168
authorships[1].institutions[0].ror	https://ror.org/05f8d4e86
authorships[1].institutions[0].type	education
authorships[1].institutions[0].lineage	https://openalex.org/I45683168
authorships[1].institutions[0].country_code	CA
authorships[1].institutions[0].display_name	Polytechnique Montréal
authorships[1].author_position	middle
authorships[1].raw_author_name	Armstrong Foundjem
authorships[1].is_corresponding	False
authorships[1].raw_affiliation_strings	Polytechnique Montréal, Montréal, Canada
authorships[2].author.id	https://openalex.org/A5071052367
authorships[2].author.orcid	https://orcid.org/0000-0002-5704-4173
authorships[2].author.display_name	Foutse Khomh
authorships[2].countries	CA
authorships[2].affiliations[0].institution_ids	https://openalex.org/I45683168
authorships[2].affiliations[0].raw_affiliation_string	Polytechnique Montréal, Montréal, Canada
authorships[2].institutions[0].id	https://openalex.org/I45683168
authorships[2].institutions[0].ror	https://ror.org/05f8d4e86
authorships[2].institutions[0].type	education
authorships[2].institutions[0].lineage	https://openalex.org/I45683168
authorships[2].institutions[0].country_code	CA
authorships[2].institutions[0].display_name	Polytechnique Montréal
authorships[2].author_position	middle
authorships[2].raw_author_name	Foutse Khomh
authorships[2].is_corresponding	False
authorships[2].raw_affiliation_strings	Polytechnique Montréal, Montréal, Canada
authorships[3].author.id	https://openalex.org/A5100338802
authorships[3].author.orcid	https://orcid.org/0000-0002-3187-9041
authorships[3].author.display_name	Heng Li
authorships[3].countries	CA
authorships[3].affiliations[0].institution_ids	https://openalex.org/I45683168
authorships[3].affiliations[0].raw_affiliation_string	Polytechnique Montréal, Montréal, Canada
authorships[3].institutions[0].id	https://openalex.org/I45683168
authorships[3].institutions[0].ror	https://ror.org/05f8d4e86
authorships[3].institutions[0].type	education
authorships[3].institutions[0].lineage	https://openalex.org/I45683168
authorships[3].institutions[0].country_code	CA
authorships[3].institutions[0].display_name	Polytechnique Montréal
authorships[3].author_position	last
authorships[3].raw_author_name	Heng Li
authorships[3].is_corresponding	False
authorships[3].raw_affiliation_strings	Polytechnique Montréal, Montréal, Canada
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2506.07942
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Adversarial attack classification and robustness testing for large language models for code
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T11689
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9995999932289124
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Adversarial Robustness in Machine Learning
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2502115930, https://openalex.org/W2482350142, https://openalex.org/W4246396837, https://openalex.org/W3126451824, https://openalex.org/W1561927205, https://openalex.org/W3191453585, https://openalex.org/W4297672492
cited_by_count	0
locations_count	3
best_oa_location.id	pmh:oai:arXiv.org:2506.07942
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2506.07942
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2506.07942
primary_location.id	doi:10.1007/s10664-025-10693-3
primary_location.is_oa	False
primary_location.source.id	https://openalex.org/S109852484
primary_location.source.issn	1382-3256, 1573-7616
primary_location.source.type	journal
primary_location.source.is_oa	False
primary_location.source.issn_l	1382-3256
primary_location.source.is_core	True
primary_location.source.is_in_doaj	False
primary_location.source.display_name	Empirical Software Engineering
primary_location.source.host_organization	https://openalex.org/P4310319900
primary_location.source.host_organization_name	Springer Science+Business Media
primary_location.source.host_organization_lineage	https://openalex.org/P4310319900, https://openalex.org/P4310319965
primary_location.source.host_organization_lineage_names	Springer Science+Business Media, Springer Nature
primary_location.license
primary_location.pdf_url
primary_location.version	publishedVersion
primary_location.raw_type	journal-article
primary_location.license_id
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	Empirical Software Engineering
primary_location.landing_page_url	https://doi.org/10.1007/s10664-025-10693-3
publication_date	2025-08-11
publication_year	2025
referenced_works	https://openalex.org/W2964150020, https://openalex.org/W6604624405, https://openalex.org/W6600438464, https://openalex.org/W2568525679, https://openalex.org/W2963857521, https://openalex.org/W6600050674, https://openalex.org/W3098605233, https://openalex.org/W6776935626, https://openalex.org/W3000477148, https://openalex.org/W3104423855, https://openalex.org/W6601399257, https://openalex.org/W6600473871, https://openalex.org/W4403556898, https://openalex.org/W2963969878, https://openalex.org/W4221158433, https://openalex.org/W4211204780, https://openalex.org/W4384345639, https://openalex.org/W4411233154, https://openalex.org/W4389274828, https://openalex.org/W4411233354, https://openalex.org/W4385571808, https://openalex.org/W4291213652, https://openalex.org/W4220722393, https://openalex.org/W2963178695, https://openalex.org/W3087231533, https://openalex.org/W3175982906
referenced_works_count	26
abstract_inverted_index
cited_by_percentile_year
corresponding_author_ids	https://openalex.org/A5088963844
countries_distinct_count	1
institutions_distinct_count	4
corresponding_institution_ids	https://openalex.org/I45683168
citation_normalized_percentile.value	0.1588211
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	True