Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted Transferability Article Swipe
Hui Zeng
,
Sanshuai Cui
,
Biwei Chen
,
Anjie Peng
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2412.20807
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2412.20807
With much longer optimization time than that of untargeted attacks notwithstanding, the transferability of targeted attacks is still far from satisfactory. Recent studies reveal that fine-tuning an existing adversarial example (AE) in feature space can efficiently boost its targeted transferability. However, existing fine-tuning schemes only utilize the endpoint and ignore the valuable information in the fine-tuning trajectory. Noting that the vanilla fine-tuning trajectory tends to oscillate around the periphery of a flat region of the loss surface, we propose averaging over the fine-tuning trajectory to pull the crafted AE towards a more centered region. We compare the proposed method with existing fine-tuning schemes by integrating them with state-of-the-art targeted attacks in various attacking scenarios. Experimental results uphold the superiority of the proposed method in boosting targeted transferability. The code is available at github.com/zengh5/Avg_FT.
Related Topics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2412.20807
- https://arxiv.org/pdf/2412.20807
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4405957169
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4405957169Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2412.20807Digital Object Identifier
- Title
-
Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted TransferabilityWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-12-30Full publication date if available
- Authors
-
Hui Zeng, Sanshuai Cui, Biwei Chen, Anjie PengList of authors in order
- Landing page
-
https://arxiv.org/abs/2412.20807Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2412.20807Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2412.20807Direct OA link when available
- Concepts
-
Transferability, Computer science, Econometrics, Mathematics, LogitTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4405957169 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2412.20807 |
| ids.doi | https://doi.org/10.48550/arxiv.2412.20807 |
| ids.openalex | https://openalex.org/W4405957169 |
| fwci | |
| type | preprint |
| title | Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted Transferability |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10784 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.17389999330043793 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2204 |
| topics[0].subfield.display_name | Biomedical Engineering |
| topics[0].display_name | Muscle activation and electromyography studies |
| topics[1].id | https://openalex.org/T12207 |
| topics[1].field.id | https://openalex.org/fields/36 |
| topics[1].field.display_name | Health Professions |
| topics[1].score | 0.15850000083446503 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/3609 |
| topics[1].subfield.display_name | Occupational Therapy |
| topics[1].display_name | Assistive Technology in Communication and Mobility |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C61272859 |
| concepts[0].level | 3 |
| concepts[0].score | 0.902327299118042 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q7834031 |
| concepts[0].display_name | Transferability |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.3853895664215088 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C149782125 |
| concepts[2].level | 1 |
| concepts[2].score | 0.30248063802719116 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q160039 |
| concepts[2].display_name | Econometrics |
| concepts[3].id | https://openalex.org/C33923547 |
| concepts[3].level | 0 |
| concepts[3].score | 0.28328582644462585 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[3].display_name | Mathematics |
| concepts[4].id | https://openalex.org/C140331021 |
| concepts[4].level | 2 |
| concepts[4].score | 0.0 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q1868104 |
| concepts[4].display_name | Logit |
| keywords[0].id | https://openalex.org/keywords/transferability |
| keywords[0].score | 0.902327299118042 |
| keywords[0].display_name | Transferability |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.3853895664215088 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/econometrics |
| keywords[2].score | 0.30248063802719116 |
| keywords[2].display_name | Econometrics |
| keywords[3].id | https://openalex.org/keywords/mathematics |
| keywords[3].score | 0.28328582644462585 |
| keywords[3].display_name | Mathematics |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2412.20807 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://arxiv.org/pdf/2412.20807 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2412.20807 |
| locations[1].id | doi:10.48550/arxiv.2412.20807 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2412.20807 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5047102000 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-7744-9218 |
| authorships[0].author.display_name | Hui Zeng |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Zeng, Hui |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5015462564 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-4709-5786 |
| authorships[1].author.display_name | Sanshuai Cui |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Cui, Sanshuai |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5059970501 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-8239-4864 |
| authorships[2].author.display_name | Biwei Chen |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Chen, Biwei |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5014092332 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-9287-7536 |
| authorships[3].author.display_name | Anjie Peng |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Peng, Anjie |
| authorships[3].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2412.20807 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted Transferability |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10784 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.17389999330043793 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2204 |
| primary_topic.subfield.display_name | Biomedical Engineering |
| primary_topic.display_name | Muscle activation and electromyography studies |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W4399895933, https://openalex.org/W2161221533, https://openalex.org/W4229699405, https://openalex.org/W1666484574, https://openalex.org/W2216382288, https://openalex.org/W2355491300, https://openalex.org/W4234629551 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2412.20807 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2412.20807 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2412.20807 |
| primary_location.id | pmh:oai:arXiv.org:2412.20807 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://arxiv.org/pdf/2412.20807 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2412.20807 |
| publication_date | 2024-12-30 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 70, 90 |
| abstract_inverted_index.AE | 88 |
| abstract_inverted_index.We | 94 |
| abstract_inverted_index.an | 26 |
| abstract_inverted_index.at | 131 |
| abstract_inverted_index.by | 103 |
| abstract_inverted_index.in | 31, 53, 110, 123 |
| abstract_inverted_index.is | 16, 129 |
| abstract_inverted_index.of | 7, 13, 69, 73, 119 |
| abstract_inverted_index.to | 64, 84 |
| abstract_inverted_index.we | 77 |
| abstract_inverted_index.The | 127 |
| abstract_inverted_index.and | 48 |
| abstract_inverted_index.can | 34 |
| abstract_inverted_index.far | 18 |
| abstract_inverted_index.its | 37 |
| abstract_inverted_index.the | 11, 46, 50, 54, 59, 67, 74, 81, 86, 96, 117, 120 |
| abstract_inverted_index.(AE) | 30 |
| abstract_inverted_index.With | 0 |
| abstract_inverted_index.code | 128 |
| abstract_inverted_index.flat | 71 |
| abstract_inverted_index.from | 19 |
| abstract_inverted_index.loss | 75 |
| abstract_inverted_index.more | 91 |
| abstract_inverted_index.much | 1 |
| abstract_inverted_index.only | 44 |
| abstract_inverted_index.over | 80 |
| abstract_inverted_index.pull | 85 |
| abstract_inverted_index.than | 5 |
| abstract_inverted_index.that | 6, 24, 58 |
| abstract_inverted_index.them | 105 |
| abstract_inverted_index.time | 4 |
| abstract_inverted_index.with | 99, 106 |
| abstract_inverted_index.boost | 36 |
| abstract_inverted_index.space | 33 |
| abstract_inverted_index.still | 17 |
| abstract_inverted_index.tends | 63 |
| abstract_inverted_index.Noting | 57 |
| abstract_inverted_index.Recent | 21 |
| abstract_inverted_index.around | 66 |
| abstract_inverted_index.ignore | 49 |
| abstract_inverted_index.longer | 2 |
| abstract_inverted_index.method | 98, 122 |
| abstract_inverted_index.region | 72 |
| abstract_inverted_index.reveal | 23 |
| abstract_inverted_index.uphold | 116 |
| abstract_inverted_index.attacks | 9, 15, 109 |
| abstract_inverted_index.compare | 95 |
| abstract_inverted_index.crafted | 87 |
| abstract_inverted_index.example | 29 |
| abstract_inverted_index.feature | 32 |
| abstract_inverted_index.propose | 78 |
| abstract_inverted_index.region. | 93 |
| abstract_inverted_index.results | 115 |
| abstract_inverted_index.schemes | 43, 102 |
| abstract_inverted_index.studies | 22 |
| abstract_inverted_index.towards | 89 |
| abstract_inverted_index.utilize | 45 |
| abstract_inverted_index.vanilla | 60 |
| abstract_inverted_index.various | 111 |
| abstract_inverted_index.However, | 40 |
| abstract_inverted_index.boosting | 124 |
| abstract_inverted_index.centered | 92 |
| abstract_inverted_index.endpoint | 47 |
| abstract_inverted_index.existing | 27, 41, 100 |
| abstract_inverted_index.proposed | 97, 121 |
| abstract_inverted_index.surface, | 76 |
| abstract_inverted_index.targeted | 14, 38, 108, 125 |
| abstract_inverted_index.valuable | 51 |
| abstract_inverted_index.attacking | 112 |
| abstract_inverted_index.available | 130 |
| abstract_inverted_index.averaging | 79 |
| abstract_inverted_index.oscillate | 65 |
| abstract_inverted_index.periphery | 68 |
| abstract_inverted_index.scenarios. | 113 |
| abstract_inverted_index.trajectory | 62, 83 |
| abstract_inverted_index.untargeted | 8 |
| abstract_inverted_index.adversarial | 28 |
| abstract_inverted_index.efficiently | 35 |
| abstract_inverted_index.fine-tuning | 25, 42, 55, 61, 82, 101 |
| abstract_inverted_index.information | 52 |
| abstract_inverted_index.integrating | 104 |
| abstract_inverted_index.superiority | 118 |
| abstract_inverted_index.trajectory. | 56 |
| abstract_inverted_index.Experimental | 114 |
| abstract_inverted_index.optimization | 3 |
| abstract_inverted_index.satisfactory. | 20 |
| abstract_inverted_index.transferability | 12 |
| abstract_inverted_index.notwithstanding, | 10 |
| abstract_inverted_index.state-of-the-art | 107 |
| abstract_inverted_index.transferability. | 39, 126 |
| abstract_inverted_index.github.com/zengh5/Avg_FT. | 132 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 4 |
| citation_normalized_percentile |