Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature Article Swipe
Changtao Miao
,
Qi Chu
,
Weihai Li
,
Tao Gong
,
Wanyi Zhuang
,
Nenghai Yu
·
YOU?
·
· 2021
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2103.07915
YOU?
·
· 2021
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2103.07915
Over the past several years, in order to solve the problem of malicious abuse of facial manipulation technology, face manipulation detection technology has obtained considerable attention and achieved remarkable progress. However, most existing methods have very impoverished generalization ability and robustness. In this paper, we propose a novel method for face manipulation detection, which can improve the generalization ability and robustness by bag-of-local-feature. Specifically, we extend Transformers using bag-of-feature approach to encode inter-patch relationships, allowing it to learn local forgery features without any explicit supervision. Extensive experiments demonstrate that our method can outperform competing state-of-the-art methods on FaceForensics++, Celeb-DF and DeeperForensics-1.0 datasets.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2103.07915
- https://arxiv.org/pdf/2103.07915
- OA Status
- green
- Cited By
- 7
- References
- 27
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W3136646882
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W3136646882Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2103.07915Digital Object Identifier
- Title
-
Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-featureWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2021Year of publication
- Publication date
-
2021-03-14Full publication date if available
- Authors
-
Changtao Miao, Qi Chu, Weihai Li, Tao Gong, Wanyi Zhuang, Nenghai YuList of authors in order
- Landing page
-
https://arxiv.org/abs/2103.07915Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2103.07915Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2103.07915Direct OA link when available
- Concepts
-
Robustness (evolution), Computer science, Artificial intelligence, Generalization, ENCODE, Machine learning, Pattern recognition (psychology), Mathematics, Biochemistry, Gene, Mathematical analysis, ChemistryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
7Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1, 2024: 4, 2023: 1, 2022: 1Per-year citation counts (last 5 years)
- References (count)
-
27Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W3136646882 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2103.07915 |
| ids.doi | https://doi.org/10.48550/arxiv.2103.07915 |
| ids.mag | 3136646882 |
| ids.openalex | https://openalex.org/W3136646882 |
| fwci | |
| type | preprint |
| title | Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11448 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9962999820709229 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1707 |
| topics[0].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[0].display_name | Face recognition and analysis |
| topics[1].id | https://openalex.org/T12262 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9739000201225281 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Hate Speech and Cyberbullying Detection |
| topics[2].id | https://openalex.org/T13877 |
| topics[2].field.id | https://openalex.org/fields/33 |
| topics[2].field.display_name | Social Sciences |
| topics[2].score | 0.9696000218391418 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3308 |
| topics[2].subfield.display_name | Law |
| topics[2].display_name | Law in Society and Culture |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C63479239 |
| concepts[0].level | 3 |
| concepts[0].score | 0.8167583346366882 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q7353546 |
| concepts[0].display_name | Robustness (evolution) |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.7227345705032349 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C154945302 |
| concepts[2].level | 1 |
| concepts[2].score | 0.622011661529541 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[2].display_name | Artificial intelligence |
| concepts[3].id | https://openalex.org/C177148314 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5870787501335144 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q170084 |
| concepts[3].display_name | Generalization |
| concepts[4].id | https://openalex.org/C66746571 |
| concepts[4].level | 3 |
| concepts[4].score | 0.48006758093833923 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q1134833 |
| concepts[4].display_name | ENCODE |
| concepts[5].id | https://openalex.org/C119857082 |
| concepts[5].level | 1 |
| concepts[5].score | 0.43671751022338867 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[5].display_name | Machine learning |
| concepts[6].id | https://openalex.org/C153180895 |
| concepts[6].level | 2 |
| concepts[6].score | 0.41913753747940063 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q7148389 |
| concepts[6].display_name | Pattern recognition (psychology) |
| concepts[7].id | https://openalex.org/C33923547 |
| concepts[7].level | 0 |
| concepts[7].score | 0.15762224793434143 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[7].display_name | Mathematics |
| concepts[8].id | https://openalex.org/C55493867 |
| concepts[8].level | 1 |
| concepts[8].score | 0.0 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q7094 |
| concepts[8].display_name | Biochemistry |
| concepts[9].id | https://openalex.org/C104317684 |
| concepts[9].level | 2 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q7187 |
| concepts[9].display_name | Gene |
| concepts[10].id | https://openalex.org/C134306372 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q7754 |
| concepts[10].display_name | Mathematical analysis |
| concepts[11].id | https://openalex.org/C185592680 |
| concepts[11].level | 0 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q2329 |
| concepts[11].display_name | Chemistry |
| keywords[0].id | https://openalex.org/keywords/robustness |
| keywords[0].score | 0.8167583346366882 |
| keywords[0].display_name | Robustness (evolution) |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.7227345705032349 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[2].score | 0.622011661529541 |
| keywords[2].display_name | Artificial intelligence |
| keywords[3].id | https://openalex.org/keywords/generalization |
| keywords[3].score | 0.5870787501335144 |
| keywords[3].display_name | Generalization |
| keywords[4].id | https://openalex.org/keywords/encode |
| keywords[4].score | 0.48006758093833923 |
| keywords[4].display_name | ENCODE |
| keywords[5].id | https://openalex.org/keywords/machine-learning |
| keywords[5].score | 0.43671751022338867 |
| keywords[5].display_name | Machine learning |
| keywords[6].id | https://openalex.org/keywords/pattern-recognition |
| keywords[6].score | 0.41913753747940063 |
| keywords[6].display_name | Pattern recognition (psychology) |
| keywords[7].id | https://openalex.org/keywords/mathematics |
| keywords[7].score | 0.15762224793434143 |
| keywords[7].display_name | Mathematics |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2103.07915 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2103.07915 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2103.07915 |
| locations[1].id | doi:10.48550/arxiv.2103.07915 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2103.07915 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5077867418 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-7634-9992 |
| authorships[0].author.display_name | Changtao Miao |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Changtao Miao |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5045938154 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-3028-0755 |
| authorships[1].author.display_name | Qi Chu |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Qi Chu |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5102001334 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-4023-8385 |
| authorships[2].author.display_name | Weihai Li |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Weihai Li |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5088814076 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-0248-9404 |
| authorships[3].author.display_name | Tao Gong |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Tao Gong |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5088627439 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-9305-1189 |
| authorships[4].author.display_name | Wanyi Zhuang |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Wanyi Zhuang |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5064573190 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-4417-9316 |
| authorships[5].author.display_name | Nenghai Yu |
| authorships[5].author_position | last |
| authorships[5].raw_author_name | Nenghai Yu |
| authorships[5].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2103.07915 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2021-03-29T00:00:00 |
| display_name | Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T11448 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9962999820709229 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1707 |
| primary_topic.subfield.display_name | Computer Vision and Pattern Recognition |
| primary_topic.display_name | Face recognition and analysis |
| related_works | https://openalex.org/W2468279273, https://openalex.org/W2354198838, https://openalex.org/W1989130879, https://openalex.org/W2103419012, https://openalex.org/W2988126442, https://openalex.org/W1974414866, https://openalex.org/W2057568687, https://openalex.org/W2063982682, https://openalex.org/W2338543196, https://openalex.org/W1544691147 |
| cited_by_count | 7 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 4 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 1 |
| counts_by_year[3].year | 2022 |
| counts_by_year[3].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2103.07915 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2103.07915 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2103.07915 |
| primary_location.id | pmh:oai:arXiv.org:2103.07915 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2103.07915 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2103.07915 |
| publication_date | 2021-03-14 |
| publication_year | 2021 |
| referenced_works | https://openalex.org/W2982058372, https://openalex.org/W3048341421, https://openalex.org/W3090124563, https://openalex.org/W2891145043, https://openalex.org/W3090899510, https://openalex.org/W2970682761, https://openalex.org/W2971144153, https://openalex.org/W3009122694, https://openalex.org/W2952337489, https://openalex.org/W3108281670, https://openalex.org/W2972511899, https://openalex.org/W3087162391, https://openalex.org/W3091550498, https://openalex.org/W3035063907, https://openalex.org/W2963341956, https://openalex.org/W3034900344, https://openalex.org/W2970952463, https://openalex.org/W3034214108, https://openalex.org/W2963403868, https://openalex.org/W2970067051, https://openalex.org/W2898877033, https://openalex.org/W3094502228, https://openalex.org/W3090061298, https://openalex.org/W3022265721, https://openalex.org/W3034713808, https://openalex.org/W3034196597, https://openalex.org/W2976627522 |
| referenced_works_count | 27 |
| abstract_inverted_index.a | 46 |
| abstract_inverted_index.In | 41 |
| abstract_inverted_index.by | 61 |
| abstract_inverted_index.in | 5 |
| abstract_inverted_index.it | 75 |
| abstract_inverted_index.of | 11, 14 |
| abstract_inverted_index.on | 96 |
| abstract_inverted_index.to | 7, 70, 76 |
| abstract_inverted_index.we | 44, 64 |
| abstract_inverted_index.and | 26, 39, 59, 99 |
| abstract_inverted_index.any | 82 |
| abstract_inverted_index.can | 54, 91 |
| abstract_inverted_index.for | 49 |
| abstract_inverted_index.has | 22 |
| abstract_inverted_index.our | 89 |
| abstract_inverted_index.the | 1, 9, 56 |
| abstract_inverted_index.Over | 0 |
| abstract_inverted_index.face | 18, 50 |
| abstract_inverted_index.have | 34 |
| abstract_inverted_index.most | 31 |
| abstract_inverted_index.past | 2 |
| abstract_inverted_index.that | 88 |
| abstract_inverted_index.this | 42 |
| abstract_inverted_index.very | 35 |
| abstract_inverted_index.abuse | 13 |
| abstract_inverted_index.learn | 77 |
| abstract_inverted_index.local | 78 |
| abstract_inverted_index.novel | 47 |
| abstract_inverted_index.order | 6 |
| abstract_inverted_index.solve | 8 |
| abstract_inverted_index.using | 67 |
| abstract_inverted_index.which | 53 |
| abstract_inverted_index.encode | 71 |
| abstract_inverted_index.extend | 65 |
| abstract_inverted_index.facial | 15 |
| abstract_inverted_index.method | 48, 90 |
| abstract_inverted_index.paper, | 43 |
| abstract_inverted_index.years, | 4 |
| abstract_inverted_index.ability | 38, 58 |
| abstract_inverted_index.forgery | 79 |
| abstract_inverted_index.improve | 55 |
| abstract_inverted_index.methods | 33, 95 |
| abstract_inverted_index.problem | 10 |
| abstract_inverted_index.propose | 45 |
| abstract_inverted_index.several | 3 |
| abstract_inverted_index.without | 81 |
| abstract_inverted_index.Celeb-DF | 98 |
| abstract_inverted_index.However, | 30 |
| abstract_inverted_index.achieved | 27 |
| abstract_inverted_index.allowing | 74 |
| abstract_inverted_index.approach | 69 |
| abstract_inverted_index.existing | 32 |
| abstract_inverted_index.explicit | 83 |
| abstract_inverted_index.features | 80 |
| abstract_inverted_index.obtained | 23 |
| abstract_inverted_index.Extensive | 85 |
| abstract_inverted_index.attention | 25 |
| abstract_inverted_index.competing | 93 |
| abstract_inverted_index.datasets. | 101 |
| abstract_inverted_index.detection | 20 |
| abstract_inverted_index.malicious | 12 |
| abstract_inverted_index.progress. | 29 |
| abstract_inverted_index.detection, | 52 |
| abstract_inverted_index.outperform | 92 |
| abstract_inverted_index.remarkable | 28 |
| abstract_inverted_index.robustness | 60 |
| abstract_inverted_index.technology | 21 |
| abstract_inverted_index.demonstrate | 87 |
| abstract_inverted_index.experiments | 86 |
| abstract_inverted_index.inter-patch | 72 |
| abstract_inverted_index.robustness. | 40 |
| abstract_inverted_index.technology, | 17 |
| abstract_inverted_index.Transformers | 66 |
| abstract_inverted_index.considerable | 24 |
| abstract_inverted_index.impoverished | 36 |
| abstract_inverted_index.manipulation | 16, 19, 51 |
| abstract_inverted_index.supervision. | 84 |
| abstract_inverted_index.Specifically, | 63 |
| abstract_inverted_index.bag-of-feature | 68 |
| abstract_inverted_index.generalization | 37, 57 |
| abstract_inverted_index.relationships, | 73 |
| abstract_inverted_index.FaceForensics++, | 97 |
| abstract_inverted_index.state-of-the-art | 94 |
| abstract_inverted_index.DeeperForensics-1.0 | 100 |
| abstract_inverted_index.bag-of-local-feature. | 62 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 6 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/16 |
| sustainable_development_goals[0].score | 0.7900000214576721 |
| sustainable_development_goals[0].display_name | Peace, Justice and strong institutions |
| citation_normalized_percentile |