mFACE: Multilingual Summarization with Factual Consistency Evaluation Article Swipe
Roee Aharoni
,
Shashi Narayan
,
Joshua Maynez
,
Jonathan Herzig
,
Elizabeth A. Clark
,
Mirella Lapata
·
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2212.10622
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2212.10622
ive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. Several recent efforts attempt to address this by devising models that automatically detect factual inconsistencies in machine generated summaries. However, they focus exclusively on English, a language with abundant resources. In this work, we leverage factual consistency evaluation models to improve multilingual summarization. We explore two intuitive approaches to mitigate hallucinations based on the signal provided by a multilingual NLI model, namely data filtering and controlled generation. Experimental results in the 45 languages from the XLSum dataset show gains over strong baselines in both automatic and human evaluation.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2212.10622
- https://arxiv.org/pdf/2212.10622
- OA Status
- green
- Cited By
- 5
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4312107301
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4312107301Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2212.10622Digital Object Identifier
- Title
-
mFACE: Multilingual Summarization with Factual Consistency EvaluationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2022Year of publication
- Publication date
-
2022-12-20Full publication date if available
- Authors
-
Roee Aharoni, Shashi Narayan, Joshua Maynez, Jonathan Herzig, Elizabeth A. Clark, Mirella LapataList of authors in order
- Landing page
-
https://arxiv.org/abs/2212.10622Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2212.10622Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2212.10622Direct OA link when available
- Concepts
-
Automatic summarization, Computer science, Leverage (statistics), Consistency (knowledge bases), Natural language processing, Artificial intelligence, Focus (optics), Information retrieval, Machine learning, Optics, PhysicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
5Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1, 2024: 1, 2023: 3Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4312107301 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2212.10622 |
| ids.doi | https://doi.org/10.48550/arxiv.2212.10622 |
| ids.openalex | https://openalex.org/W4312107301 |
| fwci | |
| type | preprint |
| title | mFACE: Multilingual Summarization with Factual Consistency Evaluation |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10181 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9998000264167786 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Natural Language Processing Techniques |
| topics[1].id | https://openalex.org/T10028 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9997000098228455 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Topic Modeling |
| topics[2].id | https://openalex.org/T11710 |
| topics[2].field.id | https://openalex.org/fields/13 |
| topics[2].field.display_name | Biochemistry, Genetics and Molecular Biology |
| topics[2].score | 0.9897000193595886 |
| topics[2].domain.id | https://openalex.org/domains/1 |
| topics[2].domain.display_name | Life Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1312 |
| topics[2].subfield.display_name | Molecular Biology |
| topics[2].display_name | Biomedical Text Mining and Ontologies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C170858558 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9383451342582703 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1394144 |
| concepts[0].display_name | Automatic summarization |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.8485757112503052 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C153083717 |
| concepts[2].level | 2 |
| concepts[2].score | 0.8356029391288757 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q6535263 |
| concepts[2].display_name | Leverage (statistics) |
| concepts[3].id | https://openalex.org/C2776436953 |
| concepts[3].level | 2 |
| concepts[3].score | 0.7545433640480042 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q5163215 |
| concepts[3].display_name | Consistency (knowledge bases) |
| concepts[4].id | https://openalex.org/C204321447 |
| concepts[4].level | 1 |
| concepts[4].score | 0.6366355419158936 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q30642 |
| concepts[4].display_name | Natural language processing |
| concepts[5].id | https://openalex.org/C154945302 |
| concepts[5].level | 1 |
| concepts[5].score | 0.5736956596374512 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[5].display_name | Artificial intelligence |
| concepts[6].id | https://openalex.org/C192209626 |
| concepts[6].level | 2 |
| concepts[6].score | 0.5342850685119629 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q190909 |
| concepts[6].display_name | Focus (optics) |
| concepts[7].id | https://openalex.org/C23123220 |
| concepts[7].level | 1 |
| concepts[7].score | 0.34021347761154175 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q816826 |
| concepts[7].display_name | Information retrieval |
| concepts[8].id | https://openalex.org/C119857082 |
| concepts[8].level | 1 |
| concepts[8].score | 0.3303224742412567 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[8].display_name | Machine learning |
| concepts[9].id | https://openalex.org/C120665830 |
| concepts[9].level | 1 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q14620 |
| concepts[9].display_name | Optics |
| concepts[10].id | https://openalex.org/C121332964 |
| concepts[10].level | 0 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[10].display_name | Physics |
| keywords[0].id | https://openalex.org/keywords/automatic-summarization |
| keywords[0].score | 0.9383451342582703 |
| keywords[0].display_name | Automatic summarization |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.8485757112503052 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/leverage |
| keywords[2].score | 0.8356029391288757 |
| keywords[2].display_name | Leverage (statistics) |
| keywords[3].id | https://openalex.org/keywords/consistency |
| keywords[3].score | 0.7545433640480042 |
| keywords[3].display_name | Consistency (knowledge bases) |
| keywords[4].id | https://openalex.org/keywords/natural-language-processing |
| keywords[4].score | 0.6366355419158936 |
| keywords[4].display_name | Natural language processing |
| keywords[5].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[5].score | 0.5736956596374512 |
| keywords[5].display_name | Artificial intelligence |
| keywords[6].id | https://openalex.org/keywords/focus |
| keywords[6].score | 0.5342850685119629 |
| keywords[6].display_name | Focus (optics) |
| keywords[7].id | https://openalex.org/keywords/information-retrieval |
| keywords[7].score | 0.34021347761154175 |
| keywords[7].display_name | Information retrieval |
| keywords[8].id | https://openalex.org/keywords/machine-learning |
| keywords[8].score | 0.3303224742412567 |
| keywords[8].display_name | Machine learning |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2212.10622 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2212.10622 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2212.10622 |
| locations[1].id | doi:10.48550/arxiv.2212.10622 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2212.10622 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5027223654 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Roee Aharoni |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Aharoni, Roee |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5081801388 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Shashi Narayan |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Narayan, Shashi |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5021334672 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-4948-2875 |
| authorships[2].author.display_name | Joshua Maynez |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Maynez, Joshua |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5071893787 |
| authorships[3].author.orcid | https://orcid.org/0009-0000-7227-6557 |
| authorships[3].author.display_name | Jonathan Herzig |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Herzig, Jonathan |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5071925869 |
| authorships[4].author.orcid | https://orcid.org/0000-0003-1237-3181 |
| authorships[4].author.display_name | Elizabeth A. Clark |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Clark, Elizabeth |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5041024491 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-2107-1516 |
| authorships[5].author.display_name | Mirella Lapata |
| authorships[5].author_position | last |
| authorships[5].raw_author_name | Lapata, Mirella |
| authorships[5].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2212.10622 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | mFACE: Multilingual Summarization with Factual Consistency Evaluation |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10181 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9998000264167786 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Natural Language Processing Techniques |
| related_works | https://openalex.org/W2366403280, https://openalex.org/W1495108544, https://openalex.org/W2091301346, https://openalex.org/W3148229873, https://openalex.org/W4389760904, https://openalex.org/W2150160875, https://openalex.org/W4242223894, https://openalex.org/W4306886878, https://openalex.org/W3134559341, https://openalex.org/W4385570385 |
| cited_by_count | 5 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 1 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 3 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2212.10622 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2212.10622 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2212.10622 |
| primary_location.id | pmh:oai:arXiv.org:2212.10622 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2212.10622 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2212.10622 |
| publication_date | 2022-12-20 |
| publication_year | 2022 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 63, 95 |
| abstract_inverted_index.45 | 109 |
| abstract_inverted_index.In | 68 |
| abstract_inverted_index.We | 81 |
| abstract_inverted_index.by | 45, 94 |
| abstract_inverted_index.in | 6, 53, 107, 120 |
| abstract_inverted_index.of | 17 |
| abstract_inverted_index.on | 61, 90 |
| abstract_inverted_index.to | 10, 42, 77, 86 |
| abstract_inverted_index.we | 71 |
| abstract_inverted_index.NLI | 97 |
| abstract_inverted_index.and | 14, 102, 123 |
| abstract_inverted_index.for | 35 |
| abstract_inverted_index.has | 2 |
| abstract_inverted_index.the | 15, 91, 108, 112 |
| abstract_inverted_index.two | 83 |
| abstract_inverted_index.both | 121 |
| abstract_inverted_index.data | 100 |
| abstract_inverted_index.from | 27, 111 |
| abstract_inverted_index.over | 117 |
| abstract_inverted_index.show | 115 |
| abstract_inverted_index.that | 48 |
| abstract_inverted_index.they | 58 |
| abstract_inverted_index.this | 44, 69 |
| abstract_inverted_index.with | 65 |
| abstract_inverted_index.XLSum | 113 |
| abstract_inverted_index.based | 89 |
| abstract_inverted_index.focus | 59 |
| abstract_inverted_index.gains | 116 |
| abstract_inverted_index.human | 124 |
| abstract_inverted_index.still | 25 |
| abstract_inverted_index.their | 33 |
| abstract_inverted_index.work, | 70 |
| abstract_inverted_index.detect | 50 |
| abstract_inverted_index.model, | 98 |
| abstract_inverted_index.models | 13, 24, 47, 76 |
| abstract_inverted_index.namely | 99 |
| abstract_inverted_index.recent | 7, 39 |
| abstract_inverted_index.signal | 92 |
| abstract_inverted_index.strong | 118 |
| abstract_inverted_index.suffer | 26 |
| abstract_inverted_index.thanks | 9 |
| abstract_inverted_index.years, | 8 |
| abstract_inverted_index.Despite | 20 |
| abstract_inverted_index.Several | 38 |
| abstract_inverted_index.address | 43 |
| abstract_inverted_index.attempt | 41 |
| abstract_inverted_index.current | 23 |
| abstract_inverted_index.dataset | 114 |
| abstract_inverted_index.efforts | 40 |
| abstract_inverted_index.enjoyed | 3 |
| abstract_inverted_index.explore | 82 |
| abstract_inverted_index.factual | 51, 73 |
| abstract_inverted_index.improve | 78 |
| abstract_inverted_index.machine | 54 |
| abstract_inverted_index.renewed | 4 |
| abstract_inverted_index.results | 106 |
| abstract_inverted_index.utility | 34 |
| abstract_inverted_index.English, | 62 |
| abstract_inverted_index.However, | 57 |
| abstract_inverted_index.abundant | 66 |
| abstract_inverted_index.devising | 46 |
| abstract_inverted_index.interest | 5 |
| abstract_inverted_index.language | 12, 64 |
| abstract_inverted_index.leverage | 72 |
| abstract_inverted_index.mitigate | 87 |
| abstract_inverted_index.provided | 93 |
| abstract_inverted_index.reducing | 32 |
| abstract_inverted_index.results, | 22 |
| abstract_inverted_index.automatic | 122 |
| abstract_inverted_index.baselines | 119 |
| abstract_inverted_index.datasets. | 19 |
| abstract_inverted_index.factually | 29 |
| abstract_inverted_index.filtering | 101 |
| abstract_inverted_index.generated | 55 |
| abstract_inverted_index.intuitive | 84 |
| abstract_inverted_index.languages | 110 |
| abstract_inverted_index.promising | 21 |
| abstract_inverted_index.approaches | 85 |
| abstract_inverted_index.controlled | 103 |
| abstract_inverted_index.evaluation | 75 |
| abstract_inverted_index.generating | 28 |
| abstract_inverted_index.real-world | 36 |
| abstract_inverted_index.resources. | 67 |
| abstract_inverted_index.summaries, | 31 |
| abstract_inverted_index.summaries. | 56 |
| abstract_inverted_index.Abstractive | 0 |
| abstract_inverted_index.consistency | 74 |
| abstract_inverted_index.evaluation. | 125 |
| abstract_inverted_index.exclusively | 60 |
| abstract_inverted_index.generation. | 104 |
| abstract_inverted_index.large-scale | 18 |
| abstract_inverted_index.pre-trained | 11 |
| abstract_inverted_index.Experimental | 105 |
| abstract_inverted_index.application. | 37 |
| abstract_inverted_index.availability | 16 |
| abstract_inverted_index.inconsistent | 30 |
| abstract_inverted_index.multilingual | 79, 96 |
| abstract_inverted_index.automatically | 49 |
| abstract_inverted_index.summarization | 1 |
| abstract_inverted_index.hallucinations | 88 |
| abstract_inverted_index.summarization. | 80 |
| abstract_inverted_index.inconsistencies | 52 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 6 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/4 |
| sustainable_development_goals[0].score | 0.6700000166893005 |
| sustainable_development_goals[0].display_name | Quality Education |
| citation_normalized_percentile |