FairSquare: probabilistic verification of program fairness Article Swipe

PDF

Aws Albarghouthi , Loris D’Antoni , Samuel Drews , Aditya V. Nori ·

YOU? · · 2017 · Open Access · · DOI: https://doi.org/10.1145/3133904

With the range and sensitivity of algorithmic decisions expanding at a break-neck speed, it is imperative that we aggressively investigate fairness and bias in decision-making programs. First, we show that a number of recently proposed formal definitions of fairness can be encoded as probabilistic program properties. Second, with the goal of enabling rigorous reasoning about fairness, we design a novel technique for verifying probabilistic properties that admits a wide class of decision-making programs. Third, we present FairSquare, the first verification tool for automatically certifying that a program meets a given fairness property. We evaluate FairSquare on a range of decision-making programs. Our evaluation demonstrates FairSquare’s ability to verify fairness for a range of different programs, which we show are out-of-reach for state-of-the-art program analysis techniques.

Related Topics

Computer Science

Range (Aeronautics)

Theoretical Computer Science

Artificial Intelligence

Electronic Engineering

Wireless

Concepts

Probabilistic logic Computer science Range (aeronautics) Property (philosophy) Fairness measure Class (philosophy) Outcome (game theory) Sensitivity (control systems) Theoretical computer science Artificial intelligence Mathematics Telecommunications Epistemology Throughput Philosophy Engineering Composite material Materials science Mathematical economics Electronic engineering Wireless

Metadata

Type: article
Language: en
Landing Page: https://doi.org/10.1145/3133904
PDF: https://dl.acm.org/doi/pdf/10.1145/3133904
OA Status: bronze
Cited By: 98
References: 77
Related Works: 10
OpenAlex ID: https://openalex.org/W2762833920

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W2762833920

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.1145/3133904

Digital Object Identifier
Title: FairSquare: probabilistic verification of program fairness

Work title
Type: article

OpenAlex work type
Language: en

Primary language
Publication year: 2017

Year of publication
Publication date: 2017-10-12

Full publication date if available
Authors: Aws Albarghouthi, Loris D’Antoni, Samuel Drews, Aditya V. Nori

List of authors in order
Landing page: https://doi.org/10.1145/3133904

Publisher landing page
PDF URL: https://dl.acm.org/doi/pdf/10.1145/3133904

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: bronze

Open access status per OpenAlex
OA URL: https://dl.acm.org/doi/pdf/10.1145/3133904

Direct OA link when available
Concepts: Probabilistic logic, Computer science, Range (aeronautics), Property (philosophy), Fairness measure, Class (philosophy), Outcome (game theory), Sensitivity (control systems), Theoretical computer science, Artificial intelligence, Mathematics, Telecommunications, Epistemology, Throughput, Philosophy, Engineering, Composite material, Materials science, Mathematical economics, Electronic engineering, Wireless

Top concepts (fields/topics) attached by OpenAlex
Cited by: 98

Total citation count in OpenAlex
Citations by year (recent): 2025: 12, 2024: 12, 2023: 19, 2022: 15, 2021: 10

Per-year citation counts (last 5 years)
References (count): 77

Number of works referenced by this work
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W2762833920
doi	https://doi.org/10.1145/3133904
ids.doi	https://doi.org/10.1145/3133904
ids.mag	2762833920
ids.openalex	https://openalex.org/W2762833920
fwci	6.87538913
type	article
title	FairSquare: probabilistic verification of program fairness
awards[0].id	https://openalex.org/G2184340811
awards[0].funder_id	https://openalex.org/F4320306076
awards[0].display_name
awards[0].funder_award_id	1704117 and 1566015
awards[0].funder_display_name	National Science Foundation
biblio.issue	OOPSLA
biblio.volume	1
biblio.last_page	30
biblio.first_page	1
topics[0].id	https://openalex.org/T11689
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9991999864578247
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Adversarial Robustness in Machine Learning
topics[1].id	https://openalex.org/T10883
topics[1].field.id	https://openalex.org/fields/33
topics[1].field.display_name	Social Sciences
topics[1].score	0.9918000102043152
topics[1].domain.id	https://openalex.org/domains/2
topics[1].domain.display_name	Social Sciences
topics[1].subfield.id	https://openalex.org/subfields/3311
topics[1].subfield.display_name	Safety Research
topics[1].display_name	Ethics and Social Impacts of AI
topics[2].id	https://openalex.org/T10743
topics[2].field.id	https://openalex.org/fields/17
topics[2].field.display_name	Computer Science
topics[2].score	0.9749000072479248
topics[2].domain.id	https://openalex.org/domains/3
topics[2].domain.display_name	Physical Sciences
topics[2].subfield.id	https://openalex.org/subfields/1712
topics[2].subfield.display_name	Software
topics[2].display_name	Software Testing and Debugging Techniques
funders[0].id	https://openalex.org/F4320306076
funders[0].ror	https://ror.org/021nxhr62
funders[0].display_name	National Science Foundation
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C49937458
concepts[0].level	2
concepts[0].score	0.8547496199607849
concepts[0].wikidata	https://www.wikidata.org/wiki/Q2599292
concepts[0].display_name	Probabilistic logic
concepts[1].id	https://openalex.org/C41008148
concepts[1].level	0
concepts[1].score	0.8170470595359802
concepts[1].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[1].display_name	Computer science
concepts[2].id	https://openalex.org/C204323151
concepts[2].level	2
concepts[2].score	0.6073737144470215
concepts[2].wikidata	https://www.wikidata.org/wiki/Q905424
concepts[2].display_name	Range (aeronautics)
concepts[3].id	https://openalex.org/C189950617
concepts[3].level	2
concepts[3].score	0.5581398010253906
concepts[3].wikidata	https://www.wikidata.org/wiki/Q937228
concepts[3].display_name	Property (philosophy)
concepts[4].id	https://openalex.org/C11867375
concepts[4].level	4
concepts[4].score	0.4956880807876587
concepts[4].wikidata	https://www.wikidata.org/wiki/Q5430671
concepts[4].display_name	Fairness measure
concepts[5].id	https://openalex.org/C2777212361
concepts[5].level	2
concepts[5].score	0.48015016317367554
concepts[5].wikidata	https://www.wikidata.org/wiki/Q5127848
concepts[5].display_name	Class (philosophy)
concepts[6].id	https://openalex.org/C148220186
concepts[6].level	2
concepts[6].score	0.4322609305381775
concepts[6].wikidata	https://www.wikidata.org/wiki/Q7111912
concepts[6].display_name	Outcome (game theory)
concepts[7].id	https://openalex.org/C21200559
concepts[7].level	2
concepts[7].score	0.41244882345199585
concepts[7].wikidata	https://www.wikidata.org/wiki/Q7451068
concepts[7].display_name	Sensitivity (control systems)
concepts[8].id	https://openalex.org/C80444323
concepts[8].level	1
concepts[8].score	0.40475672483444214
concepts[8].wikidata	https://www.wikidata.org/wiki/Q2878974
concepts[8].display_name	Theoretical computer science
concepts[9].id	https://openalex.org/C154945302
concepts[9].level	1
concepts[9].score	0.2318842113018036
concepts[9].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[9].display_name	Artificial intelligence
concepts[10].id	https://openalex.org/C33923547
concepts[10].level	0
concepts[10].score	0.10424467921257019
concepts[10].wikidata	https://www.wikidata.org/wiki/Q395
concepts[10].display_name	Mathematics
concepts[11].id	https://openalex.org/C76155785
concepts[11].level	1
concepts[11].score	0.0
concepts[11].wikidata	https://www.wikidata.org/wiki/Q418
concepts[11].display_name	Telecommunications
concepts[12].id	https://openalex.org/C111472728
concepts[12].level	1
concepts[12].score	0.0
concepts[12].wikidata	https://www.wikidata.org/wiki/Q9471
concepts[12].display_name	Epistemology
concepts[13].id	https://openalex.org/C157764524
concepts[13].level	3
concepts[13].score	0.0
concepts[13].wikidata	https://www.wikidata.org/wiki/Q1383412
concepts[13].display_name	Throughput
concepts[14].id	https://openalex.org/C138885662
concepts[14].level	0
concepts[14].score	0.0
concepts[14].wikidata	https://www.wikidata.org/wiki/Q5891
concepts[14].display_name	Philosophy
concepts[15].id	https://openalex.org/C127413603
concepts[15].level	0
concepts[15].score	0.0
concepts[15].wikidata	https://www.wikidata.org/wiki/Q11023
concepts[15].display_name	Engineering
concepts[16].id	https://openalex.org/C159985019
concepts[16].level	1
concepts[16].score	0.0
concepts[16].wikidata	https://www.wikidata.org/wiki/Q181790
concepts[16].display_name	Composite material
concepts[17].id	https://openalex.org/C192562407
concepts[17].level	0
concepts[17].score	0.0
concepts[17].wikidata	https://www.wikidata.org/wiki/Q228736
concepts[17].display_name	Materials science
concepts[18].id	https://openalex.org/C144237770
concepts[18].level	1
concepts[18].score	0.0
concepts[18].wikidata	https://www.wikidata.org/wiki/Q747534
concepts[18].display_name	Mathematical economics
concepts[19].id	https://openalex.org/C24326235
concepts[19].level	1
concepts[19].score	0.0
concepts[19].wikidata	https://www.wikidata.org/wiki/Q126095
concepts[19].display_name	Electronic engineering
concepts[20].id	https://openalex.org/C555944384
concepts[20].level	2
concepts[20].score	0.0
concepts[20].wikidata	https://www.wikidata.org/wiki/Q249
concepts[20].display_name	Wireless
keywords[0].id	https://openalex.org/keywords/probabilistic-logic
keywords[0].score	0.8547496199607849
keywords[0].display_name	Probabilistic logic
keywords[1].id	https://openalex.org/keywords/computer-science
keywords[1].score	0.8170470595359802
keywords[1].display_name	Computer science
keywords[2].id	https://openalex.org/keywords/range
keywords[2].score	0.6073737144470215
keywords[2].display_name	Range (aeronautics)
keywords[3].id	https://openalex.org/keywords/property
keywords[3].score	0.5581398010253906
keywords[3].display_name	Property (philosophy)
keywords[4].id	https://openalex.org/keywords/fairness-measure
keywords[4].score	0.4956880807876587
keywords[4].display_name	Fairness measure
keywords[5].id	https://openalex.org/keywords/class
keywords[5].score	0.48015016317367554
keywords[5].display_name	Class (philosophy)
keywords[6].id	https://openalex.org/keywords/outcome
keywords[6].score	0.4322609305381775
keywords[6].display_name	Outcome (game theory)
keywords[7].id	https://openalex.org/keywords/sensitivity
keywords[7].score	0.41244882345199585
keywords[7].display_name	Sensitivity (control systems)
keywords[8].id	https://openalex.org/keywords/theoretical-computer-science
keywords[8].score	0.40475672483444214
keywords[8].display_name	Theoretical computer science
keywords[9].id	https://openalex.org/keywords/artificial-intelligence
keywords[9].score	0.2318842113018036
keywords[9].display_name	Artificial intelligence
keywords[10].id	https://openalex.org/keywords/mathematics
keywords[10].score	0.10424467921257019
keywords[10].display_name	Mathematics
language	en
locations[0].id	doi:10.1145/3133904
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4210216081
locations[0].source.issn	2475-1421
locations[0].source.type	journal
locations[0].source.is_oa	False
locations[0].source.issn_l	2475-1421
locations[0].source.is_core	True
locations[0].source.is_in_doaj	False
locations[0].source.display_name	Proceedings of the ACM on Programming Languages
locations[0].source.host_organization	https://openalex.org/P4310319798
locations[0].source.host_organization_name	Association for Computing Machinery
locations[0].source.host_organization_lineage	https://openalex.org/P4310319798
locations[0].source.host_organization_lineage_names	Association for Computing Machinery
locations[0].license
locations[0].pdf_url	https://dl.acm.org/doi/pdf/10.1145/3133904
locations[0].version	publishedVersion
locations[0].raw_type	journal-article
locations[0].license_id
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	Proceedings of the ACM on Programming Languages
locations[0].landing_page_url	https://doi.org/10.1145/3133904
indexed_in	crossref
authorships[0].author.id	https://openalex.org/A5050593520
authorships[0].author.orcid	https://orcid.org/0000-0003-4577-175X
authorships[0].author.display_name	Aws Albarghouthi
authorships[0].countries	US
authorships[0].affiliations[0].institution_ids	https://openalex.org/I135310074
authorships[0].affiliations[0].raw_affiliation_string	University of Wisconsin-Madison, USA
authorships[0].institutions[0].id	https://openalex.org/I135310074
authorships[0].institutions[0].ror	https://ror.org/01y2jtd41
authorships[0].institutions[0].type	education
authorships[0].institutions[0].lineage	https://openalex.org/I135310074
authorships[0].institutions[0].country_code	US
authorships[0].institutions[0].display_name	University of Wisconsin–Madison
authorships[0].author_position	first
authorships[0].raw_author_name	Aws Albarghouthi
authorships[0].is_corresponding	False
authorships[0].raw_affiliation_strings	University of Wisconsin-Madison, USA
authorships[1].author.id	https://openalex.org/A5089920000
authorships[1].author.orcid	https://orcid.org/0000-0001-9625-4037
authorships[1].author.display_name	Loris D’Antoni
authorships[1].countries	US
authorships[1].affiliations[0].institution_ids	https://openalex.org/I135310074
authorships[1].affiliations[0].raw_affiliation_string	University of Wisconsin-Madison, USA
authorships[1].institutions[0].id	https://openalex.org/I135310074
authorships[1].institutions[0].ror	https://ror.org/01y2jtd41
authorships[1].institutions[0].type	education
authorships[1].institutions[0].lineage	https://openalex.org/I135310074
authorships[1].institutions[0].country_code	US
authorships[1].institutions[0].display_name	University of Wisconsin–Madison
authorships[1].author_position	middle
authorships[1].raw_author_name	Loris D'Antoni
authorships[1].is_corresponding	False
authorships[1].raw_affiliation_strings	University of Wisconsin-Madison, USA
authorships[2].author.id	https://openalex.org/A5026703503
authorships[2].author.orcid
authorships[2].author.display_name	Samuel Drews
authorships[2].countries	US
authorships[2].affiliations[0].institution_ids	https://openalex.org/I135310074
authorships[2].affiliations[0].raw_affiliation_string	University of Wisconsin-Madison, USA
authorships[2].institutions[0].id	https://openalex.org/I135310074
authorships[2].institutions[0].ror	https://ror.org/01y2jtd41
authorships[2].institutions[0].type	education
authorships[2].institutions[0].lineage	https://openalex.org/I135310074
authorships[2].institutions[0].country_code	US
authorships[2].institutions[0].display_name	University of Wisconsin–Madison
authorships[2].author_position	middle
authorships[2].raw_author_name	Samuel Drews
authorships[2].is_corresponding	False
authorships[2].raw_affiliation_strings	University of Wisconsin-Madison, USA
authorships[3].author.id	https://openalex.org/A5111937381
authorships[3].author.orcid
authorships[3].author.display_name	Aditya V. Nori
authorships[3].countries	GB
authorships[3].affiliations[0].institution_ids	https://openalex.org/I4210164937
authorships[3].affiliations[0].raw_affiliation_string	Microsoft Research, UK
authorships[3].institutions[0].id	https://openalex.org/I4210164937
authorships[3].institutions[0].ror	https://ror.org/05k87vq12
authorships[3].institutions[0].type	company
authorships[3].institutions[0].lineage	https://openalex.org/I1290206253, https://openalex.org/I4210164937
authorships[3].institutions[0].country_code	GB
authorships[3].institutions[0].display_name	Microsoft Research (United Kingdom)
authorships[3].author_position	last
authorships[3].raw_author_name	Aditya V. Nori
authorships[3].is_corresponding	False
authorships[3].raw_affiliation_strings	Microsoft Research, UK
has_content.pdf	True
has_content.grobid_xml	True
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://dl.acm.org/doi/pdf/10.1145/3133904
open_access.oa_status	bronze
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	FairSquare: probabilistic verification of program fairness
has_fulltext	True
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T11689
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9991999864578247
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Adversarial Robustness in Machine Learning
related_works	https://openalex.org/W2978999882, https://openalex.org/W3141031773, https://openalex.org/W1595686156, https://openalex.org/W2181392282, https://openalex.org/W2361713743, https://openalex.org/W2136050782, https://openalex.org/W2119369480, https://openalex.org/W148937441, https://openalex.org/W2048777860, https://openalex.org/W2153369162
cited_by_count	98
counts_by_year[0].year	2025
counts_by_year[0].cited_by_count	12
counts_by_year[1].year	2024
counts_by_year[1].cited_by_count	12
counts_by_year[2].year	2023
counts_by_year[2].cited_by_count	19
counts_by_year[3].year	2022
counts_by_year[3].cited_by_count	15
counts_by_year[4].year	2021
counts_by_year[4].cited_by_count	10
counts_by_year[5].year	2020
counts_by_year[5].cited_by_count	11
counts_by_year[6].year	2019
counts_by_year[6].cited_by_count	10
counts_by_year[7].year	2018
counts_by_year[7].cited_by_count	8
counts_by_year[8].year	2017
counts_by_year[8].cited_by_count	1
locations_count	1
best_oa_location.id	doi:10.1145/3133904
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4210216081
best_oa_location.source.issn	2475-1421
best_oa_location.source.type	journal
best_oa_location.source.is_oa	False
best_oa_location.source.issn_l	2475-1421
best_oa_location.source.is_core	True
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	Proceedings of the ACM on Programming Languages
best_oa_location.source.host_organization	https://openalex.org/P4310319798
best_oa_location.source.host_organization_name	Association for Computing Machinery
best_oa_location.source.host_organization_lineage	https://openalex.org/P4310319798
best_oa_location.source.host_organization_lineage_names	Association for Computing Machinery
best_oa_location.license
best_oa_location.pdf_url	https://dl.acm.org/doi/pdf/10.1145/3133904
best_oa_location.version	publishedVersion
best_oa_location.raw_type	journal-article
best_oa_location.license_id
best_oa_location.is_accepted	True
best_oa_location.is_published	True
best_oa_location.raw_source_name	Proceedings of the ACM on Programming Languages
best_oa_location.landing_page_url	https://doi.org/10.1145/3133904
primary_location.id	doi:10.1145/3133904
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4210216081
primary_location.source.issn	2475-1421
primary_location.source.type	journal
primary_location.source.is_oa	False
primary_location.source.issn_l	2475-1421
primary_location.source.is_core	True
primary_location.source.is_in_doaj	False
primary_location.source.display_name	Proceedings of the ACM on Programming Languages
primary_location.source.host_organization	https://openalex.org/P4310319798
primary_location.source.host_organization_name	Association for Computing Machinery
primary_location.source.host_organization_lineage	https://openalex.org/P4310319798
primary_location.source.host_organization_lineage_names	Association for Computing Machinery
primary_location.license
primary_location.pdf_url	https://dl.acm.org/doi/pdf/10.1145/3133904
primary_location.version	publishedVersion
primary_location.raw_type	journal-article
primary_location.license_id
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	Proceedings of the ACM on Programming Languages
primary_location.landing_page_url	https://doi.org/10.1145/3133904
publication_date	2017-10-12
publication_year	2017
referenced_works	https://openalex.org/W2802594920, https://openalex.org/W2735457297, https://openalex.org/W1499853177, https://openalex.org/W4233804448, https://openalex.org/W4236991443, https://openalex.org/W2047749307, https://openalex.org/W1504317179, https://openalex.org/W2026612342, https://openalex.org/W2097246321, https://openalex.org/W2105544671, https://openalex.org/W2026775511, https://openalex.org/W2107220315, https://openalex.org/W1528660673, https://openalex.org/W2155049725, https://openalex.org/W2129538349, https://openalex.org/W1982205631, https://openalex.org/W1648303880, https://openalex.org/W2014894062, https://openalex.org/W1480909796, https://openalex.org/W2911978475, https://openalex.org/W2100960835, https://openalex.org/W2063342497, https://openalex.org/W1987679122, https://openalex.org/W2014352947, https://openalex.org/W2130514924, https://openalex.org/W2494200839, https://openalex.org/W2060573639, https://openalex.org/W2295266283, https://openalex.org/W2133990480, https://openalex.org/W2011495999, https://openalex.org/W1489298643, https://openalex.org/W2808105152, https://openalex.org/W2024355065, https://openalex.org/W26017481, https://openalex.org/W2169784622, https://openalex.org/W1589239973, https://openalex.org/W1975447428, https://openalex.org/W1551315579, https://openalex.org/W2026019770, https://openalex.org/W2184545618, https://openalex.org/W4246535868, https://openalex.org/W2048025009, https://openalex.org/W3083206818, https://openalex.org/W6630485915, https://openalex.org/W3101972507, https://openalex.org/W2152492994, https://openalex.org/W2962922665, https://openalex.org/W3014235357, https://openalex.org/W3126102191, https://openalex.org/W3121483320, https://openalex.org/W2596701210, https://openalex.org/W2395317528, https://openalex.org/W1819662813, https://openalex.org/W2616376319, https://openalex.org/W2600077159, https://openalex.org/W2524301210, https://openalex.org/W2613463286, https://openalex.org/W1890754682, https://openalex.org/W2520480402, https://openalex.org/W1928668274, https://openalex.org/W2252814878, https://openalex.org/W4299828299, https://openalex.org/W2162670686, https://openalex.org/W2108207895, https://openalex.org/W1507645993, https://openalex.org/W1511986666, https://openalex.org/W1809030594, https://openalex.org/W2791059564, https://openalex.org/W2950538796, https://openalex.org/W780350140, https://openalex.org/W2095932468, https://openalex.org/W1665214252, https://openalex.org/W2095840868, https://openalex.org/W1595559231, https://openalex.org/W2107399212, https://openalex.org/W2296427110, https://openalex.org/W2297259217
referenced_works_count	77
abstract_inverted_index.a	10, 30, 58, 67, 85, 88, 96, 110
abstract_inverted_index.We	92
abstract_inverted_index.as	42
abstract_inverted_index.at	9
abstract_inverted_index.be	40
abstract_inverted_index.in	23
abstract_inverted_index.is	14
abstract_inverted_index.it	13
abstract_inverted_index.of	5, 32, 37, 50, 70, 98, 112
abstract_inverted_index.on	95
abstract_inverted_index.to	106
abstract_inverted_index.we	17, 27, 56, 74, 116
abstract_inverted_index.Our	101
abstract_inverted_index.and	3, 21
abstract_inverted_index.are	118
abstract_inverted_index.can	39
abstract_inverted_index.for	61, 81, 109, 120
abstract_inverted_index.the	1, 48, 77
abstract_inverted_index.With	0
abstract_inverted_index.bias	22
abstract_inverted_index.goal	49
abstract_inverted_index.show	28, 117
abstract_inverted_index.that	16, 29, 65, 84
abstract_inverted_index.tool	80
abstract_inverted_index.wide	68
abstract_inverted_index.with	47
abstract_inverted_index.about	54
abstract_inverted_index.class	69
abstract_inverted_index.first	78
abstract_inverted_index.given	89
abstract_inverted_index.meets	87
abstract_inverted_index.novel	59
abstract_inverted_index.range	2, 97, 111
abstract_inverted_index.which	115
abstract_inverted_index.First,	26
abstract_inverted_index.Third,	73
abstract_inverted_index.admits	66
abstract_inverted_index.design	57
abstract_inverted_index.formal	35
abstract_inverted_index.number	31
abstract_inverted_index.speed,	12
abstract_inverted_index.verify	107
abstract_inverted_index.Second,	46
abstract_inverted_index.ability	105
abstract_inverted_index.encoded	41
abstract_inverted_index.present	75
abstract_inverted_index.program	44, 86, 122
abstract_inverted_index.analysis	123
abstract_inverted_index.enabling	51
abstract_inverted_index.evaluate	93
abstract_inverted_index.fairness	20, 38, 90, 108
abstract_inverted_index.proposed	34
abstract_inverted_index.recently	33
abstract_inverted_index.rigorous	52
abstract_inverted_index.decisions	7
abstract_inverted_index.different	113
abstract_inverted_index.expanding	8
abstract_inverted_index.fairness,	55
abstract_inverted_index.programs,	114
abstract_inverted_index.programs.	25, 72, 100
abstract_inverted_index.property.	91
abstract_inverted_index.reasoning	53
abstract_inverted_index.technique	60
abstract_inverted_index.verifying	62
abstract_inverted_index.FairSquare	94
abstract_inverted_index.break-neck	11
abstract_inverted_index.certifying	83
abstract_inverted_index.evaluation	102
abstract_inverted_index.imperative	15
abstract_inverted_index.properties	64
abstract_inverted_index.FairSquare,	76
abstract_inverted_index.algorithmic	6
abstract_inverted_index.definitions	36
abstract_inverted_index.investigate	19
abstract_inverted_index.properties.	45
abstract_inverted_index.sensitivity	4
abstract_inverted_index.techniques.	124
abstract_inverted_index.aggressively	18
abstract_inverted_index.demonstrates	103
abstract_inverted_index.out-of-reach	119
abstract_inverted_index.verification	79
abstract_inverted_index.automatically	82
abstract_inverted_index.probabilistic	43, 63
abstract_inverted_index.FairSquare’s	104
abstract_inverted_index.decision-making	24, 71, 99
abstract_inverted_index.state-of-the-art	121
cited_by_percentile_year.max	100
cited_by_percentile_year.min	90
countries_distinct_count	2
institutions_distinct_count	4
sustainable_development_goals[0].id	https://metadata.un.org/sdg/16
sustainable_development_goals[0].score	0.8199999928474426
sustainable_development_goals[0].display_name	Peace, Justice and strong institutions
citation_normalized_percentile.value	0.96901949
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	True