Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle Article Swipe
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2406.09029
Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regulation. But most approaches to addressing the fairness of AI-enabled systems are limited in scope in two significant ways: their substantive content focuses on statistical measures of fairness, and they do not emphasize the need to identify and address fairness considerations across the whole AI lifecycle. Our contribution is to present an assurance framework and tool that can enable a practical and transparent method for widening the scope of fairness considerations across the AI lifecycle and move the discussion beyond mere statistical notions of fairness to consider a richer analysis in a practical and context-dependent manner. To illustrate this approach, we first describe and then apply the framework of Trustworthy and Ethical Assurance (TEA) to an AI-enabled clinical diagnostic support system (CDSS) whose purpose is to help clinicians predict the risk of developing hypertension in patients with Type 2 diabetes, a context in which several fairness considerations arise (e.g., discrimination against patient subgroups). This is supplemented by an open-source tool and a fairness considerations map to help facilitate reasoning about the fairness of AI-enabled systems in a participatory way. In short, by using a shared framework for identifying, documenting and justifying fairness considerations, and then using this deliberative exercise to structure an assurance case, research on AI fairness becomes reusable and generalizable for others in the ethical AI community and for sharing best practices for achieving fairness and equity in digital health and healthcare in particular.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2406.09029
- https://arxiv.org/pdf/2406.09029
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4399695558
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4399695558Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2406.09029Digital Object Identifier
- Title
-
Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycleWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-06-13Full publication date if available
- Authors
-
Marten H. L. Kaas, C. Burr, Zoë Porter, Berk Ozturk, Philippa Ryan, Michael Katell, Nuala Polo, Kalle Westerling, Ibrahim HabliList of authors in order
- Landing page
-
https://arxiv.org/abs/2406.09029Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2406.09029Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2406.09029Direct OA link when available
- Concepts
-
Sociotechnical system, Process management, Business, Computer science, Systems engineering, Risk analysis (engineering), Knowledge management, EngineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4399695558 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2406.09029 |
| ids.doi | https://doi.org/10.48550/arxiv.2406.09029 |
| ids.openalex | https://openalex.org/W4399695558 |
| fwci | |
| type | preprint |
| title | Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10883 |
| topics[0].field.id | https://openalex.org/fields/33 |
| topics[0].field.display_name | Social Sciences |
| topics[0].score | 0.9350000023841858 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3311 |
| topics[0].subfield.display_name | Safety Research |
| topics[0].display_name | Ethics and Social Impacts of AI |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C127627568 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9572575688362122 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1639361 |
| concepts[0].display_name | Sociotechnical system |
| concepts[1].id | https://openalex.org/C195094911 |
| concepts[1].level | 1 |
| concepts[1].score | 0.5437546372413635 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q14167904 |
| concepts[1].display_name | Process management |
| concepts[2].id | https://openalex.org/C144133560 |
| concepts[2].level | 0 |
| concepts[2].score | 0.4744204878807068 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[2].display_name | Business |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.40975627303123474 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C201995342 |
| concepts[4].level | 1 |
| concepts[4].score | 0.37678414583206177 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q682496 |
| concepts[4].display_name | Systems engineering |
| concepts[5].id | https://openalex.org/C112930515 |
| concepts[5].level | 1 |
| concepts[5].score | 0.3697963356971741 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q4389547 |
| concepts[5].display_name | Risk analysis (engineering) |
| concepts[6].id | https://openalex.org/C56739046 |
| concepts[6].level | 1 |
| concepts[6].score | 0.3670249879360199 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q192060 |
| concepts[6].display_name | Knowledge management |
| concepts[7].id | https://openalex.org/C127413603 |
| concepts[7].level | 0 |
| concepts[7].score | 0.26339566707611084 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[7].display_name | Engineering |
| keywords[0].id | https://openalex.org/keywords/sociotechnical-system |
| keywords[0].score | 0.9572575688362122 |
| keywords[0].display_name | Sociotechnical system |
| keywords[1].id | https://openalex.org/keywords/process-management |
| keywords[1].score | 0.5437546372413635 |
| keywords[1].display_name | Process management |
| keywords[2].id | https://openalex.org/keywords/business |
| keywords[2].score | 0.4744204878807068 |
| keywords[2].display_name | Business |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.40975627303123474 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/systems-engineering |
| keywords[4].score | 0.37678414583206177 |
| keywords[4].display_name | Systems engineering |
| keywords[5].id | https://openalex.org/keywords/risk-analysis |
| keywords[5].score | 0.3697963356971741 |
| keywords[5].display_name | Risk analysis (engineering) |
| keywords[6].id | https://openalex.org/keywords/knowledge-management |
| keywords[6].score | 0.3670249879360199 |
| keywords[6].display_name | Knowledge management |
| keywords[7].id | https://openalex.org/keywords/engineering |
| keywords[7].score | 0.26339566707611084 |
| keywords[7].display_name | Engineering |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2406.09029 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2406.09029 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2406.09029 |
| locations[1].id | doi:10.48550/arxiv.2406.09029 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2406.09029 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5055682206 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-0963-1004 |
| authorships[0].author.display_name | Marten H. L. Kaas |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Kaas, Marten H. L. |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5101831032 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-5155-1094 |
| authorships[1].author.display_name | C. Burr |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Burr, Christopher |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5069917281 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-4467-3288 |
| authorships[2].author.display_name | Zoë Porter |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Porter, Zoe |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5101797674 |
| authorships[3].author.orcid | https://orcid.org/0009-0006-2651-0924 |
| authorships[3].author.display_name | Berk Ozturk |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Ozturk, Berk |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5032899738 |
| authorships[4].author.orcid | https://orcid.org/0000-0003-0926-6449 |
| authorships[4].author.display_name | Philippa Ryan |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Ryan, Philippa |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5033545165 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-2200-6246 |
| authorships[5].author.display_name | Michael Katell |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Katell, Michael |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5099137335 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Nuala Polo |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Polo, Nuala |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5099137336 |
| authorships[7].author.orcid | |
| authorships[7].author.display_name | Kalle Westerling |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Westerling, Kalle |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5017840476 |
| authorships[8].author.orcid | https://orcid.org/0000-0003-2736-8238 |
| authorships[8].author.display_name | Ibrahim Habli |
| authorships[8].author_position | last |
| authorships[8].raw_author_name | Habli, Ibrahim |
| authorships[8].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2406.09029 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10883 |
| primary_topic.field.id | https://openalex.org/fields/33 |
| primary_topic.field.display_name | Social Sciences |
| primary_topic.score | 0.9350000023841858 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3311 |
| primary_topic.subfield.display_name | Safety Research |
| primary_topic.display_name | Ethics and Social Impacts of AI |
| related_works | https://openalex.org/W1980714815, https://openalex.org/W3133630643, https://openalex.org/W608490485, https://openalex.org/W2481729736, https://openalex.org/W4389636114, https://openalex.org/W2236208621, https://openalex.org/W2967475239, https://openalex.org/W4308919250, https://openalex.org/W3203106571, https://openalex.org/W2545074387 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2406.09029 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2406.09029 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2406.09029 |
| primary_location.id | pmh:oai:arXiv.org:2406.09029 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2406.09029 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2406.09029 |
| publication_date | 2024-06-13 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.2 | 166 |
| abstract_inverted_index.a | 87, 115, 119, 168, 189, 204, 211 |
| abstract_inverted_index.AI | 12, 27, 72, 101, 234, 245 |
| abstract_inverted_index.In | 207 |
| abstract_inverted_index.To | 124 |
| abstract_inverted_index.an | 79, 143, 185, 229 |
| abstract_inverted_index.by | 23, 184, 209 |
| abstract_inverted_index.do | 58 |
| abstract_inverted_index.in | 10, 41, 43, 118, 162, 170, 203, 242, 257, 262 |
| abstract_inverted_index.is | 1, 21, 76, 152, 182 |
| abstract_inverted_index.of | 3, 17, 36, 54, 96, 111, 136, 159, 200 |
| abstract_inverted_index.on | 51, 233 |
| abstract_inverted_index.to | 32, 63, 77, 113, 142, 153, 193, 227 |
| abstract_inverted_index.we | 128 |
| abstract_inverted_index.But | 29 |
| abstract_inverted_index.Our | 74 |
| abstract_inverted_index.and | 14, 25, 56, 65, 82, 89, 103, 121, 131, 138, 188, 217, 221, 238, 247, 255, 260 |
| abstract_inverted_index.are | 39 |
| abstract_inverted_index.can | 85 |
| abstract_inverted_index.for | 92, 214, 240, 248, 252 |
| abstract_inverted_index.map | 192 |
| abstract_inverted_index.new | 24 |
| abstract_inverted_index.not | 59 |
| abstract_inverted_index.one | 2 |
| abstract_inverted_index.the | 4, 15, 34, 61, 70, 94, 100, 105, 134, 157, 198, 243 |
| abstract_inverted_index.two | 44 |
| abstract_inverted_index.This | 181 |
| abstract_inverted_index.Type | 165 |
| abstract_inverted_index.best | 250 |
| abstract_inverted_index.fair | 18 |
| abstract_inverted_index.help | 154, 194 |
| abstract_inverted_index.mere | 108 |
| abstract_inverted_index.most | 5, 30 |
| abstract_inverted_index.move | 104 |
| abstract_inverted_index.need | 62 |
| abstract_inverted_index.risk | 158 |
| abstract_inverted_index.that | 84 |
| abstract_inverted_index.then | 132, 222 |
| abstract_inverted_index.they | 57 |
| abstract_inverted_index.this | 126, 224 |
| abstract_inverted_index.tool | 83, 187 |
| abstract_inverted_index.way. | 206 |
| abstract_inverted_index.with | 164 |
| abstract_inverted_index.(TEA) | 141 |
| abstract_inverted_index.about | 197 |
| abstract_inverted_index.apply | 133 |
| abstract_inverted_index.arise | 175 |
| abstract_inverted_index.case, | 231 |
| abstract_inverted_index.first | 129 |
| abstract_inverted_index.scope | 42, 95 |
| abstract_inverted_index.their | 47 |
| abstract_inverted_index.using | 210, 223 |
| abstract_inverted_index.ways: | 46 |
| abstract_inverted_index.which | 171 |
| abstract_inverted_index.whole | 71 |
| abstract_inverted_index.whose | 150 |
| abstract_inverted_index.(CDSS) | 149 |
| abstract_inverted_index.(e.g., | 176 |
| abstract_inverted_index.across | 69, 99 |
| abstract_inverted_index.beyond | 107 |
| abstract_inverted_index.enable | 86 |
| abstract_inverted_index.equity | 256 |
| abstract_inverted_index.health | 259 |
| abstract_inverted_index.method | 91 |
| abstract_inverted_index.others | 241 |
| abstract_inverted_index.richer | 116 |
| abstract_inverted_index.shared | 212 |
| abstract_inverted_index.short, | 208 |
| abstract_inverted_index.system | 148 |
| abstract_inverted_index.Ethical | 139 |
| abstract_inverted_index.address | 66 |
| abstract_inverted_index.against | 178 |
| abstract_inverted_index.becomes | 236 |
| abstract_inverted_index.content | 49 |
| abstract_inverted_index.context | 169 |
| abstract_inverted_index.digital | 258 |
| abstract_inverted_index.ethical | 8, 244 |
| abstract_inverted_index.focuses | 50 |
| abstract_inverted_index.limited | 40 |
| abstract_inverted_index.manner. | 123 |
| abstract_inverted_index.notions | 110 |
| abstract_inverted_index.patient | 179 |
| abstract_inverted_index.predict | 156 |
| abstract_inverted_index.present | 78 |
| abstract_inverted_index.purpose | 151 |
| abstract_inverted_index.several | 172 |
| abstract_inverted_index.sharing | 249 |
| abstract_inverted_index.support | 147 |
| abstract_inverted_index.systems | 20, 38, 202 |
| abstract_inverted_index.Fairness | 0 |
| abstract_inverted_index.analysis | 117 |
| abstract_inverted_index.clinical | 145 |
| abstract_inverted_index.commonly | 6 |
| abstract_inverted_index.consider | 114 |
| abstract_inverted_index.describe | 130 |
| abstract_inverted_index.emerging | 26 |
| abstract_inverted_index.exercise | 226 |
| abstract_inverted_index.existing | 11 |
| abstract_inverted_index.fairness | 35, 67, 97, 112, 173, 190, 199, 219, 235, 254 |
| abstract_inverted_index.identify | 64 |
| abstract_inverted_index.measures | 53 |
| abstract_inverted_index.patients | 163 |
| abstract_inverted_index.required | 22 |
| abstract_inverted_index.research | 232 |
| abstract_inverted_index.reusable | 237 |
| abstract_inverted_index.widening | 93 |
| abstract_inverted_index.Assurance | 140 |
| abstract_inverted_index.achieving | 253 |
| abstract_inverted_index.approach, | 127 |
| abstract_inverted_index.assurance | 80, 230 |
| abstract_inverted_index.community | 246 |
| abstract_inverted_index.diabetes, | 167 |
| abstract_inverted_index.emphasize | 60 |
| abstract_inverted_index.fairness, | 55 |
| abstract_inverted_index.framework | 81, 135, 213 |
| abstract_inverted_index.lifecycle | 102 |
| abstract_inverted_index.practical | 88, 120 |
| abstract_inverted_index.practices | 251 |
| abstract_inverted_index.reasoning | 196 |
| abstract_inverted_index.structure | 228 |
| abstract_inverted_index.AI-enabled | 19, 37, 144, 201 |
| abstract_inverted_index.addressing | 33 |
| abstract_inverted_index.approaches | 31 |
| abstract_inverted_index.clinicians | 155 |
| abstract_inverted_index.developing | 160 |
| abstract_inverted_index.diagnostic | 146 |
| abstract_inverted_index.discussion | 106 |
| abstract_inverted_index.facilitate | 195 |
| abstract_inverted_index.healthcare | 261 |
| abstract_inverted_index.identified | 7 |
| abstract_inverted_index.illustrate | 125 |
| abstract_inverted_index.justifying | 218 |
| abstract_inverted_index.lifecycle. | 73 |
| abstract_inverted_index.principles | 9 |
| abstract_inverted_index.Trustworthy | 137 |
| abstract_inverted_index.development | 16 |
| abstract_inverted_index.documenting | 216 |
| abstract_inverted_index.guidelines, | 13 |
| abstract_inverted_index.open-source | 186 |
| abstract_inverted_index.particular. | 263 |
| abstract_inverted_index.regulation. | 28 |
| abstract_inverted_index.significant | 45 |
| abstract_inverted_index.statistical | 52, 109 |
| abstract_inverted_index.subgroups). | 180 |
| abstract_inverted_index.substantive | 48 |
| abstract_inverted_index.transparent | 90 |
| abstract_inverted_index.contribution | 75 |
| abstract_inverted_index.deliberative | 225 |
| abstract_inverted_index.hypertension | 161 |
| abstract_inverted_index.identifying, | 215 |
| abstract_inverted_index.supplemented | 183 |
| abstract_inverted_index.generalizable | 239 |
| abstract_inverted_index.participatory | 205 |
| abstract_inverted_index.considerations | 68, 98, 174, 191 |
| abstract_inverted_index.discrimination | 177 |
| abstract_inverted_index.considerations, | 220 |
| abstract_inverted_index.context-dependent | 122 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 9 |
| citation_normalized_percentile |