Differential Privacy for Black-Box Statistical Analyses Article Swipe

PDF

YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.56553/popets-2023-0089

We formalize a notion of a privacy wrapper, defined as an algorithm that can take an arbitrary and untrusted script and produce an output with differential privacy guarantees. Our novel privacy wrapper, named TAHOE, incorporates two design ideas: a type of stability under subsetting, and randomization over subset size. We show that TAHOE imposes differential privacy for every possible script. When the data alphabet is finite and small enough, TAHOE can be practically run on a single computer. Performance simulations show that TAHOE has greater accuracy than a benchmark algorithm based on a subsample-and-aggregate approach for certain scenarios and parameter values.

Related Topics

Computer Science

Benchmark (Surveying)

Differential (Mechanical Device)

Algorithm

Data Mining

Theoretical Computer Science

Artificial Intelligence

Aerospace Engineering

Materials Science

Concepts

Differential privacy Computer science Benchmark (surveying) Black box Stability (learning theory) Differential (mechanical device) Alphabet Aggregate (composite) Algorithm Data mining Theoretical computer science Artificial intelligence Machine learning Geography Composite material Engineering Philosophy Linguistics Geodesy Aerospace engineering Materials science

Metadata

Type: article
Language: en
Landing Page: https://doi.org/10.56553/popets-2023-0089
PDF: https://petsymposium.org/popets/2023/popets-2023-0089.pdf
OA Status: hybrid
Cited By: 4
References: 23
Related Works: 10
OpenAlex ID: https://openalex.org/W4376626901

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4376626901

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.56553/popets-2023-0089

Digital Object Identifier
Title: Differential Privacy for Black-Box Statistical Analyses

Work title
Type: article

OpenAlex work type
Language: en

Primary language
Publication year: 2023

Year of publication
Publication date: 2023-05-15

Full publication date if available
Authors: Nitin Kohli, Paul Laskowski

List of authors in order
Landing page: https://doi.org/10.56553/popets-2023-0089

Publisher landing page
PDF URL: https://petsymposium.org/popets/2023/popets-2023-0089.pdf

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: hybrid

Open access status per OpenAlex
OA URL: https://petsymposium.org/popets/2023/popets-2023-0089.pdf

Direct OA link when available
Concepts: Differential privacy, Computer science, Benchmark (surveying), Black box, Stability (learning theory), Differential (mechanical device), Alphabet, Aggregate (composite), Algorithm, Data mining, Theoretical computer science, Artificial intelligence, Machine learning, Geography, Composite material, Engineering, Philosophy, Linguistics, Geodesy, Aerospace engineering, Materials science

Top concepts (fields/topics) attached by OpenAlex
Cited by: 4

Total citation count in OpenAlex
Citations by year (recent): 2025: 3, 2024: 1

Per-year citation counts (last 5 years)
References (count): 23

Number of works referenced by this work
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4376626901
doi	https://doi.org/10.56553/popets-2023-0089
ids.doi	https://doi.org/10.56553/popets-2023-0089
ids.openalex	https://openalex.org/W4376626901
fwci	1.02177155
type	article
title	Differential Privacy for Black-Box Statistical Analyses
biblio.issue	3
biblio.volume	2023
biblio.last_page	431
biblio.first_page	418
topics[0].id	https://openalex.org/T10764
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9997000098228455
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Privacy-Preserving Technologies in Data
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C23130292
concepts[0].level	2
concepts[0].score	0.935272216796875
concepts[0].wikidata	https://www.wikidata.org/wiki/Q5275358
concepts[0].display_name	Differential privacy
concepts[1].id	https://openalex.org/C41008148
concepts[1].level	0
concepts[1].score	0.7356156706809998
concepts[1].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[1].display_name	Computer science
concepts[2].id	https://openalex.org/C185798385
concepts[2].level	2
concepts[2].score	0.6825166940689087
concepts[2].wikidata	https://www.wikidata.org/wiki/Q1161707
concepts[2].display_name	Benchmark (surveying)
concepts[3].id	https://openalex.org/C94966114
concepts[3].level	2
concepts[3].score	0.6448200941085815
concepts[3].wikidata	https://www.wikidata.org/wiki/Q29256
concepts[3].display_name	Black box
concepts[4].id	https://openalex.org/C112972136
concepts[4].level	2
concepts[4].score	0.6049453616142273
concepts[4].wikidata	https://www.wikidata.org/wiki/Q7595718
concepts[4].display_name	Stability (learning theory)
concepts[5].id	https://openalex.org/C93226319
concepts[5].level	2
concepts[5].score	0.5310317277908325
concepts[5].wikidata	https://www.wikidata.org/wiki/Q193137
concepts[5].display_name	Differential (mechanical device)
concepts[6].id	https://openalex.org/C112876837
concepts[6].level	2
concepts[6].score	0.5138042569160461
concepts[6].wikidata	https://www.wikidata.org/wiki/Q837518
concepts[6].display_name	Alphabet
concepts[7].id	https://openalex.org/C4679612
concepts[7].level	2
concepts[7].score	0.5063692331314087
concepts[7].wikidata	https://www.wikidata.org/wiki/Q866298
concepts[7].display_name	Aggregate (composite)
concepts[8].id	https://openalex.org/C11413529
concepts[8].level	1
concepts[8].score	0.49283528327941895
concepts[8].wikidata	https://www.wikidata.org/wiki/Q8366
concepts[8].display_name	Algorithm
concepts[9].id	https://openalex.org/C124101348
concepts[9].level	1
concepts[9].score	0.39074575901031494
concepts[9].wikidata	https://www.wikidata.org/wiki/Q172491
concepts[9].display_name	Data mining
concepts[10].id	https://openalex.org/C80444323
concepts[10].level	1
concepts[10].score	0.36803919076919556
concepts[10].wikidata	https://www.wikidata.org/wiki/Q2878974
concepts[10].display_name	Theoretical computer science
concepts[11].id	https://openalex.org/C154945302
concepts[11].level	1
concepts[11].score	0.1659546196460724
concepts[11].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[11].display_name	Artificial intelligence
concepts[12].id	https://openalex.org/C119857082
concepts[12].level	1
concepts[12].score	0.1415541172027588
concepts[12].wikidata	https://www.wikidata.org/wiki/Q2539
concepts[12].display_name	Machine learning
concepts[13].id	https://openalex.org/C205649164
concepts[13].level	0
concepts[13].score	0.0
concepts[13].wikidata	https://www.wikidata.org/wiki/Q1071
concepts[13].display_name	Geography
concepts[14].id	https://openalex.org/C159985019
concepts[14].level	1
concepts[14].score	0.0
concepts[14].wikidata	https://www.wikidata.org/wiki/Q181790
concepts[14].display_name	Composite material
concepts[15].id	https://openalex.org/C127413603
concepts[15].level	0
concepts[15].score	0.0
concepts[15].wikidata	https://www.wikidata.org/wiki/Q11023
concepts[15].display_name	Engineering
concepts[16].id	https://openalex.org/C138885662
concepts[16].level	0
concepts[16].score	0.0
concepts[16].wikidata	https://www.wikidata.org/wiki/Q5891
concepts[16].display_name	Philosophy
concepts[17].id	https://openalex.org/C41895202
concepts[17].level	1
concepts[17].score	0.0
concepts[17].wikidata	https://www.wikidata.org/wiki/Q8162
concepts[17].display_name	Linguistics
concepts[18].id	https://openalex.org/C13280743
concepts[18].level	1
concepts[18].score	0.0
concepts[18].wikidata	https://www.wikidata.org/wiki/Q131089
concepts[18].display_name	Geodesy
concepts[19].id	https://openalex.org/C146978453
concepts[19].level	1
concepts[19].score	0.0
concepts[19].wikidata	https://www.wikidata.org/wiki/Q3798668
concepts[19].display_name	Aerospace engineering
concepts[20].id	https://openalex.org/C192562407
concepts[20].level	0
concepts[20].score	0.0
concepts[20].wikidata	https://www.wikidata.org/wiki/Q228736
concepts[20].display_name	Materials science
keywords[0].id	https://openalex.org/keywords/differential-privacy
keywords[0].score	0.935272216796875
keywords[0].display_name	Differential privacy
keywords[1].id	https://openalex.org/keywords/computer-science
keywords[1].score	0.7356156706809998
keywords[1].display_name	Computer science
keywords[2].id	https://openalex.org/keywords/benchmark
keywords[2].score	0.6825166940689087
keywords[2].display_name	Benchmark (surveying)
keywords[3].id	https://openalex.org/keywords/black-box
keywords[3].score	0.6448200941085815
keywords[3].display_name	Black box
keywords[4].id	https://openalex.org/keywords/stability
keywords[4].score	0.6049453616142273
keywords[4].display_name	Stability (learning theory)
keywords[5].id	https://openalex.org/keywords/differential
keywords[5].score	0.5310317277908325
keywords[5].display_name	Differential (mechanical device)
keywords[6].id	https://openalex.org/keywords/alphabet
keywords[6].score	0.5138042569160461
keywords[6].display_name	Alphabet
keywords[7].id	https://openalex.org/keywords/aggregate
keywords[7].score	0.5063692331314087
keywords[7].display_name	Aggregate (composite)
keywords[8].id	https://openalex.org/keywords/algorithm
keywords[8].score	0.49283528327941895
keywords[8].display_name	Algorithm
keywords[9].id	https://openalex.org/keywords/data-mining
keywords[9].score	0.39074575901031494
keywords[9].display_name	Data mining
keywords[10].id	https://openalex.org/keywords/theoretical-computer-science
keywords[10].score	0.36803919076919556
keywords[10].display_name	Theoretical computer science
keywords[11].id	https://openalex.org/keywords/artificial-intelligence
keywords[11].score	0.1659546196460724
keywords[11].display_name	Artificial intelligence
keywords[12].id	https://openalex.org/keywords/machine-learning
keywords[12].score	0.1415541172027588
keywords[12].display_name	Machine learning
language	en
locations[0].id	doi:10.56553/popets-2023-0089
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4210183172
locations[0].source.issn	2299-0984
locations[0].source.type	journal
locations[0].source.is_oa	False
locations[0].source.issn_l	2299-0984
locations[0].source.is_core	True
locations[0].source.is_in_doaj	False
locations[0].source.display_name	Proceedings on Privacy Enhancing Technologies
locations[0].source.host_organization	https://openalex.org/P4310320322
locations[0].source.host_organization_name	De Gruyter Open
locations[0].source.host_organization_lineage	https://openalex.org/P4310320322, https://openalex.org/P4310313990
locations[0].source.host_organization_lineage_names	De Gruyter Open, De Gruyter
locations[0].license	cc-by
locations[0].pdf_url	https://petsymposium.org/popets/2023/popets-2023-0089.pdf
locations[0].version	publishedVersion
locations[0].raw_type	journal-article
locations[0].license_id	https://openalex.org/licenses/cc-by
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	Proceedings on Privacy Enhancing Technologies
locations[0].landing_page_url	https://doi.org/10.56553/popets-2023-0089
indexed_in	crossref
authorships[0].author.id	https://openalex.org/A5038055821
authorships[0].author.orcid
authorships[0].author.display_name	Nitin Kohli
authorships[0].countries	US
authorships[0].affiliations[0].institution_ids	https://openalex.org/I4210135243, https://openalex.org/I95457486
authorships[0].affiliations[0].raw_affiliation_string	UC Berkeley Center for Effective Global Action Berkeley, CA, USA
authorships[0].institutions[0].id	https://openalex.org/I4210135243
authorships[0].institutions[0].ror	https://ror.org/03djjyk45
authorships[0].institutions[0].type	facility
authorships[0].institutions[0].lineage	https://openalex.org/I201448701, https://openalex.org/I4210135243, https://openalex.org/I95457486, https://openalex.org/I97018004
authorships[0].institutions[0].country_code	US
authorships[0].institutions[0].display_name	Center for Effective Global Action
authorships[0].institutions[1].id	https://openalex.org/I95457486
authorships[0].institutions[1].ror	https://ror.org/01an7q238
authorships[0].institutions[1].type	education
authorships[0].institutions[1].lineage	https://openalex.org/I95457486
authorships[0].institutions[1].country_code	US
authorships[0].institutions[1].display_name	University of California, Berkeley
authorships[0].author_position	first
authorships[0].raw_author_name	Nitin Kohli
authorships[0].is_corresponding	True
authorships[0].raw_affiliation_strings	UC Berkeley Center for Effective Global Action Berkeley, CA, USA
authorships[1].author.id	https://openalex.org/A5052389485
authorships[1].author.orcid
authorships[1].author.display_name	Paul Laskowski
authorships[1].countries	US
authorships[1].affiliations[0].institution_ids	https://openalex.org/I134446601, https://openalex.org/I95457486
authorships[1].affiliations[0].raw_affiliation_string	UC Berkeley School of Information Berkeley, CA, USA
authorships[1].institutions[0].id	https://openalex.org/I134446601
authorships[1].institutions[0].ror	https://ror.org/02xewxa75
authorships[1].institutions[0].type	education
authorships[1].institutions[0].lineage	https://openalex.org/I134446601
authorships[1].institutions[0].country_code	US
authorships[1].institutions[0].display_name	Berkeley College
authorships[1].institutions[1].id	https://openalex.org/I95457486
authorships[1].institutions[1].ror	https://ror.org/01an7q238
authorships[1].institutions[1].type	education
authorships[1].institutions[1].lineage	https://openalex.org/I95457486
authorships[1].institutions[1].country_code	US
authorships[1].institutions[1].display_name	University of California, Berkeley
authorships[1].author_position	last
authorships[1].raw_author_name	Paul Laskowski
authorships[1].is_corresponding	False
authorships[1].raw_affiliation_strings	UC Berkeley School of Information Berkeley, CA, USA
has_content.pdf	True
has_content.grobid_xml	True
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://petsymposium.org/popets/2023/popets-2023-0089.pdf
open_access.oa_status	hybrid
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Differential Privacy for Black-Box Statistical Analyses
has_fulltext	True
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T10764
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9997000098228455
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Privacy-Preserving Technologies in Data
related_works	https://openalex.org/W3038283795, https://openalex.org/W2604501336, https://openalex.org/W2734500670, https://openalex.org/W2558166297, https://openalex.org/W2315671126, https://openalex.org/W798507144, https://openalex.org/W2964481303, https://openalex.org/W1751413323, https://openalex.org/W2571704763, https://openalex.org/W3206394311
cited_by_count	4
counts_by_year[0].year	2025
counts_by_year[0].cited_by_count	3
counts_by_year[1].year	2024
counts_by_year[1].cited_by_count	1
locations_count	1
best_oa_location.id	doi:10.56553/popets-2023-0089
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4210183172
best_oa_location.source.issn	2299-0984
best_oa_location.source.type	journal
best_oa_location.source.is_oa	False
best_oa_location.source.issn_l	2299-0984
best_oa_location.source.is_core	True
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	Proceedings on Privacy Enhancing Technologies
best_oa_location.source.host_organization	https://openalex.org/P4310320322
best_oa_location.source.host_organization_name	De Gruyter Open
best_oa_location.source.host_organization_lineage	https://openalex.org/P4310320322, https://openalex.org/P4310313990
best_oa_location.source.host_organization_lineage_names	De Gruyter Open, De Gruyter
best_oa_location.license	cc-by
best_oa_location.pdf_url	https://petsymposium.org/popets/2023/popets-2023-0089.pdf
best_oa_location.version	publishedVersion
best_oa_location.raw_type	journal-article
best_oa_location.license_id	https://openalex.org/licenses/cc-by
best_oa_location.is_accepted	True
best_oa_location.is_published	True
best_oa_location.raw_source_name	Proceedings on Privacy Enhancing Technologies
best_oa_location.landing_page_url	https://doi.org/10.56553/popets-2023-0089
primary_location.id	doi:10.56553/popets-2023-0089
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4210183172
primary_location.source.issn	2299-0984
primary_location.source.type	journal
primary_location.source.is_oa	False
primary_location.source.issn_l	2299-0984
primary_location.source.is_core	True
primary_location.source.is_in_doaj	False
primary_location.source.display_name	Proceedings on Privacy Enhancing Technologies
primary_location.source.host_organization	https://openalex.org/P4310320322
primary_location.source.host_organization_name	De Gruyter Open
primary_location.source.host_organization_lineage	https://openalex.org/P4310320322, https://openalex.org/P4310313990
primary_location.source.host_organization_lineage_names	De Gruyter Open, De Gruyter
primary_location.license	cc-by
primary_location.pdf_url	https://petsymposium.org/popets/2023/popets-2023-0089.pdf
primary_location.version	publishedVersion
primary_location.raw_type	journal-article
primary_location.license_id	https://openalex.org/licenses/cc-by
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	Proceedings on Privacy Enhancing Technologies
primary_location.landing_page_url	https://doi.org/10.56553/popets-2023-0089
publication_date	2023-05-15
publication_year	2023
referenced_works	https://openalex.org/W1578588790, https://openalex.org/W2031415694, https://openalex.org/W2101771965, https://openalex.org/W2079017812, https://openalex.org/W2294904676, https://openalex.org/W3006031742, https://openalex.org/W2138865266, https://openalex.org/W4297799122, https://openalex.org/W2963699739, https://openalex.org/W2047764386, https://openalex.org/W2908109788, https://openalex.org/W3031432927, https://openalex.org/W4285100324, https://openalex.org/W4248861293, https://openalex.org/W3125018083, https://openalex.org/W1873763122, https://openalex.org/W4213049518, https://openalex.org/W2605062226, https://openalex.org/W3030902227, https://openalex.org/W1557833142, https://openalex.org/W2027595342, https://openalex.org/W3001405476, https://openalex.org/W2161906179
referenced_works_count	23
abstract_inverted_index.a	2, 5, 38, 75, 87, 92
abstract_inverted_index.We	0, 49
abstract_inverted_index.an	10, 15, 22
abstract_inverted_index.as	9
abstract_inverted_index.be	71
abstract_inverted_index.is	64
abstract_inverted_index.of	4, 40
abstract_inverted_index.on	74, 91
abstract_inverted_index.Our	28
abstract_inverted_index.and	17, 20, 44, 66, 98
abstract_inverted_index.can	13, 70
abstract_inverted_index.for	56, 95
abstract_inverted_index.has	83
abstract_inverted_index.run	73
abstract_inverted_index.the	61
abstract_inverted_index.two	35
abstract_inverted_index.When	60
abstract_inverted_index.data	62
abstract_inverted_index.over	46
abstract_inverted_index.show	50, 80
abstract_inverted_index.take	14
abstract_inverted_index.than	86
abstract_inverted_index.that	12, 51, 81
abstract_inverted_index.type	39
abstract_inverted_index.with	24
abstract_inverted_index.TAHOE	52, 69, 82
abstract_inverted_index.based	90
abstract_inverted_index.every	57
abstract_inverted_index.named	32
abstract_inverted_index.novel	29
abstract_inverted_index.size.	48
abstract_inverted_index.small	67
abstract_inverted_index.under	42
abstract_inverted_index.TAHOE,	33
abstract_inverted_index.design	36
abstract_inverted_index.finite	65
abstract_inverted_index.ideas:	37
abstract_inverted_index.notion	3
abstract_inverted_index.output	23
abstract_inverted_index.script	19
abstract_inverted_index.single	76
abstract_inverted_index.subset	47
abstract_inverted_index.certain	96
abstract_inverted_index.defined	8
abstract_inverted_index.enough,	68
abstract_inverted_index.greater	84
abstract_inverted_index.imposes	53
abstract_inverted_index.privacy	6, 26, 30, 55
abstract_inverted_index.produce	21
abstract_inverted_index.script.	59
abstract_inverted_index.values.	100
abstract_inverted_index.accuracy	85
abstract_inverted_index.alphabet	63
abstract_inverted_index.approach	94
abstract_inverted_index.possible	58
abstract_inverted_index.wrapper,	7, 31
abstract_inverted_index.algorithm	11, 89
abstract_inverted_index.arbitrary	16
abstract_inverted_index.benchmark	88
abstract_inverted_index.computer.	77
abstract_inverted_index.formalize	1
abstract_inverted_index.parameter	99
abstract_inverted_index.scenarios	97
abstract_inverted_index.stability	41
abstract_inverted_index.untrusted	18
abstract_inverted_index.Performance	78
abstract_inverted_index.guarantees.	27
abstract_inverted_index.practically	72
abstract_inverted_index.simulations	79
abstract_inverted_index.subsetting,	43
abstract_inverted_index.differential	25, 54
abstract_inverted_index.incorporates	34
abstract_inverted_index.randomization	45
abstract_inverted_index.subsample-and-aggregate	93
cited_by_percentile_year.max	97
cited_by_percentile_year.min	90
corresponding_author_ids	https://openalex.org/A5038055821
countries_distinct_count	1
institutions_distinct_count	2
corresponding_institution_ids	https://openalex.org/I4210135243, https://openalex.org/I95457486
sustainable_development_goals[0].id	https://metadata.un.org/sdg/16
sustainable_development_goals[0].score	0.6000000238418579
sustainable_development_goals[0].display_name	Peace, Justice and strong institutions
citation_normalized_percentile.value	0.7698468
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	False