Combined P-value Functions for Compatible Effect Estimation and Hypothesis Testing in Drug Regulation Article Swipe

PDF

Samuel Pawel , Małgorzata Roos , Leonhard Held ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2503.10246

The two-trials rule in drug regulation requires statistically significant results from two pivotal trials to demonstrate efficacy. However, it is unclear how the effect estimates from both trials should be combined to quantify the drug effect. Fixed-effect meta-analysis is commonly used but may yield confidence intervals that exclude the value of no effect even when the two-trials rule is not fulfilled. We systematically address this by recasting the two-trials rule and meta-analysis in a unified framework of combined p-value functions, where they are variants of Wilkinson's and Stouffer's combination methods, respectively. This allows us to obtain compatible combined p-values, effect estimates, and confidence intervals, which we derive in closed-form. Additionally, we provide new results for Edgington's, Fisher's, Pearson's, and Tippett's p-value combination methods. When both trials have the same true effect, all methods can consistently estimate it, although some show bias. When true effects differ, the two-trials rule and Pearson's method are conservative (converging to the less extreme effect), Fisher's and Tippett's methods are anti-conservative (converging to the more extreme effect), and Edgington's method and meta-analysis are balanced (converging to a weighted average). Notably, Edgington's confidence intervals asymptotically always include individual trial effects, while meta-analytic confidence intervals shrink to a point at the weighted average effect. We conclude that all of these methods may be appropriate depending on the estimand of interest. We implement combined p-value function inference for two trials in the R package twotrials, allowing researchers to easily perform compatible hypothesis testing and parameter estimation.

Related Topics

Combined Statistical Area

Trigonometric Functions

Combined Charging System

Combined Oral Contraceptive Pill

Washington–Baltimore Combined Statistical Area

Combined Counties Football League

Severe Combined Immunodeficiency

Combined Cycle Power Plant

Combined Dna Index System

Combined Community Codec Pack

Differentiation Of Trigonometric Functions

Loss Functions For Classification

Concepts

No concepts available.

Metadata

Type: preprint
Language: en
Landing Page: http://arxiv.org/abs/2503.10246
PDF: https://arxiv.org/pdf/2503.10246
OA Status: green
OpenAlex ID: https://openalex.org/W4416039089

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4416039089

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2503.10246

Digital Object Identifier
Title: Combined P-value Functions for Compatible Effect Estimation and Hypothesis Testing in Drug Regulation

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-03-13

Full publication date if available
Authors: Samuel Pawel, Małgorzata Roos, Leonhard Held

List of authors in order
Landing page: https://arxiv.org/abs/2503.10246

Publisher landing page
PDF URL: https://arxiv.org/pdf/2503.10246

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2503.10246

Direct OA link when available
Cited by: 0

Total citation count in OpenAlex

Full payload

id	https://openalex.org/W4416039089
doi	https://doi.org/10.48550/arxiv.2503.10246
ids.doi	https://doi.org/10.48550/arxiv.2503.10246
ids.openalex	https://openalex.org/W4416039089
fwci
type	preprint
title	Combined P-value Functions for Compatible Effect Estimation and Hypothesis Testing in Drug Regulation
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
is_xpac	False
apc_list
apc_paid
language	en
locations[0].id	pmh:oai:arXiv.org:2503.10246
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2503.10246
locations[0].version	submittedVersion
locations[0].raw_type	text
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2503.10246
locations[1].id	doi:10.48550/arxiv.2503.10246
locations[1].is_oa	True
locations[1].source.id	https://openalex.org/S4306400194
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	True
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	arXiv (Cornell University)
locations[1].source.host_organization	https://openalex.org/I205783295
locations[1].source.host_organization_name	Cornell University
locations[1].source.host_organization_lineage	https://openalex.org/I205783295
locations[1].license	cc-by
locations[1].pdf_url
locations[1].version
locations[1].raw_type	article
locations[1].license_id	https://openalex.org/licenses/cc-by
locations[1].is_accepted	False
locations[1].is_published
locations[1].raw_source_name
locations[1].landing_page_url	https://doi.org/10.48550/arxiv.2503.10246
indexed_in	arxiv, datacite
authorships[0].author.id	https://openalex.org/A5038190384
authorships[0].author.orcid	https://orcid.org/0000-0003-2779-320X
authorships[0].author.display_name	Samuel Pawel
authorships[0].author_position	first
authorships[0].raw_author_name	Pawel, Samuel
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5009807080
authorships[1].author.orcid	https://orcid.org/0000-0001-9878-6969
authorships[1].author.display_name	Małgorzata Roos
authorships[1].author_position	middle
authorships[1].raw_author_name	Roos, Małgorzata
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5078043213
authorships[2].author.orcid	https://orcid.org/0000-0002-8686-5325
authorships[2].author.display_name	Leonhard Held
authorships[2].author_position	last
authorships[2].raw_author_name	Held, Leonhard
authorships[2].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2503.10246
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Combined P-value Functions for Compatible Effect Estimation and Hypothesis Testing in Drug Regulation
has_fulltext	False
is_retracted	False
updated_date	2025-11-09T23:09:16.995542
primary_topic
cited_by_count	0
locations_count	2
best_oa_location.id	pmh:oai:arXiv.org:2503.10246
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2503.10246
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2503.10246
primary_location.id	pmh:oai:arXiv.org:2503.10246
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2503.10246
primary_location.version	submittedVersion
primary_location.raw_type	text
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2503.10246
publication_date	2025-03-13
publication_year	2025
referenced_works_count	0
abstract_inverted_index.R	233
abstract_inverted_index.a	73, 180, 199
abstract_inverted_index.We	61, 206, 222
abstract_inverted_index.at	201
abstract_inverted_index.be	29, 214
abstract_inverted_index.by	65
abstract_inverted_index.in	3, 72, 107, 231
abstract_inverted_index.is	19, 38, 58
abstract_inverted_index.it	18
abstract_inverted_index.no	51
abstract_inverted_index.of	50, 76, 84, 210, 220
abstract_inverted_index.on	217
abstract_inverted_index.to	14, 31, 94, 154, 166, 179, 198, 238
abstract_inverted_index.us	93
abstract_inverted_index.we	105, 110
abstract_inverted_index.The	0
abstract_inverted_index.all	131, 209
abstract_inverted_index.and	70, 86, 101, 118, 148, 160, 171, 174, 244
abstract_inverted_index.are	82, 151, 163, 176
abstract_inverted_index.but	41
abstract_inverted_index.can	133
abstract_inverted_index.for	114, 228
abstract_inverted_index.how	21
abstract_inverted_index.it,	136
abstract_inverted_index.may	42, 213
abstract_inverted_index.new	112
abstract_inverted_index.not	59
abstract_inverted_index.the	22, 33, 48, 55, 67, 127, 145, 155, 167, 202, 218, 232
abstract_inverted_index.two	11, 229
abstract_inverted_index.This	91
abstract_inverted_index.When	123, 141
abstract_inverted_index.both	26, 124
abstract_inverted_index.drug	4, 34
abstract_inverted_index.even	53
abstract_inverted_index.from	10, 25
abstract_inverted_index.have	126
abstract_inverted_index.less	156
abstract_inverted_index.more	168
abstract_inverted_index.rule	2, 57, 69, 147
abstract_inverted_index.same	128
abstract_inverted_index.show	139
abstract_inverted_index.some	138
abstract_inverted_index.that	46, 208
abstract_inverted_index.they	81
abstract_inverted_index.this	64
abstract_inverted_index.true	129, 142
abstract_inverted_index.used	40
abstract_inverted_index.when	54
abstract_inverted_index.bias.	140
abstract_inverted_index.point	200
abstract_inverted_index.these	211
abstract_inverted_index.trial	191
abstract_inverted_index.value	49
abstract_inverted_index.where	80
abstract_inverted_index.which	104
abstract_inverted_index.while	193
abstract_inverted_index.yield	43
abstract_inverted_index.allows	92
abstract_inverted_index.always	188
abstract_inverted_index.derive	106
abstract_inverted_index.easily	239
abstract_inverted_index.effect	23, 52, 99
abstract_inverted_index.method	150, 173
abstract_inverted_index.obtain	95
abstract_inverted_index.should	28
abstract_inverted_index.shrink	197
abstract_inverted_index.trials	13, 27, 125, 230
abstract_inverted_index.address	63
abstract_inverted_index.average	204
abstract_inverted_index.differ,	144
abstract_inverted_index.effect,	130
abstract_inverted_index.effect.	35, 205
abstract_inverted_index.effects	143
abstract_inverted_index.exclude	47
abstract_inverted_index.extreme	157, 169
abstract_inverted_index.include	189
abstract_inverted_index.methods	132, 162, 212
abstract_inverted_index.p-value	78, 120, 225
abstract_inverted_index.package	234
abstract_inverted_index.perform	240
abstract_inverted_index.pivotal	12
abstract_inverted_index.provide	111
abstract_inverted_index.results	9, 113
abstract_inverted_index.testing	243
abstract_inverted_index.unclear	20
abstract_inverted_index.unified	74
abstract_inverted_index.Fisher's	159
abstract_inverted_index.However,	17
abstract_inverted_index.Notably,	183
abstract_inverted_index.allowing	236
abstract_inverted_index.although	137
abstract_inverted_index.balanced	177
abstract_inverted_index.combined	30, 77, 97, 224
abstract_inverted_index.commonly	39
abstract_inverted_index.conclude	207
abstract_inverted_index.effect),	158, 170
abstract_inverted_index.effects,	192
abstract_inverted_index.estimand	219
abstract_inverted_index.estimate	135
abstract_inverted_index.function	226
abstract_inverted_index.methods,	89
abstract_inverted_index.methods.	122
abstract_inverted_index.quantify	32
abstract_inverted_index.requires	6
abstract_inverted_index.variants	83
abstract_inverted_index.weighted	181, 203
abstract_inverted_index.Fisher's,	116
abstract_inverted_index.Pearson's	149
abstract_inverted_index.Tippett's	119, 161
abstract_inverted_index.average).	182
abstract_inverted_index.depending	216
abstract_inverted_index.efficacy.	16
abstract_inverted_index.estimates	24
abstract_inverted_index.framework	75
abstract_inverted_index.implement	223
abstract_inverted_index.inference	227
abstract_inverted_index.interest.	221
abstract_inverted_index.intervals	45, 186, 196
abstract_inverted_index.p-values,	98
abstract_inverted_index.parameter	245
abstract_inverted_index.recasting	66
abstract_inverted_index.Pearson's,	117
abstract_inverted_index.Stouffer's	87
abstract_inverted_index.compatible	96, 241
abstract_inverted_index.confidence	44, 102, 185, 195
abstract_inverted_index.estimates,	100
abstract_inverted_index.fulfilled.	60
abstract_inverted_index.functions,	79
abstract_inverted_index.hypothesis	242
abstract_inverted_index.individual	190
abstract_inverted_index.intervals,	103
abstract_inverted_index.regulation	5
abstract_inverted_index.two-trials	1, 56, 68, 146
abstract_inverted_index.twotrials,	235
abstract_inverted_index.(converging	153, 165, 178
abstract_inverted_index.Edgington's	172, 184
abstract_inverted_index.Wilkinson's	85
abstract_inverted_index.appropriate	215
abstract_inverted_index.combination	88, 121
abstract_inverted_index.demonstrate	15
abstract_inverted_index.estimation.	246
abstract_inverted_index.researchers	237
abstract_inverted_index.significant	8
abstract_inverted_index.Edgington's,	115
abstract_inverted_index.Fixed-effect	36
abstract_inverted_index.closed-form.	108
abstract_inverted_index.conservative	152
abstract_inverted_index.consistently	134
abstract_inverted_index.Additionally,	109
abstract_inverted_index.meta-analysis	37, 71, 175
abstract_inverted_index.meta-analytic	194
abstract_inverted_index.respectively.	90
abstract_inverted_index.statistically	7
abstract_inverted_index.asymptotically	187
abstract_inverted_index.systematically	62
abstract_inverted_index.anti-conservative	164
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	3
citation_normalized_percentile