Proof of Principle for a Self-Governing Prediction and Forecasting Reward Algorithm Article Swipe

View

J. O. Gonzalez-Hernandez , Jonathan Marino , T. C. Rogers , Brandon Velasco ·

YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.18564/jasss.5432

We use Monte Carlo techniques to simulate an organized prediction competition between a group of scientific experts acting under the influence of a "self-governing" prediction reward algorithm. Our aim is to illustrate the advantages of a specific type of reward distribution rule that is designed to address some of the limitations of traditional forecast scoring rules. The primary extension of this algorithm as compared with standard forecast scoring is that it incorporates measures of both group consensus and question relevance directly into the reward distribution algorithm. Our model of the prediction competition includes parameters that control both the level of bias from prior beliefs and the influence of the reward incentive. The Monte Carlo simulations demonstrate that, within the simplifying assumptions of the model, experts collectively approach belief in objectively true facts, so long as reward influence is high and the bias stays below a critical threshold. The purpose of this work is to motivate further research into prediction reward algorithms that combine standard forecasting measures with factors like bias and consensus.

Related Topics

Computer Science

Algorithm

Artificial Intelligence

Concepts

Computer science Algorithm Artificial intelligence

Metadata

Type: article
Language: en
Landing Page: http://doi.org/10.18564/jasss.5432
OA Status: gold
Related Works: 10
OpenAlex ID: https://openalex.org/W4403952677

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4403952677

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.18564/jasss.5432

Digital Object Identifier
Title: Proof of Principle for a Self-Governing Prediction and Forecasting Reward Algorithm

Work title
Type: article

OpenAlex work type
Language: en

Primary language
Publication year: 2024

Year of publication
Publication date: 2024-01-01

Full publication date if available
Authors: J. O. Gonzalez-Hernandez, Jonathan Marino, T. C. Rogers, Brandon Velasco

List of authors in order
Landing page: https://doi.org/10.18564/jasss.5432

Publisher landing page
Open access: Yes

Whether a free full text is available
OA status: gold

Open access status per OpenAlex
OA URL: https://doi.org/10.18564/jasss.5432

Direct OA link when available
Concepts: Computer science, Algorithm, Artificial intelligence

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4403952677
doi	https://doi.org/10.18564/jasss.5432
ids.doi	https://doi.org/10.18564/jasss.5432
ids.openalex	https://openalex.org/W4403952677
fwci	0.0
type	article
title	Proof of Principle for a Self-Governing Prediction and Forecasting Reward Algorithm
biblio.issue	4
biblio.volume	27
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T14351
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.3953000009059906
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Statistical and Computational Modeling
is_xpac	False
apc_list.value	1000
apc_list.currency	EUR
apc_list.value_usd	1300
apc_paid.value	1000
apc_paid.currency	EUR
apc_paid.value_usd	1300
concepts[0].id	https://openalex.org/C41008148
concepts[0].level	0
concepts[0].score	0.4694157540798187
concepts[0].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[0].display_name	Computer science
concepts[1].id	https://openalex.org/C11413529
concepts[1].level	1
concepts[1].score	0.4349822700023651
concepts[1].wikidata	https://www.wikidata.org/wiki/Q8366
concepts[1].display_name	Algorithm
concepts[2].id	https://openalex.org/C154945302
concepts[2].level	1
concepts[2].score	0.3807699680328369
concepts[2].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[2].display_name	Artificial intelligence
keywords[0].id	https://openalex.org/keywords/computer-science
keywords[0].score	0.4694157540798187
keywords[0].display_name	Computer science
keywords[1].id	https://openalex.org/keywords/algorithm
keywords[1].score	0.4349822700023651
keywords[1].display_name	Algorithm
keywords[2].id	https://openalex.org/keywords/artificial-intelligence
keywords[2].score	0.3807699680328369
keywords[2].display_name	Artificial intelligence
language	en
locations[0].id	doi:10.18564/jasss.5432
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S131312518
locations[0].source.issn	1460-7425
locations[0].source.type	journal
locations[0].source.is_oa	True
locations[0].source.issn_l	1460-7425
locations[0].source.is_core	True
locations[0].source.is_in_doaj	True
locations[0].source.display_name	Journal of Artificial Societies and Social Simulation
locations[0].source.host_organization	https://openalex.org/P4310311603
locations[0].source.host_organization_name	University of Surrey
locations[0].source.host_organization_lineage	https://openalex.org/P4310311603
locations[0].source.host_organization_lineage_names	University of Surrey
locations[0].license	cc-by
locations[0].pdf_url
locations[0].version	publishedVersion
locations[0].raw_type	journal-article
locations[0].license_id	https://openalex.org/licenses/cc-by
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	Journal of Artificial Societies and Social Simulation
locations[0].landing_page_url	http://doi.org/10.18564/jasss.5432
locations[1].id	pmh:oai:digitalcommons.odu.edu:physics_fac_pubs-1888
locations[1].is_oa	False
locations[1].source.id	https://openalex.org/S4377196314
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	False
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	ODU Digital Commons (Old Dominion University)
locations[1].source.host_organization	https://openalex.org/I81365321
locations[1].source.host_organization_name	Old Dominion University
locations[1].source.host_organization_lineage	https://openalex.org/I81365321
locations[1].license
locations[1].pdf_url
locations[1].version	submittedVersion
locations[1].raw_type	article
locations[1].license_id
locations[1].is_accepted	False
locations[1].is_published	False
locations[1].raw_source_name	Physics Faculty Publications
locations[1].landing_page_url	https://digitalcommons.odu.edu/physics_fac_pubs/886
indexed_in	crossref, doaj
authorships[0].author.id	https://openalex.org/A5083704024
authorships[0].author.orcid	https://orcid.org/0000-0003-4352-9564
authorships[0].author.display_name	J. O. Gonzalez-Hernandez
authorships[0].author_position	first
authorships[0].raw_author_name	Jose Osvaldo Gonzalez-Hernandez
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5003364526
authorships[1].author.orcid
authorships[1].author.display_name	Jonathan Marino
authorships[1].author_position	middle
authorships[1].raw_author_name	Jonathan Marino
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5041709152
authorships[2].author.orcid	https://orcid.org/0000-0002-0762-0275
authorships[2].author.display_name	T. C. Rogers
authorships[2].author_position	middle
authorships[2].raw_author_name	Ted Rogers
authorships[2].is_corresponding	False
authorships[3].author.id	https://openalex.org/A5020436293
authorships[3].author.orcid	https://orcid.org/0000-0003-2918-5486
authorships[3].author.display_name	Brandon Velasco
authorships[3].author_position	last
authorships[3].raw_author_name	Brandon Velasco
authorships[3].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	http://doi.org/10.18564/jasss.5432
open_access.oa_status	gold
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Proof of Principle for a Self-Governing Prediction and Forecasting Reward Algorithm
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T14351
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.3953000009059906
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Statistical and Computational Modeling
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2051487156, https://openalex.org/W2073681303, https://openalex.org/W2390279801, https://openalex.org/W4391913857, https://openalex.org/W2358668433, https://openalex.org/W4396701345, https://openalex.org/W2376932109
cited_by_count	0
locations_count	2
best_oa_location.id	doi:10.18564/jasss.5432
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S131312518
best_oa_location.source.issn	1460-7425
best_oa_location.source.type	journal
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l	1460-7425
best_oa_location.source.is_core	True
best_oa_location.source.is_in_doaj	True
best_oa_location.source.display_name	Journal of Artificial Societies and Social Simulation
best_oa_location.source.host_organization	https://openalex.org/P4310311603
best_oa_location.source.host_organization_name	University of Surrey
best_oa_location.source.host_organization_lineage	https://openalex.org/P4310311603
best_oa_location.source.host_organization_lineage_names	University of Surrey
best_oa_location.license	cc-by
best_oa_location.pdf_url
best_oa_location.version	publishedVersion
best_oa_location.raw_type	journal-article
best_oa_location.license_id	https://openalex.org/licenses/cc-by
best_oa_location.is_accepted	True
best_oa_location.is_published	True
best_oa_location.raw_source_name	Journal of Artificial Societies and Social Simulation
best_oa_location.landing_page_url	http://doi.org/10.18564/jasss.5432
primary_location.id	doi:10.18564/jasss.5432
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S131312518
primary_location.source.issn	1460-7425
primary_location.source.type	journal
primary_location.source.is_oa	True
primary_location.source.issn_l	1460-7425
primary_location.source.is_core	True
primary_location.source.is_in_doaj	True
primary_location.source.display_name	Journal of Artificial Societies and Social Simulation
primary_location.source.host_organization	https://openalex.org/P4310311603
primary_location.source.host_organization_name	University of Surrey
primary_location.source.host_organization_lineage	https://openalex.org/P4310311603
primary_location.source.host_organization_lineage_names	University of Surrey
primary_location.license	cc-by
primary_location.pdf_url
primary_location.version	publishedVersion
primary_location.raw_type	journal-article
primary_location.license_id	https://openalex.org/licenses/cc-by
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	Journal of Artificial Societies and Social Simulation
primary_location.landing_page_url	http://doi.org/10.18564/jasss.5432
publication_date	2024-01-01
publication_year	2024
referenced_works_count	0
abstract_inverted_index.a	12, 22, 35, 144
abstract_inverted_index.We	0
abstract_inverted_index.an	7
abstract_inverted_index.as	62, 134
abstract_inverted_index.in	128
abstract_inverted_index.is	29, 43, 68, 137, 152
abstract_inverted_index.it	70
abstract_inverted_index.of	14, 21, 34, 38, 48, 51, 59, 73, 88, 99, 107, 121, 149
abstract_inverted_index.so	132
abstract_inverted_index.to	5, 30, 45, 153
abstract_inverted_index.Our	27, 86
abstract_inverted_index.The	56, 111, 147
abstract_inverted_index.aim	28
abstract_inverted_index.and	77, 104, 139, 170
abstract_inverted_index.the	19, 32, 49, 82, 89, 97, 105, 108, 118, 122, 140
abstract_inverted_index.use	1
abstract_inverted_index.bias	100, 141, 169
abstract_inverted_index.both	74, 96
abstract_inverted_index.from	101
abstract_inverted_index.high	138
abstract_inverted_index.into	81, 157
abstract_inverted_index.like	168
abstract_inverted_index.long	133
abstract_inverted_index.rule	41
abstract_inverted_index.some	47
abstract_inverted_index.that	42, 69, 94, 161
abstract_inverted_index.this	60, 150
abstract_inverted_index.true	130
abstract_inverted_index.type	37
abstract_inverted_index.with	64, 166
abstract_inverted_index.work	151
abstract_inverted_index.Carlo	3, 113
abstract_inverted_index.Monte	2, 112
abstract_inverted_index.below	143
abstract_inverted_index.group	13, 75
abstract_inverted_index.level	98
abstract_inverted_index.model	87
abstract_inverted_index.prior	102
abstract_inverted_index.stays	142
abstract_inverted_index.that,	116
abstract_inverted_index.under	18
abstract_inverted_index.acting	17
abstract_inverted_index.belief	127
abstract_inverted_index.facts,	131
abstract_inverted_index.model,	123
abstract_inverted_index.reward	25, 39, 83, 109, 135, 159
abstract_inverted_index.rules.	55
abstract_inverted_index.within	117
abstract_inverted_index.address	46
abstract_inverted_index.beliefs	103
abstract_inverted_index.between	11
abstract_inverted_index.combine	162
abstract_inverted_index.control	95
abstract_inverted_index.experts	16, 124
abstract_inverted_index.factors	167
abstract_inverted_index.further	155
abstract_inverted_index.primary	57
abstract_inverted_index.purpose	148
abstract_inverted_index.scoring	54, 67
abstract_inverted_index.approach	126
abstract_inverted_index.compared	63
abstract_inverted_index.critical	145
abstract_inverted_index.designed	44
abstract_inverted_index.directly	80
abstract_inverted_index.forecast	53, 66
abstract_inverted_index.includes	92
abstract_inverted_index.measures	72, 165
abstract_inverted_index.motivate	154
abstract_inverted_index.question	78
abstract_inverted_index.research	156
abstract_inverted_index.simulate	6
abstract_inverted_index.specific	36
abstract_inverted_index.standard	65, 163
abstract_inverted_index.algorithm	61
abstract_inverted_index.consensus	76
abstract_inverted_index.extension	58
abstract_inverted_index.influence	20, 106, 136
abstract_inverted_index.organized	8
abstract_inverted_index.relevance	79
abstract_inverted_index.advantages	33
abstract_inverted_index.algorithm.	26, 85
abstract_inverted_index.algorithms	160
abstract_inverted_index.consensus.	171
abstract_inverted_index.illustrate	31
abstract_inverted_index.incentive.	110
abstract_inverted_index.parameters	93
abstract_inverted_index.prediction	9, 24, 90, 158
abstract_inverted_index.scientific	15
abstract_inverted_index.techniques	4
abstract_inverted_index.threshold.	146
abstract_inverted_index.assumptions	120
abstract_inverted_index.competition	10, 91
abstract_inverted_index.demonstrate	115
abstract_inverted_index.forecasting	164
abstract_inverted_index.limitations	50
abstract_inverted_index.objectively	129
abstract_inverted_index.simplifying	119
abstract_inverted_index.simulations	114
abstract_inverted_index.traditional	52
abstract_inverted_index.collectively	125
abstract_inverted_index.distribution	40, 84
abstract_inverted_index.incorporates	71
abstract_inverted_index."self-governing"	23
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	4
citation_normalized_percentile.value	0.21122908
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	False