Manipulation and peer mechanisms: A survey Article Swipe
Matthew Olckers
,
Toby Walsh
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1016/j.artint.2024.104196
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1016/j.artint.2024.104196
In peer mechanisms, the competitors for a prize also determine who wins. Each competitor may be asked to rank, grade, or nominate peers for the prize. Since the prize can be valuable, such as financial aid, course grades, or an award at a conference, competitors may be tempted to manipulate the mechanism. We survey approaches to prevent or discourage the manipulation of peer mechanisms. We conclude our survey by identifying several important research challenges.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1016/j.artint.2024.104196
- OA Status
- hybrid
- Cited By
- 6
- References
- 91
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4401241445
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4401241445Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1016/j.artint.2024.104196Digital Object Identifier
- Title
-
Manipulation and peer mechanisms: A surveyWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-08-02Full publication date if available
- Authors
-
Matthew Olckers, Toby WalshList of authors in order
- Landing page
-
https://doi.org/10.1016/j.artint.2024.104196Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
hybridOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.1016/j.artint.2024.104196Direct OA link when available
- Concepts
-
NOMINATE, Competitor analysis, Mechanism (biology), Computer science, Psychology, Survey research, Marketing, Business, Applied psychology, Machine learning, Philosophy, EpistemologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
6Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 4, 2024: 1, 2023: 1Per-year citation counts (last 5 years)
- References (count)
-
91Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4401241445 |
|---|---|
| doi | https://doi.org/10.1016/j.artint.2024.104196 |
| ids.doi | https://doi.org/10.1016/j.artint.2024.104196 |
| ids.openalex | https://openalex.org/W4401241445 |
| fwci | 4.78261348 |
| type | article |
| title | Manipulation and peer mechanisms: A survey |
| awards[0].id | https://openalex.org/G438882881 |
| awards[0].funder_id | https://openalex.org/F4320334704 |
| awards[0].display_name | |
| awards[0].funder_award_id | FL200100204 |
| awards[0].funder_display_name | Australian Research Council |
| biblio.issue | |
| biblio.volume | 336 |
| biblio.last_page | 104196 |
| biblio.first_page | 104196 |
| topics[0].id | https://openalex.org/T11182 |
| topics[0].field.id | https://openalex.org/fields/18 |
| topics[0].field.display_name | Decision Sciences |
| topics[0].score | 0.9991999864578247 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1803 |
| topics[0].subfield.display_name | Management Science and Operations Research |
| topics[0].display_name | Auction Theory and Applications |
| topics[1].id | https://openalex.org/T11031 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9937999844551086 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1803 |
| topics[1].subfield.display_name | Management Science and Operations Research |
| topics[1].display_name | Game Theory and Applications |
| topics[2].id | https://openalex.org/T10991 |
| topics[2].field.id | https://openalex.org/fields/20 |
| topics[2].field.display_name | Economics, Econometrics and Finance |
| topics[2].score | 0.9902999997138977 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2002 |
| topics[2].subfield.display_name | Economics and Econometrics |
| topics[2].display_name | Game Theory and Voting Systems |
| funders[0].id | https://openalex.org/F4320334704 |
| funders[0].ror | https://ror.org/05mmh0f86 |
| funders[0].display_name | Australian Research Council |
| is_xpac | False |
| apc_list.value | 3670 |
| apc_list.currency | USD |
| apc_list.value_usd | 3670 |
| apc_paid.value | 3670 |
| apc_paid.currency | USD |
| apc_paid.value_usd | 3670 |
| concepts[0].id | https://openalex.org/C140367253 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8960328102111816 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q6954911 |
| concepts[0].display_name | NOMINATE |
| concepts[1].id | https://openalex.org/C127576917 |
| concepts[1].level | 2 |
| concepts[1].score | 0.843633234500885 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q624630 |
| concepts[1].display_name | Competitor analysis |
| concepts[2].id | https://openalex.org/C89611455 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5206105709075928 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q6804646 |
| concepts[2].display_name | Mechanism (biology) |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.4662173390388489 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C15744967 |
| concepts[4].level | 0 |
| concepts[4].score | 0.44478094577789307 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[4].display_name | Psychology |
| concepts[5].id | https://openalex.org/C173481278 |
| concepts[5].level | 2 |
| concepts[5].score | 0.41078582406044006 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q7257997 |
| concepts[5].display_name | Survey research |
| concepts[6].id | https://openalex.org/C162853370 |
| concepts[6].level | 1 |
| concepts[6].score | 0.23398080468177795 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q39809 |
| concepts[6].display_name | Marketing |
| concepts[7].id | https://openalex.org/C144133560 |
| concepts[7].level | 0 |
| concepts[7].score | 0.21529695391654968 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[7].display_name | Business |
| concepts[8].id | https://openalex.org/C75630572 |
| concepts[8].level | 1 |
| concepts[8].score | 0.12591668963432312 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q538904 |
| concepts[8].display_name | Applied psychology |
| concepts[9].id | https://openalex.org/C119857082 |
| concepts[9].level | 1 |
| concepts[9].score | 0.07444778084754944 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[9].display_name | Machine learning |
| concepts[10].id | https://openalex.org/C138885662 |
| concepts[10].level | 0 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[10].display_name | Philosophy |
| concepts[11].id | https://openalex.org/C111472728 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q9471 |
| concepts[11].display_name | Epistemology |
| keywords[0].id | https://openalex.org/keywords/nominate |
| keywords[0].score | 0.8960328102111816 |
| keywords[0].display_name | NOMINATE |
| keywords[1].id | https://openalex.org/keywords/competitor-analysis |
| keywords[1].score | 0.843633234500885 |
| keywords[1].display_name | Competitor analysis |
| keywords[2].id | https://openalex.org/keywords/mechanism |
| keywords[2].score | 0.5206105709075928 |
| keywords[2].display_name | Mechanism (biology) |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.4662173390388489 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/psychology |
| keywords[4].score | 0.44478094577789307 |
| keywords[4].display_name | Psychology |
| keywords[5].id | https://openalex.org/keywords/survey-research |
| keywords[5].score | 0.41078582406044006 |
| keywords[5].display_name | Survey research |
| keywords[6].id | https://openalex.org/keywords/marketing |
| keywords[6].score | 0.23398080468177795 |
| keywords[6].display_name | Marketing |
| keywords[7].id | https://openalex.org/keywords/business |
| keywords[7].score | 0.21529695391654968 |
| keywords[7].display_name | Business |
| keywords[8].id | https://openalex.org/keywords/applied-psychology |
| keywords[8].score | 0.12591668963432312 |
| keywords[8].display_name | Applied psychology |
| keywords[9].id | https://openalex.org/keywords/machine-learning |
| keywords[9].score | 0.07444778084754944 |
| keywords[9].display_name | Machine learning |
| language | en |
| locations[0].id | doi:10.1016/j.artint.2024.104196 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S196139623 |
| locations[0].source.issn | 0004-3702, 1872-7921 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | 0004-3702 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | Artificial Intelligence |
| locations[0].source.host_organization | https://openalex.org/P4310320990 |
| locations[0].source.host_organization_name | Elsevier BV |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310320990 |
| locations[0].source.host_organization_lineage_names | Elsevier BV |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Artificial Intelligence |
| locations[0].landing_page_url | https://doi.org/10.1016/j.artint.2024.104196 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5081345398 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-7096-7047 |
| authorships[0].author.display_name | Matthew Olckers |
| authorships[0].countries | AU |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I99043593 |
| authorships[0].affiliations[0].raw_affiliation_string | Macquarie University and the e61 Institute, Australia |
| authorships[0].institutions[0].id | https://openalex.org/I99043593 |
| authorships[0].institutions[0].ror | https://ror.org/01sf06y89 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I99043593 |
| authorships[0].institutions[0].country_code | AU |
| authorships[0].institutions[0].display_name | Macquarie University |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Matthew Olckers |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Macquarie University and the e61 Institute, Australia |
| authorships[1].author.id | https://openalex.org/A5072902302 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-2998-8668 |
| authorships[1].author.display_name | Toby Walsh |
| authorships[1].countries | AU |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I31746571 |
| authorships[1].affiliations[0].raw_affiliation_string | School of Computer Science and Engineering, UNSW Sydney, Australia |
| authorships[1].institutions[0].id | https://openalex.org/I31746571 |
| authorships[1].institutions[0].ror | https://ror.org/03r8z3t63 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I31746571 |
| authorships[1].institutions[0].country_code | AU |
| authorships[1].institutions[0].display_name | UNSW Sydney |
| authorships[1].author_position | last |
| authorships[1].raw_author_name | Toby Walsh |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | School of Computer Science and Engineering, UNSW Sydney, Australia |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.1016/j.artint.2024.104196 |
| open_access.oa_status | hybrid |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Manipulation and peer mechanisms: A survey |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T11182 |
| primary_topic.field.id | https://openalex.org/fields/18 |
| primary_topic.field.display_name | Decision Sciences |
| primary_topic.score | 0.9991999864578247 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1803 |
| primary_topic.subfield.display_name | Management Science and Operations Research |
| primary_topic.display_name | Auction Theory and Applications |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W4388640614, https://openalex.org/W2468827065, https://openalex.org/W2521605489, https://openalex.org/W2023913105, https://openalex.org/W4244590767, https://openalex.org/W4401260011, https://openalex.org/W3165668142, https://openalex.org/W2434895813 |
| cited_by_count | 6 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 4 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 1 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 1 |
| locations_count | 1 |
| best_oa_location.id | doi:10.1016/j.artint.2024.104196 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S196139623 |
| best_oa_location.source.issn | 0004-3702, 1872-7921 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | 0004-3702 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | Artificial Intelligence |
| best_oa_location.source.host_organization | https://openalex.org/P4310320990 |
| best_oa_location.source.host_organization_name | Elsevier BV |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310320990 |
| best_oa_location.source.host_organization_lineage_names | Elsevier BV |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Artificial Intelligence |
| best_oa_location.landing_page_url | https://doi.org/10.1016/j.artint.2024.104196 |
| primary_location.id | doi:10.1016/j.artint.2024.104196 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S196139623 |
| primary_location.source.issn | 0004-3702, 1872-7921 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | 0004-3702 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | Artificial Intelligence |
| primary_location.source.host_organization | https://openalex.org/P4310320990 |
| primary_location.source.host_organization_name | Elsevier BV |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310320990 |
| primary_location.source.host_organization_lineage_names | Elsevier BV |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Artificial Intelligence |
| primary_location.landing_page_url | https://doi.org/10.1016/j.artint.2024.104196 |
| publication_date | 2024-08-02 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W2164108909, https://openalex.org/W6632978321, https://openalex.org/W2084984189, https://openalex.org/W6764721838, https://openalex.org/W1984982463, https://openalex.org/W4382395871, https://openalex.org/W2146393798, https://openalex.org/W6767025957, https://openalex.org/W6762521079, https://openalex.org/W6731103147, https://openalex.org/W2963752051, https://openalex.org/W6748242391, https://openalex.org/W6770310482, https://openalex.org/W6778617272, https://openalex.org/W2473242869, https://openalex.org/W6780059446, https://openalex.org/W2512463392, https://openalex.org/W2778870909, https://openalex.org/W6787842869, https://openalex.org/W3123169686, https://openalex.org/W6607354617, https://openalex.org/W6767875630, https://openalex.org/W6695430190, https://openalex.org/W2950414942, https://openalex.org/W2130116557, https://openalex.org/W6847765113, https://openalex.org/W3174330101, https://openalex.org/W6724221150, https://openalex.org/W3124919702, https://openalex.org/W2091152488, https://openalex.org/W6809760122, https://openalex.org/W2624786321, https://openalex.org/W3198986883, https://openalex.org/W6744560485, https://openalex.org/W2124002218, https://openalex.org/W6661770582, https://openalex.org/W2044376135, https://openalex.org/W2769880400, https://openalex.org/W2017970485, https://openalex.org/W1558752712, https://openalex.org/W2783385777, https://openalex.org/W6758466796, https://openalex.org/W6748725845, https://openalex.org/W6772337899, https://openalex.org/W6627008108, https://openalex.org/W3125563705, https://openalex.org/W4313368329, https://openalex.org/W6754365781, https://openalex.org/W3164964801, https://openalex.org/W1473750384, https://openalex.org/W2920431521, https://openalex.org/W6777541163, https://openalex.org/W2006437246, https://openalex.org/W2048490718, https://openalex.org/W2031992809, https://openalex.org/W6677855075, https://openalex.org/W2011272461, https://openalex.org/W4281392565, https://openalex.org/W6784296406, https://openalex.org/W1921880471, https://openalex.org/W2055395921, https://openalex.org/W2151242492, https://openalex.org/W4205512334, https://openalex.org/W6640483950, https://openalex.org/W6752752648, https://openalex.org/W6679245100, https://openalex.org/W6682576376, https://openalex.org/W6752736684, https://openalex.org/W6842253891, https://openalex.org/W6798832157, https://openalex.org/W6790873888, https://openalex.org/W6853777701, https://openalex.org/W2914501678, https://openalex.org/W3032916997, https://openalex.org/W2484891765, https://openalex.org/W2911324430, https://openalex.org/W1498889918, https://openalex.org/W2539402368, https://openalex.org/W973843712, https://openalex.org/W3212567773, https://openalex.org/W2913440532, https://openalex.org/W2531563875, https://openalex.org/W3088724664, https://openalex.org/W4241678075, https://openalex.org/W3124942460, https://openalex.org/W2613712744, https://openalex.org/W4225647540, https://openalex.org/W2757853533, https://openalex.org/W2913841425, https://openalex.org/W3113120478, https://openalex.org/W4230316285 |
| referenced_works_count | 91 |
| abstract_inverted_index.a | 6, 42 |
| abstract_inverted_index.In | 0 |
| abstract_inverted_index.We | 52, 64 |
| abstract_inverted_index.an | 39 |
| abstract_inverted_index.as | 33 |
| abstract_inverted_index.at | 41 |
| abstract_inverted_index.be | 15, 30, 46 |
| abstract_inverted_index.by | 68 |
| abstract_inverted_index.of | 61 |
| abstract_inverted_index.or | 20, 38, 57 |
| abstract_inverted_index.to | 17, 48, 55 |
| abstract_inverted_index.can | 29 |
| abstract_inverted_index.for | 5, 23 |
| abstract_inverted_index.may | 14, 45 |
| abstract_inverted_index.our | 66 |
| abstract_inverted_index.the | 3, 24, 27, 50, 59 |
| abstract_inverted_index.who | 10 |
| abstract_inverted_index.Each | 12 |
| abstract_inverted_index.aid, | 35 |
| abstract_inverted_index.also | 8 |
| abstract_inverted_index.peer | 1, 62 |
| abstract_inverted_index.such | 32 |
| abstract_inverted_index.Since | 26 |
| abstract_inverted_index.asked | 16 |
| abstract_inverted_index.award | 40 |
| abstract_inverted_index.peers | 22 |
| abstract_inverted_index.prize | 7, 28 |
| abstract_inverted_index.rank, | 18 |
| abstract_inverted_index.wins. | 11 |
| abstract_inverted_index.course | 36 |
| abstract_inverted_index.grade, | 19 |
| abstract_inverted_index.prize. | 25 |
| abstract_inverted_index.survey | 53, 67 |
| abstract_inverted_index.grades, | 37 |
| abstract_inverted_index.prevent | 56 |
| abstract_inverted_index.several | 70 |
| abstract_inverted_index.tempted | 47 |
| abstract_inverted_index.conclude | 65 |
| abstract_inverted_index.nominate | 21 |
| abstract_inverted_index.research | 72 |
| abstract_inverted_index.determine | 9 |
| abstract_inverted_index.financial | 34 |
| abstract_inverted_index.important | 71 |
| abstract_inverted_index.valuable, | 31 |
| abstract_inverted_index.approaches | 54 |
| abstract_inverted_index.competitor | 13 |
| abstract_inverted_index.discourage | 58 |
| abstract_inverted_index.manipulate | 49 |
| abstract_inverted_index.mechanism. | 51 |
| abstract_inverted_index.challenges. | 73 |
| abstract_inverted_index.competitors | 4, 44 |
| abstract_inverted_index.conference, | 43 |
| abstract_inverted_index.identifying | 69 |
| abstract_inverted_index.mechanisms, | 2 |
| abstract_inverted_index.mechanisms. | 63 |
| abstract_inverted_index.manipulation | 60 |
| cited_by_percentile_year.max | 98 |
| cited_by_percentile_year.min | 89 |
| corresponding_author_ids | https://openalex.org/A5081345398 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 2 |
| corresponding_institution_ids | https://openalex.org/I99043593 |
| citation_normalized_percentile.value | 0.92007 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |