Simple changes to content curation algorithms affect the beliefs people form in a collaborative filtering experiment Article Swipe
Jason W. Burton
,
Stefan M. Herzog
,
Philipp Lorenz-Spreen
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/5yfbt_v1
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/5yfbt_v1
Content-curating algorithms provide a crucial service for social media users by surfacing relevant content, but they can also bring about harms when their objectives are misaligned with user values and welfare. Yet, potential behavioral and cognitive consequences of this alignment problem remain understudied in controlled experiments. In a preregistered, two-wave, collaborative filtering experiment (total N=1,500), we demonstrate that simple changes to the metrics used for sampling and ranking posts affect the beliefs people form. Our results show observable differences in two types of outcomes within statistically constructed groups: belief accuracy and consensus. We find partial support for hypotheses that the recently proposed approaches of ``bridging-based ranking" and ``intelligence-based ranking" promote consensus and belief accuracy, respectively. We also find that while personalized, engagement-based ranking promotes posts that participants perceive favorably, it simultaneously leads those participants to form more polarized and less accurate beliefs than any of the other algorithms considered.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- https://doi.org/10.31234/osf.io/5yfbt_v1
- https://osf.io/5yfbt_v1/download
- OA Status
- gold
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4411287320
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4411287320Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.31234/osf.io/5yfbt_v1Digital Object Identifier
- Title
-
Simple changes to content curation algorithms affect the beliefs people form in a collaborative filtering experimentWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-02-08Full publication date if available
- Authors
-
Jason W. Burton, Stefan M. Herzog, Philipp Lorenz-SpreenList of authors in order
- Landing page
-
https://doi.org/10.31234/osf.io/5yfbt_v1Publisher landing page
- PDF URL
-
https://osf.io/5yfbt_v1/downloadDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://osf.io/5yfbt_v1/downloadDirect OA link when available
- Concepts
-
Simple (philosophy), Affect (linguistics), Collaborative filtering, Content (measure theory), Data curation, Computer science, Algorithm, Psychology, Data science, Information retrieval, Mathematics, Recommender system, Communication, Epistemology, Philosophy, Mathematical analysisTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4411287320 |
|---|---|
| doi | https://doi.org/10.31234/osf.io/5yfbt_v1 |
| ids.doi | https://doi.org/10.31234/osf.io/5yfbt_v1 |
| ids.openalex | https://openalex.org/W4411287320 |
| fwci | 0.0 |
| type | preprint |
| title | Simple changes to content curation algorithms affect the beliefs people form in a collaborative filtering experiment |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11439 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9681000113487244 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1707 |
| topics[0].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[0].display_name | Video Analysis and Summarization |
| topics[1].id | https://openalex.org/T11309 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9610999822616577 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1711 |
| topics[1].subfield.display_name | Signal Processing |
| topics[1].display_name | Music and Audio Processing |
| topics[2].id | https://openalex.org/T13321 |
| topics[2].field.id | https://openalex.org/fields/33 |
| topics[2].field.display_name | Social Sciences |
| topics[2].score | 0.9362000226974487 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3315 |
| topics[2].subfield.display_name | Communication |
| topics[2].display_name | Radio, Podcasts, and Digital Media |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2780586882 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7854548692703247 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q7520643 |
| concepts[0].display_name | Simple (philosophy) |
| concepts[1].id | https://openalex.org/C2776035688 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7529875040054321 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1606558 |
| concepts[1].display_name | Affect (linguistics) |
| concepts[2].id | https://openalex.org/C21569690 |
| concepts[2].level | 3 |
| concepts[2].score | 0.6003796458244324 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q94702 |
| concepts[2].display_name | Collaborative filtering |
| concepts[3].id | https://openalex.org/C2778152352 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5933078527450562 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q5165061 |
| concepts[3].display_name | Content (measure theory) |
| concepts[4].id | https://openalex.org/C91632574 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5449290871620178 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q15088675 |
| concepts[4].display_name | Data curation |
| concepts[5].id | https://openalex.org/C41008148 |
| concepts[5].level | 0 |
| concepts[5].score | 0.49663954973220825 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[5].display_name | Computer science |
| concepts[6].id | https://openalex.org/C11413529 |
| concepts[6].level | 1 |
| concepts[6].score | 0.37141314148902893 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q8366 |
| concepts[6].display_name | Algorithm |
| concepts[7].id | https://openalex.org/C15744967 |
| concepts[7].level | 0 |
| concepts[7].score | 0.34686487913131714 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[7].display_name | Psychology |
| concepts[8].id | https://openalex.org/C2522767166 |
| concepts[8].level | 1 |
| concepts[8].score | 0.31175950169563293 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[8].display_name | Data science |
| concepts[9].id | https://openalex.org/C23123220 |
| concepts[9].level | 1 |
| concepts[9].score | 0.30847156047821045 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q816826 |
| concepts[9].display_name | Information retrieval |
| concepts[10].id | https://openalex.org/C33923547 |
| concepts[10].level | 0 |
| concepts[10].score | 0.21016746759414673 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[10].display_name | Mathematics |
| concepts[11].id | https://openalex.org/C557471498 |
| concepts[11].level | 2 |
| concepts[11].score | 0.16635379195213318 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q554950 |
| concepts[11].display_name | Recommender system |
| concepts[12].id | https://openalex.org/C46312422 |
| concepts[12].level | 1 |
| concepts[12].score | 0.13762840628623962 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q11024 |
| concepts[12].display_name | Communication |
| concepts[13].id | https://openalex.org/C111472728 |
| concepts[13].level | 1 |
| concepts[13].score | 0.13049885630607605 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q9471 |
| concepts[13].display_name | Epistemology |
| concepts[14].id | https://openalex.org/C138885662 |
| concepts[14].level | 0 |
| concepts[14].score | 0.0 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[14].display_name | Philosophy |
| concepts[15].id | https://openalex.org/C134306372 |
| concepts[15].level | 1 |
| concepts[15].score | 0.0 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q7754 |
| concepts[15].display_name | Mathematical analysis |
| keywords[0].id | https://openalex.org/keywords/simple |
| keywords[0].score | 0.7854548692703247 |
| keywords[0].display_name | Simple (philosophy) |
| keywords[1].id | https://openalex.org/keywords/affect |
| keywords[1].score | 0.7529875040054321 |
| keywords[1].display_name | Affect (linguistics) |
| keywords[2].id | https://openalex.org/keywords/collaborative-filtering |
| keywords[2].score | 0.6003796458244324 |
| keywords[2].display_name | Collaborative filtering |
| keywords[3].id | https://openalex.org/keywords/content |
| keywords[3].score | 0.5933078527450562 |
| keywords[3].display_name | Content (measure theory) |
| keywords[4].id | https://openalex.org/keywords/data-curation |
| keywords[4].score | 0.5449290871620178 |
| keywords[4].display_name | Data curation |
| keywords[5].id | https://openalex.org/keywords/computer-science |
| keywords[5].score | 0.49663954973220825 |
| keywords[5].display_name | Computer science |
| keywords[6].id | https://openalex.org/keywords/algorithm |
| keywords[6].score | 0.37141314148902893 |
| keywords[6].display_name | Algorithm |
| keywords[7].id | https://openalex.org/keywords/psychology |
| keywords[7].score | 0.34686487913131714 |
| keywords[7].display_name | Psychology |
| keywords[8].id | https://openalex.org/keywords/data-science |
| keywords[8].score | 0.31175950169563293 |
| keywords[8].display_name | Data science |
| keywords[9].id | https://openalex.org/keywords/information-retrieval |
| keywords[9].score | 0.30847156047821045 |
| keywords[9].display_name | Information retrieval |
| keywords[10].id | https://openalex.org/keywords/mathematics |
| keywords[10].score | 0.21016746759414673 |
| keywords[10].display_name | Mathematics |
| keywords[11].id | https://openalex.org/keywords/recommender-system |
| keywords[11].score | 0.16635379195213318 |
| keywords[11].display_name | Recommender system |
| keywords[12].id | https://openalex.org/keywords/communication |
| keywords[12].score | 0.13762840628623962 |
| keywords[12].display_name | Communication |
| keywords[13].id | https://openalex.org/keywords/epistemology |
| keywords[13].score | 0.13049885630607605 |
| keywords[13].display_name | Epistemology |
| language | en |
| locations[0].id | doi:10.31234/osf.io/5yfbt_v1 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://osf.io/5yfbt_v1/download |
| locations[0].version | acceptedVersion |
| locations[0].raw_type | posted-content |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.31234/osf.io/5yfbt_v1 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5070346701 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-6797-2299 |
| authorships[0].author.display_name | Jason W. Burton |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Jason W. Burton |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5008439962 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-2329-6433 |
| authorships[1].author.display_name | Stefan M. Herzog |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Stefan Michael Herzog |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5026949484 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-6319-4154 |
| authorships[2].author.display_name | Philipp Lorenz-Spreen |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Philipp Lorenz-Spreen |
| authorships[2].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://osf.io/5yfbt_v1/download |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Simple changes to content curation algorithms affect the beliefs people form in a collaborative filtering experiment |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T11439 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9681000113487244 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1707 |
| primary_topic.subfield.display_name | Computer Vision and Pattern Recognition |
| primary_topic.display_name | Video Analysis and Summarization |
| related_works | https://openalex.org/W2398165842, https://openalex.org/W197922276, https://openalex.org/W4226158052, https://openalex.org/W1809731386, https://openalex.org/W4388863299, https://openalex.org/W2160332782, https://openalex.org/W2945818642, https://openalex.org/W2146181690, https://openalex.org/W2006998619, https://openalex.org/W2556985004 |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | doi:10.31234/osf.io/5yfbt_v1 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://osf.io/5yfbt_v1/download |
| best_oa_location.version | acceptedVersion |
| best_oa_location.raw_type | posted-content |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.31234/osf.io/5yfbt_v1 |
| primary_location.id | doi:10.31234/osf.io/5yfbt_v1 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://osf.io/5yfbt_v1/download |
| primary_location.version | acceptedVersion |
| primary_location.raw_type | posted-content |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.31234/osf.io/5yfbt_v1 |
| publication_date | 2024-02-08 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 3, 47 |
| abstract_inverted_index.In | 46 |
| abstract_inverted_index.We | 92, 115 |
| abstract_inverted_index.by | 10 |
| abstract_inverted_index.in | 43, 79 |
| abstract_inverted_index.it | 129 |
| abstract_inverted_index.of | 37, 82, 103, 144 |
| abstract_inverted_index.to | 60, 134 |
| abstract_inverted_index.we | 55 |
| abstract_inverted_index.Our | 74 |
| abstract_inverted_index.and | 29, 34, 66, 90, 106, 111, 138 |
| abstract_inverted_index.any | 143 |
| abstract_inverted_index.are | 24 |
| abstract_inverted_index.but | 14 |
| abstract_inverted_index.can | 16 |
| abstract_inverted_index.for | 6, 64, 96 |
| abstract_inverted_index.the | 61, 70, 99, 145 |
| abstract_inverted_index.two | 80 |
| abstract_inverted_index.Yet, | 31 |
| abstract_inverted_index.also | 17, 116 |
| abstract_inverted_index.find | 93, 117 |
| abstract_inverted_index.form | 135 |
| abstract_inverted_index.less | 139 |
| abstract_inverted_index.more | 136 |
| abstract_inverted_index.show | 76 |
| abstract_inverted_index.than | 142 |
| abstract_inverted_index.that | 57, 98, 118, 125 |
| abstract_inverted_index.they | 15 |
| abstract_inverted_index.this | 38 |
| abstract_inverted_index.used | 63 |
| abstract_inverted_index.user | 27 |
| abstract_inverted_index.when | 21 |
| abstract_inverted_index.with | 26 |
| abstract_inverted_index.about | 19 |
| abstract_inverted_index.bring | 18 |
| abstract_inverted_index.form. | 73 |
| abstract_inverted_index.harms | 20 |
| abstract_inverted_index.leads | 131 |
| abstract_inverted_index.media | 8 |
| abstract_inverted_index.other | 146 |
| abstract_inverted_index.posts | 68, 124 |
| abstract_inverted_index.their | 22 |
| abstract_inverted_index.those | 132 |
| abstract_inverted_index.types | 81 |
| abstract_inverted_index.users | 9 |
| abstract_inverted_index.while | 119 |
| abstract_inverted_index.(total | 53 |
| abstract_inverted_index.affect | 69 |
| abstract_inverted_index.belief | 88, 112 |
| abstract_inverted_index.people | 72 |
| abstract_inverted_index.remain | 41 |
| abstract_inverted_index.simple | 58 |
| abstract_inverted_index.social | 7 |
| abstract_inverted_index.values | 28 |
| abstract_inverted_index.within | 84 |
| abstract_inverted_index.beliefs | 71, 141 |
| abstract_inverted_index.changes | 59 |
| abstract_inverted_index.crucial | 4 |
| abstract_inverted_index.groups: | 87 |
| abstract_inverted_index.metrics | 62 |
| abstract_inverted_index.partial | 94 |
| abstract_inverted_index.problem | 40 |
| abstract_inverted_index.promote | 109 |
| abstract_inverted_index.provide | 2 |
| abstract_inverted_index.ranking | 67, 122 |
| abstract_inverted_index.results | 75 |
| abstract_inverted_index.service | 5 |
| abstract_inverted_index.support | 95 |
| abstract_inverted_index.accuracy | 89 |
| abstract_inverted_index.accurate | 140 |
| abstract_inverted_index.content, | 13 |
| abstract_inverted_index.outcomes | 83 |
| abstract_inverted_index.perceive | 127 |
| abstract_inverted_index.promotes | 123 |
| abstract_inverted_index.proposed | 101 |
| abstract_inverted_index.ranking" | 105, 108 |
| abstract_inverted_index.recently | 100 |
| abstract_inverted_index.relevant | 12 |
| abstract_inverted_index.sampling | 65 |
| abstract_inverted_index.welfare. | 30 |
| abstract_inverted_index.N=1,500), | 54 |
| abstract_inverted_index.accuracy, | 113 |
| abstract_inverted_index.alignment | 39 |
| abstract_inverted_index.cognitive | 35 |
| abstract_inverted_index.consensus | 110 |
| abstract_inverted_index.filtering | 51 |
| abstract_inverted_index.polarized | 137 |
| abstract_inverted_index.potential | 32 |
| abstract_inverted_index.surfacing | 11 |
| abstract_inverted_index.two-wave, | 49 |
| abstract_inverted_index.algorithms | 1, 147 |
| abstract_inverted_index.approaches | 102 |
| abstract_inverted_index.behavioral | 33 |
| abstract_inverted_index.consensus. | 91 |
| abstract_inverted_index.controlled | 44 |
| abstract_inverted_index.experiment | 52 |
| abstract_inverted_index.favorably, | 128 |
| abstract_inverted_index.hypotheses | 97 |
| abstract_inverted_index.misaligned | 25 |
| abstract_inverted_index.objectives | 23 |
| abstract_inverted_index.observable | 77 |
| abstract_inverted_index.considered. | 148 |
| abstract_inverted_index.constructed | 86 |
| abstract_inverted_index.demonstrate | 56 |
| abstract_inverted_index.differences | 78 |
| abstract_inverted_index.consequences | 36 |
| abstract_inverted_index.experiments. | 45 |
| abstract_inverted_index.participants | 126, 133 |
| abstract_inverted_index.understudied | 42 |
| abstract_inverted_index.collaborative | 50 |
| abstract_inverted_index.personalized, | 120 |
| abstract_inverted_index.respectively. | 114 |
| abstract_inverted_index.statistically | 85 |
| abstract_inverted_index.preregistered, | 48 |
| abstract_inverted_index.simultaneously | 130 |
| abstract_inverted_index.Content-curating | 0 |
| abstract_inverted_index.``bridging-based | 104 |
| abstract_inverted_index.engagement-based | 121 |
| abstract_inverted_index.``intelligence-based | 107 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| citation_normalized_percentile.value | 0.37883222 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |