Current validation practice undermines surgical AI development Article Swipe

PDF

Annika Reinke , Z. Li , Minu D. Tizabi , Paulo André , Marcel Knopp , M. Rother , Inês Machado , Maria S. Altieri , Deepak Alapatt , Sophia Bano , Sebastian Bodenstedt , Oliver Burgert , Elvis C. S. Chen , Justin Collins , Olivier Colliot , Evangelia Christodoulou , Tobias Czempiel , Adrito Das , Reuben Docea , Daniel A. Donoho , Qi Dou , Jennifer A. Eckhoff , Sandy Engelhardt , Gábor Fichtinger , Philipp Fürnstahl , Pablo García Kilroy , Stamatia Giannarou , Stephen Gilbert , Ines Gockel , Patrick Godau , Jan Gödeke , Teodor Grantcharov , Tamás Haidegger , Alexander Hann , Makoto Hashizume , Charles Heitz , Rebecca Hisey , Hanna Hoffmann , Arnaud Huaulmé , Paul F. Jäger , Pierre Jannin , Anthony Jarc , R. Jena , Yueming Jin , Leo Joskowicz , Luc Joyeux , Max Kirchner , Axel Krieger , Gernot Kronreif , Kyle Lam , Stefan Laufer , Joël L. Lavanchy , G Lee , Robert H. Lim , Peng Liu , Hani J. Marcus , Pietro Mascagni , Ozanan R. Meireles , Beat P. Mueller , Lars Mündermann , Hirenkumar Nakawala , Nassir Navab , Abdourahmane Ndong , Juliane Neumann , Felix Nickel , Marco Nolden , Chinedu Innocent Nwoye , Noeun Oh , Nicolas Padoy , Thomas Pausch , Micha Pfeiffer , Tim Rädsch , Hongliang Ren , Nicola Rieke , Dominik Rivoir , Duygu Sarikaya , Samuel Schmidgall , Matthias Seibold , Silvia Seidlitz , Lalith Sharan , Jeffrey H. Siewerdsen , Vinkle Srivastav , Raphael Sznitman , Russell Taylor , Thuy Nuong Tran , Mathias Unberath , Fons van der Sommen , Martin Wagner , Amine Yamlahi , S. Kevin Zhou , Aneeq Zia , Amin Madani , Danail Stoyanov , Stefanie Speidel , D. Hashimoto , Fiona R. Kolbinger , Lena Maier‐Hein ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2511.03769

Surgical data science (SDS) is rapidly advancing, yet clinical adoption of artificial intelligence (AI) in surgery remains severely limited, with inadequate validation emerging as a key obstacle. In fact, existing validation practices often neglect the temporal and hierarchical structure of intraoperative videos, producing misleading, unstable, or clinically irrelevant results. In a pioneering, consensus-driven effort, we introduce the first comprehensive catalog of validation pitfalls in AI-based surgical video analysis that was derived from a multi-stage Delphi process with 91 international experts. The collected pitfalls span three categories: (1) data (e.g., incomplete annotation, spurious correlations), (2) metric selection and configuration (e.g., neglect of temporal stability, mismatch with clinical needs), and (3) aggregation and reporting (e.g., clinically uninformative aggregation, failure to account for frame dependencies in hierarchical data structures). A systematic review of surgical AI papers reveals that these pitfalls are widespread in current practice, with the majority of studies failing to account for temporal dynamics or hierarchical data structure, or relying on clinically uninformative metrics. Experiments on real surgical video datasets provide the first empirical evidence that ignoring temporal and hierarchical data structures can lead to drastic understatement of uncertainty, obscure critical failure modes, and even alter algorithm rankings. This work establishes a framework for the rigorous validation of surgical video analysis algorithms, providing a foundation for safe clinical translation, benchmarking, regulatory review, and future reporting standards in the field.

Related Topics

Cult (Religious Practice)

Practice (Learning Method)

Pegging (Sexual Practice)

List Of Current Indian Chief Ministers

List Of Current Ships Of The United States Navy

The Practice

Sati (Practice)

List Of Current Major League Baseball Stadiums

Current Theega

List Of One Piece Chapters (1016–Current)

High-Voltage Direct Current

Kuroshio Current

Concepts

No concepts available.

Metadata

Type: preprint
Landing Page: http://arxiv.org/abs/2511.03769
PDF: https://arxiv.org/pdf/2511.03769
OA Status: green
OpenAlex ID: https://openalex.org/W4416021902

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4416021902

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2511.03769

Digital Object Identifier
Title: Current validation practice undermines surgical AI development

Work title
Type: preprint

OpenAlex work type
Publication year: 2025

Year of publication
Publication date: 2025-11-05

Full publication date if available
Authors: Annika Reinke, Z. Li, Minu D. Tizabi, Paulo André, Marcel Knopp, M. Rother, Inês Machado, Maria S. Altieri, Deepak Alapatt, Sophia Bano, Sebastian Bodenstedt, Oliver Burgert, Elvis C. S. Chen, Justin Collins, Olivier Colliot, Evangelia Christodoulou, Tobias Czempiel, Adrito Das, Reuben Docea, Daniel A. Donoho, Qi Dou, Jennifer A. Eckhoff, Sandy Engelhardt, Gábor Fichtinger, Philipp Fürnstahl, Pablo García Kilroy, Stamatia Giannarou, Stephen Gilbert, Ines Gockel, Patrick Godau, Jan Gödeke, Teodor Grantcharov, Tamás Haidegger, Alexander Hann, Makoto Hashizume, Charles Heitz, Rebecca Hisey, Hanna Hoffmann, Arnaud Huaulmé, Paul F. Jäger, Pierre Jannin, Anthony Jarc, R. Jena, Yueming Jin, Leo Joskowicz, Luc Joyeux, Max Kirchner, Axel Krieger, Gernot Kronreif, Kyle Lam, Stefan Laufer, Joël L. Lavanchy, G Lee, Robert H. Lim, Peng Liu, Hani J. Marcus, Pietro Mascagni, Ozanan R. Meireles, Beat P. Mueller, Lars Mündermann, Hirenkumar Nakawala, Nassir Navab, Abdourahmane Ndong, Juliane Neumann, Felix Nickel, Marco Nolden, Chinedu Innocent Nwoye, Noeun Oh, Nicolas Padoy, Thomas Pausch, Micha Pfeiffer, Tim Rädsch, Hongliang Ren, Nicola Rieke, Dominik Rivoir, Duygu Sarikaya, Samuel Schmidgall, Matthias Seibold, Silvia Seidlitz, Lalith Sharan, Jeffrey H. Siewerdsen, Vinkle Srivastav, Raphael Sznitman, Russell Taylor, Thuy Nuong Tran, Mathias Unberath, Fons van der Sommen, Martin Wagner, Amine Yamlahi, S. Kevin Zhou, Aneeq Zia, Amin Madani, Danail Stoyanov, Stefanie Speidel, D. Hashimoto, Fiona R. Kolbinger, Lena Maier‐Hein

List of authors in order
Landing page: https://arxiv.org/abs/2511.03769

Publisher landing page
PDF URL: https://arxiv.org/pdf/2511.03769

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2511.03769

Direct OA link when available
Cited by: 0

Total citation count in OpenAlex

Full payload

id	https://openalex.org/W4416021902
doi	https://doi.org/10.48550/arxiv.2511.03769
ids.doi	https://doi.org/10.48550/arxiv.2511.03769
ids.openalex	https://openalex.org/W4416021902
fwci
type	preprint
title	Current validation practice undermines surgical AI development
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
is_xpac	False
apc_list
apc_paid
language
locations[0].id	pmh:oai:arXiv.org:2511.03769
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2511.03769
locations[0].version	submittedVersion
locations[0].raw_type	text
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2511.03769
locations[1].id	doi:10.48550/arxiv.2511.03769
locations[1].is_oa	True
locations[1].source.id	https://openalex.org/S4306400194
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	True
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	arXiv (Cornell University)
locations[1].source.host_organization	https://openalex.org/I205783295
locations[1].source.host_organization_name	Cornell University
locations[1].source.host_organization_lineage	https://openalex.org/I205783295
locations[1].license
locations[1].pdf_url
locations[1].version
locations[1].raw_type	article
locations[1].license_id
locations[1].is_accepted	False
locations[1].is_published
locations[1].raw_source_name
locations[1].landing_page_url	https://doi.org/10.48550/arxiv.2511.03769
indexed_in	arxiv, datacite
authorships[0].author.id	https://openalex.org/A5079787198
authorships[0].author.orcid	https://orcid.org/0000-0003-4363-1876
authorships[0].author.display_name	Annika Reinke
authorships[0].author_position	first
authorships[0].raw_author_name	Reinke, Annika
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5111674570
authorships[1].author.orcid
authorships[1].author.display_name	Z. Li
authorships[1].author_position	middle
authorships[1].raw_author_name	Li, Ziying O.
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5047698894
authorships[2].author.orcid	https://orcid.org/0000-0003-3687-6381
authorships[2].author.display_name	Minu D. Tizabi
authorships[2].author_position	middle
authorships[2].raw_author_name	Tizabi, Minu D.
authorships[2].is_corresponding	False
authorships[3].author.id	https://openalex.org/A5062629353
authorships[3].author.orcid	https://orcid.org/0000-0002-6276-4976
authorships[3].author.display_name	Paulo André
authorships[3].author_position	middle
authorships[3].raw_author_name	André, Pascaline
authorships[3].is_corresponding	False
authorships[4].author.id	https://openalex.org/A5111118801
authorships[4].author.orcid
authorships[4].author.display_name	Marcel Knopp
authorships[4].author_position	middle
authorships[4].raw_author_name	Knopp, Marcel
authorships[4].is_corresponding	False
authorships[5].author.id	https://openalex.org/A5111458805
authorships[5].author.orcid
authorships[5].author.display_name	M. Rother
authorships[5].author_position	middle
authorships[5].raw_author_name	Rother, Mika M.
authorships[5].is_corresponding	False
authorships[6].author.id	https://openalex.org/A5101745432
authorships[6].author.orcid	https://orcid.org/0000-0003-4160-9624
authorships[6].author.display_name	Inês Machado
authorships[6].author_position	middle
authorships[6].raw_author_name	Machado, Ines P.
authorships[6].is_corresponding	False
authorships[7].author.id	https://openalex.org/A5047632145
authorships[7].author.orcid	https://orcid.org/0000-0001-6976-1631
authorships[7].author.display_name	Maria S. Altieri
authorships[7].author_position	middle
authorships[7].raw_author_name	Altieri, Maria S.
authorships[7].is_corresponding	False
authorships[8].author.id	https://openalex.org/A5087529010
authorships[8].author.orcid	https://orcid.org/0000-0001-6223-3270
authorships[8].author.display_name	Deepak Alapatt
authorships[8].author_position	middle
authorships[8].raw_author_name	Alapatt, Deepak
authorships[8].is_corresponding	False
authorships[9].author.id	https://openalex.org/A5071609030
authorships[9].author.orcid	https://orcid.org/0000-0003-1329-4565
authorships[9].author.display_name	Sophia Bano
authorships[9].author_position	middle
authorships[9].raw_author_name	Bano, Sophia
authorships[9].is_corresponding	False
authorships[10].author.id	https://openalex.org/A5034437528
authorships[10].author.orcid	https://orcid.org/0000-0002-2203-9729
authorships[10].author.display_name	Sebastian Bodenstedt
authorships[10].author_position	middle
authorships[10].raw_author_name	Bodenstedt, Sebastian
authorships[10].is_corresponding	False
authorships[11].author.id	https://openalex.org/A5023657696
authorships[11].author.orcid	https://orcid.org/0000-0001-7118-4730
authorships[11].author.display_name	Oliver Burgert
authorships[11].author_position	middle
authorships[11].raw_author_name	Burgert, Oliver
authorships[11].is_corresponding	False
authorships[12].author.id	https://openalex.org/A5064673286
authorships[12].author.orcid	https://orcid.org/0000-0002-4198-3336
authorships[12].author.display_name	Elvis C. S. Chen
authorships[12].author_position	middle
authorships[12].raw_author_name	Chen, Elvis C. S.
authorships[12].is_corresponding	False
authorships[13].author.id	https://openalex.org/A5029817885
authorships[13].author.orcid	https://orcid.org/0000-0003-2228-1213
authorships[13].author.display_name	Justin Collins
authorships[13].author_position	middle
authorships[13].raw_author_name	Collins, Justin W.
authorships[13].is_corresponding	False
authorships[14].author.id	https://openalex.org/A5005778444
authorships[14].author.orcid	https://orcid.org/0000-0002-9836-654X
authorships[14].author.display_name	Olivier Colliot
authorships[14].author_position	middle
authorships[14].raw_author_name	Colliot, Olivier
authorships[14].is_corresponding	False
authorships[15].author.id	https://openalex.org/A5027201749
authorships[15].author.orcid	https://orcid.org/0000-0001-7900-5952
authorships[15].author.display_name	Evangelia Christodoulou
authorships[15].author_position	middle
authorships[15].raw_author_name	Christodoulou, Evangelia
authorships[15].is_corresponding	False
authorships[16].author.id	https://openalex.org/A5003203833
authorships[16].author.orcid	https://orcid.org/0000-0001-6863-9490
authorships[16].author.display_name	Tobias Czempiel
authorships[16].author_position	middle
authorships[16].raw_author_name	Czempiel, Tobias
authorships[16].is_corresponding	False
authorships[17].author.id	https://openalex.org/A5041912825
authorships[17].author.orcid	https://orcid.org/0000-0001-5682-9545
authorships[17].author.display_name	Adrito Das
authorships[17].author_position	middle
authorships[17].raw_author_name	Das, Adrito
authorships[17].is_corresponding	False
authorships[18].author.id	https://openalex.org/A5037268015
authorships[18].author.orcid	https://orcid.org/0009-0006-1825-7762
authorships[18].author.display_name	Reuben Docea
authorships[18].author_position	middle
authorships[18].raw_author_name	Docea, Reuben
authorships[18].is_corresponding	False
authorships[19].author.id	https://openalex.org/A5023033992
authorships[19].author.orcid	https://orcid.org/0000-0002-0531-1436
authorships[19].author.display_name	Daniel A. Donoho
authorships[19].author_position	middle
authorships[19].raw_author_name	Donoho, Daniel
authorships[19].is_corresponding	False
authorships[20].author.id	https://openalex.org/A5090516040
authorships[20].author.orcid	https://orcid.org/0000-0002-3416-9950
authorships[20].author.display_name	Qi Dou
authorships[20].author_position	middle
authorships[20].raw_author_name	Dou, Qi
authorships[20].is_corresponding	False
authorships[21].author.id	https://openalex.org/A5052009824
authorships[21].author.orcid	https://orcid.org/0000-0002-0805-8050
authorships[21].author.display_name	Jennifer A. Eckhoff
authorships[21].author_position	middle
authorships[21].raw_author_name	Eckhoff, Jennifer
authorships[21].is_corresponding	False
authorships[22].author.id	https://openalex.org/A5088137293
authorships[22].author.orcid	https://orcid.org/0000-0001-8816-7654
authorships[22].author.display_name	Sandy Engelhardt
authorships[22].author_position	middle
authorships[22].raw_author_name	Engelhardt, Sandy
authorships[22].is_corresponding	False
authorships[23].author.id	https://openalex.org/A5084753910
authorships[23].author.orcid	https://orcid.org/0000-0002-6354-262X
authorships[23].author.display_name	Gábor Fichtinger
authorships[23].author_position	middle
authorships[23].raw_author_name	Fichtinger, Gabor
authorships[23].is_corresponding	False
authorships[24].author.id	https://openalex.org/A5080643821
authorships[24].author.orcid	https://orcid.org/0000-0001-6484-6206
authorships[24].author.display_name	Philipp Fürnstahl
authorships[24].author_position	middle
authorships[24].raw_author_name	Fuernstahl, Philipp
authorships[24].is_corresponding	False
authorships[25].author.id	https://openalex.org/A5120303695
authorships[25].author.orcid
authorships[25].author.display_name	Pablo García Kilroy
authorships[25].author_position	middle
authorships[25].raw_author_name	Kilroy, Pablo García
authorships[25].is_corresponding	False
authorships[26].author.id	https://openalex.org/A5054387003
authorships[26].author.orcid	https://orcid.org/0000-0002-8745-1343
authorships[26].author.display_name	Stamatia Giannarou
authorships[26].author_position	middle
authorships[26].raw_author_name	Giannarou, Stamatia
authorships[26].is_corresponding	False
authorships[27].author.id	https://openalex.org/A5083800253
authorships[27].author.orcid	https://orcid.org/0000-0002-1997-1689
authorships[27].author.display_name	Stephen Gilbert
authorships[27].author_position	middle
authorships[27].raw_author_name	Gilbert, Stephen
authorships[27].is_corresponding	False
authorships[28].author.id	https://openalex.org/A5107392958
authorships[28].author.orcid
authorships[28].author.display_name	Ines Gockel
authorships[28].author_position	middle
authorships[28].raw_author_name	Gockel, Ines
authorships[28].is_corresponding	False
authorships[29].author.id	https://openalex.org/A5070335414
authorships[29].author.orcid	https://orcid.org/0000-0002-0365-7265
authorships[29].author.display_name	Patrick Godau
authorships[29].author_position	middle
authorships[29].raw_author_name	Godau, Patrick
authorships[29].is_corresponding	False
authorships[30].author.id	https://openalex.org/A5120303696
authorships[30].author.orcid
authorships[30].author.display_name	Jan Gödeke
authorships[30].author_position	middle
authorships[30].raw_author_name	Gödeke, Jan
authorships[30].is_corresponding	False
authorships[31].author.id	https://openalex.org/A5022164743
authorships[31].author.orcid	https://orcid.org/0000-0002-3424-5618
authorships[31].author.display_name	Teodor Grantcharov
authorships[31].author_position	middle
authorships[31].raw_author_name	Grantcharov, Teodor P.
authorships[31].is_corresponding	False
authorships[32].author.id	https://openalex.org/A5068708902
authorships[32].author.orcid	https://orcid.org/0000-0003-1402-1139
authorships[32].author.display_name	Tamás Haidegger
authorships[32].author_position	middle
authorships[32].raw_author_name	Haidegger, Tamas
authorships[32].is_corresponding	False
authorships[33].author.id	https://openalex.org/A5051168420
authorships[33].author.orcid	https://orcid.org/0000-0001-8035-3559
authorships[33].author.display_name	Alexander Hann
authorships[33].author_position	middle
authorships[33].raw_author_name	Hann, Alexander
authorships[33].is_corresponding	False
authorships[34].author.id	https://openalex.org/A5109896593
authorships[34].author.orcid
authorships[34].author.display_name	Makoto Hashizume
authorships[34].author_position	middle
authorships[34].raw_author_name	Hashizume, Makoto
authorships[34].is_corresponding	False
authorships[35].author.id	https://openalex.org/A5119722582
authorships[35].author.orcid
authorships[35].author.display_name	Charles Heitz
authorships[35].author_position	middle
authorships[35].raw_author_name	Heitz, Charles
authorships[35].is_corresponding	False
authorships[36].author.id	https://openalex.org/A5084593138
authorships[36].author.orcid	https://orcid.org/0000-0002-1036-5789
authorships[36].author.display_name	Rebecca Hisey
authorships[36].author_position	middle
authorships[36].raw_author_name	Hisey, Rebecca
authorships[36].is_corresponding	False
authorships[37].author.id	https://openalex.org/A5023506121
authorships[37].author.orcid
authorships[37].author.display_name	Hanna Hoffmann
authorships[37].author_position	middle
authorships[37].raw_author_name	Hoffmann, Hanna
authorships[37].is_corresponding	False
authorships[38].author.id	https://openalex.org/A5046488947
authorships[38].author.orcid	https://orcid.org/0000-0002-7844-5259
authorships[38].author.display_name	Arnaud Huaulmé
authorships[38].author_position	middle
authorships[38].raw_author_name	Huaulmé, Arnaud
authorships[38].is_corresponding	False
authorships[39].author.id	https://openalex.org/A5012942347
authorships[39].author.orcid	https://orcid.org/0000-0002-6243-2568
authorships[39].author.display_name	Paul F. Jäger
authorships[39].author_position	middle
authorships[39].raw_author_name	Jäger, Paul F.
authorships[39].is_corresponding	False
authorships[40].author.id	https://openalex.org/A5029098035
authorships[40].author.orcid	https://orcid.org/0000-0002-7415-071X
authorships[40].author.display_name	Pierre Jannin
authorships[40].author_position	middle
authorships[40].raw_author_name	Jannin, Pierre
authorships[40].is_corresponding	False
authorships[41].author.id	https://openalex.org/A5083764444
authorships[41].author.orcid	https://orcid.org/0000-0002-9845-841X
authorships[41].author.display_name	Anthony Jarc
authorships[41].author_position	middle
authorships[41].raw_author_name	Jarc, Anthony
authorships[41].is_corresponding	False
authorships[42].author.id	https://openalex.org/A5059681293
authorships[42].author.orcid	https://orcid.org/0000-0002-3803-5968
authorships[42].author.display_name	R. Jena
authorships[42].author_position	middle
authorships[42].raw_author_name	Jena, Rohit
authorships[42].is_corresponding	False
authorships[43].author.id	https://openalex.org/A5050163233
authorships[43].author.orcid	https://orcid.org/0000-0003-3775-3877
authorships[43].author.display_name	Yueming Jin
authorships[43].author_position	middle
authorships[43].raw_author_name	Jin, Yueming
authorships[43].is_corresponding	False
authorships[44].author.id	https://openalex.org/A5016547705
authorships[44].author.orcid	https://orcid.org/0000-0002-3010-4770
authorships[44].author.display_name	Leo Joskowicz
authorships[44].author_position	middle
authorships[44].raw_author_name	Joskowicz, Leo
authorships[44].is_corresponding	False
authorships[45].author.id	https://openalex.org/A5054646328
authorships[45].author.orcid	https://orcid.org/0000-0001-7331-6354
authorships[45].author.display_name	Luc Joyeux
authorships[45].author_position	middle
authorships[45].raw_author_name	Joyeux, Luc
authorships[45].is_corresponding	False
authorships[46].author.id	https://openalex.org/A5036243537
authorships[46].author.orcid	https://orcid.org/0000-0001-8798-2446
authorships[46].author.display_name	Max Kirchner
authorships[46].author_position	middle
authorships[46].raw_author_name	Kirchner, Max
authorships[46].is_corresponding	False
authorships[47].author.id	https://openalex.org/A5008331040
authorships[47].author.orcid	https://orcid.org/0000-0001-8169-075X
authorships[47].author.display_name	Axel Krieger
authorships[47].author_position	middle
authorships[47].raw_author_name	Krieger, Axel
authorships[47].is_corresponding	False
authorships[48].author.id	https://openalex.org/A5026873697
authorships[48].author.orcid	https://orcid.org/0000-0003-2675-2190
authorships[48].author.display_name	Gernot Kronreif
authorships[48].author_position	middle
authorships[48].raw_author_name	Kronreif, Gernot
authorships[48].is_corresponding	False
authorships[49].author.id	https://openalex.org/A5055578281
authorships[49].author.orcid	https://orcid.org/0000-0001-6407-4912
authorships[49].author.display_name	Kyle Lam
authorships[49].author_position	middle
authorships[49].raw_author_name	Lam, Kyle
authorships[49].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2511.03769
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-11-08T00:00:00
display_name	Current validation practice undermines surgical AI development
has_fulltext	False
is_retracted	False
updated_date	2025-11-09T23:09:16.995542
primary_topic
cited_by_count	0
locations_count	2
best_oa_location.id	pmh:oai:arXiv.org:2511.03769
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2511.03769
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2511.03769
primary_location.id	pmh:oai:arXiv.org:2511.03769
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2511.03769
primary_location.version	submittedVersion
primary_location.raw_type	text
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2511.03769
publication_date	2025-11-05
publication_year	2025
referenced_works_count	0
abstract_inverted_index.A	126
abstract_inverted_index.a	24, 50, 72, 200, 212
abstract_inverted_index.91	77
abstract_inverted_index.AI	131
abstract_inverted_index.In	27, 49
abstract_inverted_index.as	23
abstract_inverted_index.in	14, 63, 122, 139, 225
abstract_inverted_index.is	4
abstract_inverted_index.of	10, 39, 60, 100, 129, 145, 186, 206
abstract_inverted_index.on	159, 164
abstract_inverted_index.or	45, 153, 157
abstract_inverted_index.to	117, 148, 183
abstract_inverted_index.we	54
abstract_inverted_index.(1)	86
abstract_inverted_index.(2)	93
abstract_inverted_index.(3)	108
abstract_inverted_index.The	80
abstract_inverted_index.and	36, 96, 107, 110, 177, 192, 221
abstract_inverted_index.are	137
abstract_inverted_index.can	181
abstract_inverted_index.for	119, 150, 202, 214
abstract_inverted_index.key	25
abstract_inverted_index.the	34, 56, 143, 170, 203, 226
abstract_inverted_index.was	69
abstract_inverted_index.yet	7
abstract_inverted_index.(AI)	13
abstract_inverted_index.This	197
abstract_inverted_index.data	1, 87, 124, 155, 179
abstract_inverted_index.even	193
abstract_inverted_index.from	71
abstract_inverted_index.lead	182
abstract_inverted_index.real	165
abstract_inverted_index.safe	215
abstract_inverted_index.span	83
abstract_inverted_index.that	68, 134, 174
abstract_inverted_index.with	19, 76, 104, 142
abstract_inverted_index.work	198
abstract_inverted_index.(SDS)	3
abstract_inverted_index.alter	194
abstract_inverted_index.fact,	28
abstract_inverted_index.first	57, 171
abstract_inverted_index.frame	120
abstract_inverted_index.often	32
abstract_inverted_index.these	135
abstract_inverted_index.three	84
abstract_inverted_index.video	66, 167, 208
abstract_inverted_index.(e.g.,	88, 98, 112
abstract_inverted_index.Delphi	74
abstract_inverted_index.field.	227
abstract_inverted_index.future	222
abstract_inverted_index.metric	94
abstract_inverted_index.modes,	191
abstract_inverted_index.papers	132
abstract_inverted_index.review	128
abstract_inverted_index.account	118, 149
abstract_inverted_index.catalog	59
abstract_inverted_index.current	140
abstract_inverted_index.derived	70
abstract_inverted_index.drastic	184
abstract_inverted_index.effort,	53
abstract_inverted_index.failing	147
abstract_inverted_index.failure	116, 190
abstract_inverted_index.needs),	106
abstract_inverted_index.neglect	33, 99
abstract_inverted_index.obscure	188
abstract_inverted_index.process	75
abstract_inverted_index.provide	169
abstract_inverted_index.rapidly	5
abstract_inverted_index.relying	158
abstract_inverted_index.remains	16
abstract_inverted_index.reveals	133
abstract_inverted_index.review,	220
abstract_inverted_index.science	2
abstract_inverted_index.studies	146
abstract_inverted_index.surgery	15
abstract_inverted_index.videos,	41
abstract_inverted_index.AI-based	64
abstract_inverted_index.Surgical	0
abstract_inverted_index.adoption	9
abstract_inverted_index.analysis	67, 209
abstract_inverted_index.clinical	8, 105, 216
abstract_inverted_index.critical	189
abstract_inverted_index.datasets	168
abstract_inverted_index.dynamics	152
abstract_inverted_index.emerging	22
abstract_inverted_index.evidence	173
abstract_inverted_index.existing	29
abstract_inverted_index.experts.	79
abstract_inverted_index.ignoring	175
abstract_inverted_index.limited,	18
abstract_inverted_index.majority	144
abstract_inverted_index.metrics.	162
abstract_inverted_index.mismatch	103
abstract_inverted_index.pitfalls	62, 82, 136
abstract_inverted_index.results.	48
abstract_inverted_index.rigorous	204
abstract_inverted_index.severely	17
abstract_inverted_index.spurious	91
abstract_inverted_index.surgical	65, 130, 166, 207
abstract_inverted_index.temporal	35, 101, 151, 176
abstract_inverted_index.algorithm	195
abstract_inverted_index.collected	81
abstract_inverted_index.empirical	172
abstract_inverted_index.framework	201
abstract_inverted_index.introduce	55
abstract_inverted_index.obstacle.	26
abstract_inverted_index.practice,	141
abstract_inverted_index.practices	31
abstract_inverted_index.producing	42
abstract_inverted_index.providing	211
abstract_inverted_index.rankings.	196
abstract_inverted_index.reporting	111, 223
abstract_inverted_index.selection	95
abstract_inverted_index.standards	224
abstract_inverted_index.structure	38
abstract_inverted_index.unstable,	44
abstract_inverted_index.advancing,	6
abstract_inverted_index.artificial	11
abstract_inverted_index.clinically	46, 113, 160
abstract_inverted_index.foundation	213
abstract_inverted_index.inadequate	20
abstract_inverted_index.incomplete	89
abstract_inverted_index.irrelevant	47
abstract_inverted_index.regulatory	219
abstract_inverted_index.stability,	102
abstract_inverted_index.structure,	156
abstract_inverted_index.structures	180
abstract_inverted_index.systematic	127
abstract_inverted_index.validation	21, 30, 61, 205
abstract_inverted_index.widespread	138
abstract_inverted_index.Experiments	163
abstract_inverted_index.aggregation	109
abstract_inverted_index.algorithms,	210
abstract_inverted_index.annotation,	90
abstract_inverted_index.categories:	85
abstract_inverted_index.establishes	199
abstract_inverted_index.misleading,	43
abstract_inverted_index.multi-stage	73
abstract_inverted_index.pioneering,	51
abstract_inverted_index.aggregation,	115
abstract_inverted_index.dependencies	121
abstract_inverted_index.hierarchical	37, 123, 154, 178
abstract_inverted_index.intelligence	12
abstract_inverted_index.structures).	125
abstract_inverted_index.translation,	217
abstract_inverted_index.uncertainty,	187
abstract_inverted_index.benchmarking,	218
abstract_inverted_index.comprehensive	58
abstract_inverted_index.configuration	97
abstract_inverted_index.international	78
abstract_inverted_index.uninformative	114, 161
abstract_inverted_index.correlations),	92
abstract_inverted_index.intraoperative	40
abstract_inverted_index.understatement	185
abstract_inverted_index.consensus-driven	52
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	97
citation_normalized_percentile