nnInteractive: Redefining 3D Promptable Segmentation Article Swipe
Fabian Isensee
,
Maximilian Rokuss
,
Lars Krämer
,
Stefan Dinkelacker
,
Ashis Ravindran
,
Florian Stritzke
,
Benjamin Hamm
,
Tassilo Wald
,
Moritz Langenberg
,
Constantin Ulrich
,
Jonathan Deissler
,
Ralf Floca
,
Klaus Maier‐Hein
·
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2503.08373
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2503.08373
Accurate and efficient 3D segmentation is essential for both clinical and research applications. While foundation models like SAM have revolutionized interactive segmentation, their 2D design and domain shift limitations make them ill-suited for 3D medical images. Current adaptations address some of these challenges but remain limited, either lacking volumetric awareness, offering restricted interactivity, or supporting only a small set of structures and modalities. Usability also remains a challenge, as current tools are rarely integrated into established imaging platforms and often rely on cumbersome web-based interfaces with restricted functionality. We introduce nnInteractive, the first comprehensive 3D interactive open-set segmentation method. It supports diverse prompts-including points, scribbles, boxes, and a novel lasso prompt-while leveraging intuitive 2D interactions to generate full 3D segmentations. Trained on 120+ diverse volumetric 3D datasets (CT, MRI, PET, 3D Microscopy, etc.), nnInteractive sets a new state-of-the-art in accuracy, adaptability, and usability. Crucially, it is the first method integrated into widely used image viewers (e.g., Napari, MITK), ensuring broad accessibility for real-world clinical and research applications. Extensive benchmarking demonstrates that nnInteractive far surpasses existing methods, setting a new standard for AI-driven interactive 3D segmentation. nnInteractive is publicly available: https://github.com/MIC-DKFZ/napari-nninteractive (Napari plugin), https://www.mitk.org/MITK-nnInteractive (MITK integration), https://github.com/MIC-DKFZ/nnInteractive (Python backend).
Related Topics
Concepts
No concepts available.
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2503.08373
- https://arxiv.org/pdf/2503.08373
- OA Status
- green
- Cited By
- 1
- OpenAlex ID
- https://openalex.org/W4414578049
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4414578049Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2503.08373Digital Object Identifier
- Title
-
nnInteractive: Redefining 3D Promptable SegmentationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-03-11Full publication date if available
- Authors
-
Fabian Isensee, Maximilian Rokuss, Lars Krämer, Stefan Dinkelacker, Ashis Ravindran, Florian Stritzke, Benjamin Hamm, Tassilo Wald, Moritz Langenberg, Constantin Ulrich, Jonathan Deissler, Ralf Floca, Klaus Maier‐HeinList of authors in order
- Landing page
-
https://arxiv.org/abs/2503.08373Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2503.08373Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2503.08373Direct OA link when available
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1Per-year citation counts (last 5 years)
Full payload
| id | https://openalex.org/W4414578049 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2503.08373 |
| ids.doi | https://doi.org/10.48550/arxiv.2503.08373 |
| ids.openalex | https://openalex.org/W4414578049 |
| fwci | |
| type | preprint |
| title | nnInteractive: Redefining 3D Promptable Segmentation |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10481 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.375 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1704 |
| topics[0].subfield.display_name | Computer Graphics and Computer-Aided Design |
| topics[0].display_name | Computer Graphics and Visualization Techniques |
| topics[1].id | https://openalex.org/T10719 |
| topics[1].field.id | https://openalex.org/fields/22 |
| topics[1].field.display_name | Engineering |
| topics[1].score | 0.33970001339912415 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2206 |
| topics[1].subfield.display_name | Computational Mechanics |
| topics[1].display_name | 3D Shape Modeling and Analysis |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2503.08373 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2503.08373 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2503.08373 |
| locations[1].id | doi:10.48550/arxiv.2503.08373 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2503.08373 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5072647800 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-3519-5886 |
| authorships[0].author.display_name | Fabian Isensee |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Isensee, Fabian |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5002648077 |
| authorships[1].author.orcid | https://orcid.org/0009-0004-4560-0760 |
| authorships[1].author.display_name | Maximilian Rokuss |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Rokuss, Maximilian |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5012097326 |
| authorships[2].author.orcid | https://orcid.org/0009-0001-3156-0065 |
| authorships[2].author.display_name | Lars Krämer |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Krämer, Lars |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5032556332 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Stefan Dinkelacker |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Dinkelacker, Stefan |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5005052990 |
| authorships[4].author.orcid | https://orcid.org/0000-0003-2942-6235 |
| authorships[4].author.display_name | Ashis Ravindran |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Ravindran, Ashis |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5119752598 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Florian Stritzke |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Stritzke, Florian |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5104269737 |
| authorships[6].author.orcid | https://orcid.org/0009-0003-4818-8700 |
| authorships[6].author.display_name | Benjamin Hamm |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Hamm, Benjamin |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5037975935 |
| authorships[7].author.orcid | https://orcid.org/0009-0007-5222-2683 |
| authorships[7].author.display_name | Tassilo Wald |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Wald, Tassilo |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5119752599 |
| authorships[8].author.orcid | |
| authorships[8].author.display_name | Moritz Langenberg |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Langenberg, Moritz |
| authorships[8].is_corresponding | False |
| authorships[9].author.id | https://openalex.org/A5052032756 |
| authorships[9].author.orcid | |
| authorships[9].author.display_name | Constantin Ulrich |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Ulrich, Constantin |
| authorships[9].is_corresponding | False |
| authorships[10].author.id | https://openalex.org/A5107179545 |
| authorships[10].author.orcid | |
| authorships[10].author.display_name | Jonathan Deissler |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Deissler, Jonathan |
| authorships[10].is_corresponding | False |
| authorships[11].author.id | https://openalex.org/A5056850855 |
| authorships[11].author.orcid | https://orcid.org/0000-0003-3218-3377 |
| authorships[11].author.display_name | Ralf Floca |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Floca, Ralf |
| authorships[11].is_corresponding | False |
| authorships[12].author.id | https://openalex.org/A5027292126 |
| authorships[12].author.orcid | https://orcid.org/0000-0002-6626-2463 |
| authorships[12].author.display_name | Klaus Maier‐Hein |
| authorships[12].author_position | last |
| authorships[12].raw_author_name | Maier-Hein, Klaus |
| authorships[12].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2503.08373 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | nnInteractive: Redefining 3D Promptable Segmentation |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10481 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.375 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1704 |
| primary_topic.subfield.display_name | Computer Graphics and Computer-Aided Design |
| primary_topic.display_name | Computer Graphics and Visualization Techniques |
| cited_by_count | 1 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2503.08373 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2503.08373 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2503.08373 |
| primary_location.id | pmh:oai:arXiv.org:2503.08373 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2503.08373 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2503.08373 |
| publication_date | 2025-03-11 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 56, 66, 107, 135, 177 |
| abstract_inverted_index.2D | 23, 113 |
| abstract_inverted_index.3D | 3, 33, 94, 118, 125, 130, 183 |
| abstract_inverted_index.It | 99 |
| abstract_inverted_index.We | 88 |
| abstract_inverted_index.as | 68 |
| abstract_inverted_index.in | 138 |
| abstract_inverted_index.is | 5, 145, 186 |
| abstract_inverted_index.it | 144 |
| abstract_inverted_index.of | 40, 59 |
| abstract_inverted_index.on | 81, 121 |
| abstract_inverted_index.or | 53 |
| abstract_inverted_index.to | 115 |
| abstract_inverted_index.SAM | 17 |
| abstract_inverted_index.and | 1, 10, 25, 61, 78, 106, 141, 164 |
| abstract_inverted_index.are | 71 |
| abstract_inverted_index.but | 43 |
| abstract_inverted_index.far | 172 |
| abstract_inverted_index.for | 7, 32, 161, 180 |
| abstract_inverted_index.new | 136, 178 |
| abstract_inverted_index.set | 58 |
| abstract_inverted_index.the | 91, 146 |
| abstract_inverted_index.(CT, | 127 |
| abstract_inverted_index.120+ | 122 |
| abstract_inverted_index.MRI, | 128 |
| abstract_inverted_index.PET, | 129 |
| abstract_inverted_index.also | 64 |
| abstract_inverted_index.both | 8 |
| abstract_inverted_index.full | 117 |
| abstract_inverted_index.have | 18 |
| abstract_inverted_index.into | 74, 150 |
| abstract_inverted_index.like | 16 |
| abstract_inverted_index.make | 29 |
| abstract_inverted_index.only | 55 |
| abstract_inverted_index.rely | 80 |
| abstract_inverted_index.sets | 134 |
| abstract_inverted_index.some | 39 |
| abstract_inverted_index.that | 170 |
| abstract_inverted_index.them | 30 |
| abstract_inverted_index.used | 152 |
| abstract_inverted_index.with | 85 |
| abstract_inverted_index.(MITK | 193 |
| abstract_inverted_index.While | 13 |
| abstract_inverted_index.broad | 159 |
| abstract_inverted_index.first | 92, 147 |
| abstract_inverted_index.image | 153 |
| abstract_inverted_index.lasso | 109 |
| abstract_inverted_index.novel | 108 |
| abstract_inverted_index.often | 79 |
| abstract_inverted_index.shift | 27 |
| abstract_inverted_index.small | 57 |
| abstract_inverted_index.their | 22 |
| abstract_inverted_index.these | 41 |
| abstract_inverted_index.tools | 70 |
| abstract_inverted_index.(e.g., | 155 |
| abstract_inverted_index.MITK), | 157 |
| abstract_inverted_index.boxes, | 105 |
| abstract_inverted_index.design | 24 |
| abstract_inverted_index.domain | 26 |
| abstract_inverted_index.either | 46 |
| abstract_inverted_index.etc.), | 132 |
| abstract_inverted_index.method | 148 |
| abstract_inverted_index.models | 15 |
| abstract_inverted_index.rarely | 72 |
| abstract_inverted_index.remain | 44 |
| abstract_inverted_index.widely | 151 |
| abstract_inverted_index.(Napari | 190 |
| abstract_inverted_index.(Python | 196 |
| abstract_inverted_index.Current | 36 |
| abstract_inverted_index.Napari, | 156 |
| abstract_inverted_index.Trained | 120 |
| abstract_inverted_index.address | 38 |
| abstract_inverted_index.current | 69 |
| abstract_inverted_index.diverse | 101, 123 |
| abstract_inverted_index.images. | 35 |
| abstract_inverted_index.imaging | 76 |
| abstract_inverted_index.lacking | 47 |
| abstract_inverted_index.medical | 34 |
| abstract_inverted_index.method. | 98 |
| abstract_inverted_index.points, | 103 |
| abstract_inverted_index.remains | 65 |
| abstract_inverted_index.setting | 176 |
| abstract_inverted_index.viewers | 154 |
| abstract_inverted_index.Accurate | 0 |
| abstract_inverted_index.clinical | 9, 163 |
| abstract_inverted_index.datasets | 126 |
| abstract_inverted_index.ensuring | 158 |
| abstract_inverted_index.existing | 174 |
| abstract_inverted_index.generate | 116 |
| abstract_inverted_index.limited, | 45 |
| abstract_inverted_index.methods, | 175 |
| abstract_inverted_index.offering | 50 |
| abstract_inverted_index.open-set | 96 |
| abstract_inverted_index.plugin), | 191 |
| abstract_inverted_index.publicly | 187 |
| abstract_inverted_index.research | 11, 165 |
| abstract_inverted_index.standard | 179 |
| abstract_inverted_index.supports | 100 |
| abstract_inverted_index.AI-driven | 181 |
| abstract_inverted_index.Extensive | 167 |
| abstract_inverted_index.Usability | 63 |
| abstract_inverted_index.accuracy, | 139 |
| abstract_inverted_index.backend). | 197 |
| abstract_inverted_index.efficient | 2 |
| abstract_inverted_index.essential | 6 |
| abstract_inverted_index.introduce | 89 |
| abstract_inverted_index.intuitive | 112 |
| abstract_inverted_index.platforms | 77 |
| abstract_inverted_index.surpasses | 173 |
| abstract_inverted_index.web-based | 83 |
| abstract_inverted_index.Crucially, | 143 |
| abstract_inverted_index.available: | 188 |
| abstract_inverted_index.awareness, | 49 |
| abstract_inverted_index.challenge, | 67 |
| abstract_inverted_index.challenges | 42 |
| abstract_inverted_index.cumbersome | 82 |
| abstract_inverted_index.foundation | 14 |
| abstract_inverted_index.ill-suited | 31 |
| abstract_inverted_index.integrated | 73, 149 |
| abstract_inverted_index.interfaces | 84 |
| abstract_inverted_index.leveraging | 111 |
| abstract_inverted_index.real-world | 162 |
| abstract_inverted_index.restricted | 51, 86 |
| abstract_inverted_index.scribbles, | 104 |
| abstract_inverted_index.structures | 60 |
| abstract_inverted_index.supporting | 54 |
| abstract_inverted_index.usability. | 142 |
| abstract_inverted_index.volumetric | 48, 124 |
| abstract_inverted_index.Microscopy, | 131 |
| abstract_inverted_index.adaptations | 37 |
| abstract_inverted_index.established | 75 |
| abstract_inverted_index.interactive | 20, 95, 182 |
| abstract_inverted_index.limitations | 28 |
| abstract_inverted_index.modalities. | 62 |
| abstract_inverted_index.benchmarking | 168 |
| abstract_inverted_index.demonstrates | 169 |
| abstract_inverted_index.interactions | 114 |
| abstract_inverted_index.prompt-while | 110 |
| abstract_inverted_index.segmentation | 4, 97 |
| abstract_inverted_index.accessibility | 160 |
| abstract_inverted_index.adaptability, | 140 |
| abstract_inverted_index.applications. | 12, 166 |
| abstract_inverted_index.comprehensive | 93 |
| abstract_inverted_index.integration), | 194 |
| abstract_inverted_index.nnInteractive | 133, 171, 185 |
| abstract_inverted_index.segmentation, | 21 |
| abstract_inverted_index.segmentation. | 184 |
| abstract_inverted_index.functionality. | 87 |
| abstract_inverted_index.interactivity, | 52 |
| abstract_inverted_index.nnInteractive, | 90 |
| abstract_inverted_index.revolutionized | 19 |
| abstract_inverted_index.segmentations. | 119 |
| abstract_inverted_index.state-of-the-art | 137 |
| abstract_inverted_index.prompts-including | 102 |
| abstract_inverted_index.https://www.mitk.org/MITK-nnInteractive | 192 |
| abstract_inverted_index.https://github.com/MIC-DKFZ/nnInteractive | 195 |
| abstract_inverted_index.https://github.com/MIC-DKFZ/napari-nninteractive | 189 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 13 |
| citation_normalized_percentile |