MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis Article Swipe
Tianyu Wang
,
Jianming Zhang
,
Haitian Zheng
,
Zhihong Ding
,
Scott Cohen
,
Zhe Lin
,
Wei Xiong
,
Chi‐Wing Fu
,
Luis Figueroa
,
Soo Ye Kim
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2412.02635
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2412.02635
Shadows are often under-considered or even ignored in image editing applications, limiting the realism of the edited results. In this paper, we introduce MetaShadow, a three-in-one versatile framework that enables detection, removal, and controllable synthesis of shadows in natural images in an object-centered fashion. MetaShadow combines the strengths of two cooperative components: Shadow Analyzer, for object-centered shadow detection and removal, and Shadow Synthesizer, for reference-based controllable shadow synthesis. Notably, we optimize the learning of the intermediate features from Shadow Analyzer to guide Shadow Synthesizer to generate more realistic shadows that blend seamlessly with the scene. Extensive evaluations on multiple shadow benchmark datasets show significant improvements of MetaShadow over the existing state-of-the-art methods on object-centered shadow detection, removal, and synthesis. MetaShadow excels in image-editing tasks such as object removal, relocation, and insertion, pushing the boundaries of object-centered image editing.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2412.02635
- https://arxiv.org/pdf/2412.02635
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4405035815
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4405035815Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2412.02635Digital Object Identifier
- Title
-
MetaShadow: Object-Centered Shadow Detection, Removal, and SynthesisWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-12-03Full publication date if available
- Authors
-
Tianyu Wang, Jianming Zhang, Haitian Zheng, Zhihong Ding, Scott Cohen, Zhe Lin, Wei Xiong, Chi‐Wing Fu, Luis Figueroa, Soo Ye KimList of authors in order
- Landing page
-
https://arxiv.org/abs/2412.02635Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2412.02635Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2412.02635Direct OA link when available
- Concepts
-
Shadow (psychology), Object (grammar), Computer vision, Computer science, Artificial intelligence, Psychology, PsychoanalysisTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4405035815 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2412.02635 |
| ids.doi | https://doi.org/10.48550/arxiv.2412.02635 |
| ids.openalex | https://openalex.org/W4405035815 |
| fwci | |
| type | preprint |
| title | MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12357 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.7652000188827515 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1707 |
| topics[0].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[0].display_name | Digital Media Forensic Detection |
| topics[1].id | https://openalex.org/T11512 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.7592999935150146 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Anomaly Detection Techniques and Applications |
| topics[2].id | https://openalex.org/T12034 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.7271000146865845 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1710 |
| topics[2].subfield.display_name | Information Systems |
| topics[2].display_name | Digital and Cyber Forensics |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C117797892 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8028678894042969 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q286363 |
| concepts[0].display_name | Shadow (psychology) |
| concepts[1].id | https://openalex.org/C2781238097 |
| concepts[1].level | 2 |
| concepts[1].score | 0.5162353515625 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q175026 |
| concepts[1].display_name | Object (grammar) |
| concepts[2].id | https://openalex.org/C31972630 |
| concepts[2].level | 1 |
| concepts[2].score | 0.4989907741546631 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[2].display_name | Computer vision |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.43951383233070374 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C154945302 |
| concepts[4].level | 1 |
| concepts[4].score | 0.41524362564086914 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[4].display_name | Artificial intelligence |
| concepts[5].id | https://openalex.org/C15744967 |
| concepts[5].level | 0 |
| concepts[5].score | 0.21962767839431763 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[5].display_name | Psychology |
| concepts[6].id | https://openalex.org/C11171543 |
| concepts[6].level | 1 |
| concepts[6].score | 0.05113023519515991 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q41630 |
| concepts[6].display_name | Psychoanalysis |
| keywords[0].id | https://openalex.org/keywords/shadow |
| keywords[0].score | 0.8028678894042969 |
| keywords[0].display_name | Shadow (psychology) |
| keywords[1].id | https://openalex.org/keywords/object |
| keywords[1].score | 0.5162353515625 |
| keywords[1].display_name | Object (grammar) |
| keywords[2].id | https://openalex.org/keywords/computer-vision |
| keywords[2].score | 0.4989907741546631 |
| keywords[2].display_name | Computer vision |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.43951383233070374 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[4].score | 0.41524362564086914 |
| keywords[4].display_name | Artificial intelligence |
| keywords[5].id | https://openalex.org/keywords/psychology |
| keywords[5].score | 0.21962767839431763 |
| keywords[5].display_name | Psychology |
| keywords[6].id | https://openalex.org/keywords/psychoanalysis |
| keywords[6].score | 0.05113023519515991 |
| keywords[6].display_name | Psychoanalysis |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2412.02635 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2412.02635 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2412.02635 |
| locations[1].id | doi:10.48550/arxiv.2412.02635 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2412.02635 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5100417433 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-9244-8798 |
| authorships[0].author.display_name | Tianyu Wang |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Wang, Tianyu |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5036510129 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-9954-6294 |
| authorships[1].author.display_name | Jianming Zhang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Zhang, Jianming |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5016267591 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-0415-1765 |
| authorships[2].author.display_name | Haitian Zheng |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Zheng, Haitian |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5075738664 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Zhihong Ding |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Ding, Zhihong |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5055156362 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-3459-6899 |
| authorships[4].author.display_name | Scott Cohen |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Cohen, Scott |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5101564904 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-1154-9907 |
| authorships[5].author.display_name | Zhe Lin |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Lin, Zhe |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5100359241 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-3017-9895 |
| authorships[6].author.display_name | Wei Xiong |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Xiong, Wei |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5054382056 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-5238-593X |
| authorships[7].author.display_name | Chi‐Wing Fu |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Fu, Chi-Wing |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5026777424 |
| authorships[8].author.orcid | |
| authorships[8].author.display_name | Luis Figueroa |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Figueroa, Luis |
| authorships[8].is_corresponding | False |
| authorships[9].author.id | https://openalex.org/A5016563944 |
| authorships[9].author.orcid | |
| authorships[9].author.display_name | Soo Ye Kim |
| authorships[9].author_position | last |
| authorships[9].raw_author_name | Kim, Soo Ye |
| authorships[9].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2412.02635 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12357 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.7652000188827515 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1707 |
| primary_topic.subfield.display_name | Computer Vision and Pattern Recognition |
| primary_topic.display_name | Digital Media Forensic Detection |
| related_works | https://openalex.org/W2772917594, https://openalex.org/W2036807459, https://openalex.org/W2058170566, https://openalex.org/W2755342338, https://openalex.org/W2166024367, https://openalex.org/W3116076068, https://openalex.org/W2229312674, https://openalex.org/W2951359407, https://openalex.org/W2079911747, https://openalex.org/W1969923398 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2412.02635 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2412.02635 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2412.02635 |
| primary_location.id | pmh:oai:arXiv.org:2412.02635 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2412.02635 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2412.02635 |
| publication_date | 2024-12-03 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 24 |
| abstract_inverted_index.In | 18 |
| abstract_inverted_index.an | 41 |
| abstract_inverted_index.as | 125 |
| abstract_inverted_index.in | 7, 37, 40, 121 |
| abstract_inverted_index.of | 14, 35, 48, 73, 105, 134 |
| abstract_inverted_index.on | 97, 112 |
| abstract_inverted_index.or | 4 |
| abstract_inverted_index.to | 80, 84 |
| abstract_inverted_index.we | 21, 69 |
| abstract_inverted_index.and | 32, 58, 60, 117, 129 |
| abstract_inverted_index.are | 1 |
| abstract_inverted_index.for | 54, 63 |
| abstract_inverted_index.the | 12, 15, 46, 71, 74, 93, 108, 132 |
| abstract_inverted_index.two | 49 |
| abstract_inverted_index.even | 5 |
| abstract_inverted_index.from | 77 |
| abstract_inverted_index.more | 86 |
| abstract_inverted_index.over | 107 |
| abstract_inverted_index.show | 102 |
| abstract_inverted_index.such | 124 |
| abstract_inverted_index.that | 28, 89 |
| abstract_inverted_index.this | 19 |
| abstract_inverted_index.with | 92 |
| abstract_inverted_index.blend | 90 |
| abstract_inverted_index.guide | 81 |
| abstract_inverted_index.image | 8, 136 |
| abstract_inverted_index.often | 2 |
| abstract_inverted_index.tasks | 123 |
| abstract_inverted_index.Shadow | 52, 61, 78, 82 |
| abstract_inverted_index.edited | 16 |
| abstract_inverted_index.excels | 120 |
| abstract_inverted_index.images | 39 |
| abstract_inverted_index.object | 126 |
| abstract_inverted_index.paper, | 20 |
| abstract_inverted_index.scene. | 94 |
| abstract_inverted_index.shadow | 56, 66, 99, 114 |
| abstract_inverted_index.Shadows | 0 |
| abstract_inverted_index.editing | 9 |
| abstract_inverted_index.enables | 29 |
| abstract_inverted_index.ignored | 6 |
| abstract_inverted_index.methods | 111 |
| abstract_inverted_index.natural | 38 |
| abstract_inverted_index.pushing | 131 |
| abstract_inverted_index.realism | 13 |
| abstract_inverted_index.shadows | 36, 88 |
| abstract_inverted_index.Analyzer | 79 |
| abstract_inverted_index.Notably, | 68 |
| abstract_inverted_index.combines | 45 |
| abstract_inverted_index.datasets | 101 |
| abstract_inverted_index.editing. | 137 |
| abstract_inverted_index.existing | 109 |
| abstract_inverted_index.fashion. | 43 |
| abstract_inverted_index.features | 76 |
| abstract_inverted_index.generate | 85 |
| abstract_inverted_index.learning | 72 |
| abstract_inverted_index.limiting | 11 |
| abstract_inverted_index.multiple | 98 |
| abstract_inverted_index.optimize | 70 |
| abstract_inverted_index.removal, | 31, 59, 116, 127 |
| abstract_inverted_index.results. | 17 |
| abstract_inverted_index.Analyzer, | 53 |
| abstract_inverted_index.Extensive | 95 |
| abstract_inverted_index.benchmark | 100 |
| abstract_inverted_index.detection | 57 |
| abstract_inverted_index.framework | 27 |
| abstract_inverted_index.introduce | 22 |
| abstract_inverted_index.realistic | 87 |
| abstract_inverted_index.strengths | 47 |
| abstract_inverted_index.synthesis | 34 |
| abstract_inverted_index.versatile | 26 |
| abstract_inverted_index.MetaShadow | 44, 106, 119 |
| abstract_inverted_index.boundaries | 133 |
| abstract_inverted_index.detection, | 30, 115 |
| abstract_inverted_index.insertion, | 130 |
| abstract_inverted_index.seamlessly | 91 |
| abstract_inverted_index.synthesis. | 67, 118 |
| abstract_inverted_index.MetaShadow, | 23 |
| abstract_inverted_index.Synthesizer | 83 |
| abstract_inverted_index.components: | 51 |
| abstract_inverted_index.cooperative | 50 |
| abstract_inverted_index.evaluations | 96 |
| abstract_inverted_index.relocation, | 128 |
| abstract_inverted_index.significant | 103 |
| abstract_inverted_index.Synthesizer, | 62 |
| abstract_inverted_index.controllable | 33, 65 |
| abstract_inverted_index.improvements | 104 |
| abstract_inverted_index.intermediate | 75 |
| abstract_inverted_index.three-in-one | 25 |
| abstract_inverted_index.applications, | 10 |
| abstract_inverted_index.image-editing | 122 |
| abstract_inverted_index.object-centered | 42, 55, 113, 135 |
| abstract_inverted_index.reference-based | 64 |
| abstract_inverted_index.state-of-the-art | 110 |
| abstract_inverted_index.under-considered | 3 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 10 |
| citation_normalized_percentile |