Towards Better De-raining Generalization via Rainy Characteristics Memorization and Replay Article Swipe
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2506.02477
Current image de-raining methods primarily learn from a limited dataset, leading to inadequate performance in varied real-world rainy conditions. To tackle this, we introduce a new framework that enables networks to progressively expand their de-raining knowledge base by tapping into a growing pool of datasets, significantly boosting their adaptability. Drawing inspiration from the human brain's ability to continuously absorb and generalize from ongoing experiences, our approach borrow the mechanism of the complementary learning system. Specifically, we first deploy Generative Adversarial Networks (GANs) to capture and retain the unique features of new data, mirroring the hippocampus's role in learning and memory. Then, the de-raining network is trained with both existing and GAN-synthesized data, mimicking the process of hippocampal replay and interleaved learning. Furthermore, we employ knowledge distillation with the replayed data to replicate the synergy between the neocortex's activity patterns triggered by hippocampal replays and the pre-existing neocortical knowledge. This comprehensive framework empowers the de-raining network to amass knowledge from various datasets, continually enhancing its performance on previously unseen rainy scenes. Our testing on three benchmark de-raining networks confirms the framework's effectiveness. It not only facilitates continuous knowledge accumulation across six datasets but also surpasses state-of-the-art methods in generalizing to new real-world scenarios.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2506.02477
- https://arxiv.org/pdf/2506.02477
- OA Status
- green
- OpenAlex ID
- https://openalex.org/W4415132965
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4415132965Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2506.02477Digital Object Identifier
- Title
-
Towards Better De-raining Generalization via Rainy Characteristics Memorization and ReplayWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-06-03Full publication date if available
- Authors
-
Kunyu Wang, Xueyang Fu, Chengzhi Cao, Chengjie Ge, Wei Zhai, Zheng-Jun ZhaList of authors in order
- Landing page
-
https://arxiv.org/abs/2506.02477Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2506.02477Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2506.02477Direct OA link when available
- Cited by
-
0Total citation count in OpenAlex
Full payload
| id | https://openalex.org/W4415132965 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2506.02477 |
| ids.doi | https://doi.org/10.48550/arxiv.2506.02477 |
| ids.openalex | https://openalex.org/W4415132965 |
| fwci | |
| type | preprint |
| title | Towards Better De-raining Generalization via Rainy Characteristics Memorization and Replay |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11234 |
| topics[0].field.id | https://openalex.org/fields/19 |
| topics[0].field.display_name | Earth and Planetary Sciences |
| topics[0].score | 0.9957000017166138 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1902 |
| topics[0].subfield.display_name | Atmospheric Science |
| topics[0].display_name | Precipitation Measurement and Analysis |
| topics[1].id | https://openalex.org/T11019 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9445000290870667 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1707 |
| topics[1].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[1].display_name | Image Enhancement Techniques |
| topics[2].id | https://openalex.org/T12696 |
| topics[2].field.id | https://openalex.org/fields/22 |
| topics[2].field.display_name | Engineering |
| topics[2].score | 0.9433000087738037 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2202 |
| topics[2].subfield.display_name | Aerospace Engineering |
| topics[2].display_name | Icing and De-icing Technologies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2506.02477 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by-nc-nd |
| locations[0].pdf_url | https://arxiv.org/pdf/2506.02477 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | https://openalex.org/licenses/cc-by-nc-nd |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2506.02477 |
| locations[1].id | doi:10.48550/arxiv.2506.02477 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2506.02477 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5100615240 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-8261-0325 |
| authorships[0].author.display_name | Kunyu Wang |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Wang, Kunyu |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5079007635 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-8036-4071 |
| authorships[1].author.display_name | Xueyang Fu |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Fu, Xueyang |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5025050880 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Chengzhi Cao |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Cao, Chengzhi |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5015696501 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Chengjie Ge |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Ge, Chengjie |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5101425640 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-5695-8291 |
| authorships[4].author.display_name | Wei Zhai |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Zhai, Wei |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5003217535 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-2510-8993 |
| authorships[5].author.display_name | Zheng-Jun Zha |
| authorships[5].author_position | last |
| authorships[5].raw_author_name | Zha, Zheng-Jun |
| authorships[5].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2506.02477 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-14T00:00:00 |
| display_name | Towards Better De-raining Generalization via Rainy Characteristics Memorization and Replay |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T11234 |
| primary_topic.field.id | https://openalex.org/fields/19 |
| primary_topic.field.display_name | Earth and Planetary Sciences |
| primary_topic.score | 0.9957000017166138 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1902 |
| primary_topic.subfield.display_name | Atmospheric Science |
| primary_topic.display_name | Precipitation Measurement and Analysis |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2506.02477 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by-nc-nd |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2506.02477 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by-nc-nd |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2506.02477 |
| primary_location.id | pmh:oai:arXiv.org:2506.02477 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by-nc-nd |
| primary_location.pdf_url | https://arxiv.org/pdf/2506.02477 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | https://openalex.org/licenses/cc-by-nc-nd |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2506.02477 |
| publication_date | 2025-06-03 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 7, 24, 40 |
| abstract_inverted_index.It | 181 |
| abstract_inverted_index.To | 19 |
| abstract_inverted_index.by | 37, 140 |
| abstract_inverted_index.in | 14, 96, 196 |
| abstract_inverted_index.is | 104 |
| abstract_inverted_index.of | 43, 69, 89, 115 |
| abstract_inverted_index.on | 165, 172 |
| abstract_inverted_index.to | 11, 30, 56, 82, 130, 155, 198 |
| abstract_inverted_index.we | 22, 75, 122 |
| abstract_inverted_index.Our | 170 |
| abstract_inverted_index.and | 59, 84, 98, 109, 118, 143 |
| abstract_inverted_index.but | 191 |
| abstract_inverted_index.its | 163 |
| abstract_inverted_index.new | 25, 90, 199 |
| abstract_inverted_index.not | 182 |
| abstract_inverted_index.our | 64 |
| abstract_inverted_index.six | 189 |
| abstract_inverted_index.the | 52, 67, 70, 86, 93, 101, 113, 127, 132, 135, 144, 152, 178 |
| abstract_inverted_index.This | 148 |
| abstract_inverted_index.also | 192 |
| abstract_inverted_index.base | 36 |
| abstract_inverted_index.both | 107 |
| abstract_inverted_index.data | 129 |
| abstract_inverted_index.from | 6, 51, 61, 158 |
| abstract_inverted_index.into | 39 |
| abstract_inverted_index.only | 183 |
| abstract_inverted_index.pool | 42 |
| abstract_inverted_index.role | 95 |
| abstract_inverted_index.that | 27 |
| abstract_inverted_index.with | 106, 126 |
| abstract_inverted_index.Then, | 100 |
| abstract_inverted_index.amass | 156 |
| abstract_inverted_index.data, | 91, 111 |
| abstract_inverted_index.first | 76 |
| abstract_inverted_index.human | 53 |
| abstract_inverted_index.image | 1 |
| abstract_inverted_index.learn | 5 |
| abstract_inverted_index.rainy | 17, 168 |
| abstract_inverted_index.their | 33, 47 |
| abstract_inverted_index.this, | 21 |
| abstract_inverted_index.three | 173 |
| abstract_inverted_index.(GANs) | 81 |
| abstract_inverted_index.absorb | 58 |
| abstract_inverted_index.across | 188 |
| abstract_inverted_index.borrow | 66 |
| abstract_inverted_index.deploy | 77 |
| abstract_inverted_index.employ | 123 |
| abstract_inverted_index.expand | 32 |
| abstract_inverted_index.replay | 117 |
| abstract_inverted_index.retain | 85 |
| abstract_inverted_index.tackle | 20 |
| abstract_inverted_index.unique | 87 |
| abstract_inverted_index.unseen | 167 |
| abstract_inverted_index.varied | 15 |
| abstract_inverted_index.Current | 0 |
| abstract_inverted_index.Drawing | 49 |
| abstract_inverted_index.ability | 55 |
| abstract_inverted_index.between | 134 |
| abstract_inverted_index.brain's | 54 |
| abstract_inverted_index.capture | 83 |
| abstract_inverted_index.enables | 28 |
| abstract_inverted_index.growing | 41 |
| abstract_inverted_index.leading | 10 |
| abstract_inverted_index.limited | 8 |
| abstract_inverted_index.memory. | 99 |
| abstract_inverted_index.methods | 3, 195 |
| abstract_inverted_index.network | 103, 154 |
| abstract_inverted_index.ongoing | 62 |
| abstract_inverted_index.process | 114 |
| abstract_inverted_index.replays | 142 |
| abstract_inverted_index.scenes. | 169 |
| abstract_inverted_index.synergy | 133 |
| abstract_inverted_index.system. | 73 |
| abstract_inverted_index.tapping | 38 |
| abstract_inverted_index.testing | 171 |
| abstract_inverted_index.trained | 105 |
| abstract_inverted_index.various | 159 |
| abstract_inverted_index.Networks | 80 |
| abstract_inverted_index.activity | 137 |
| abstract_inverted_index.approach | 65 |
| abstract_inverted_index.boosting | 46 |
| abstract_inverted_index.confirms | 177 |
| abstract_inverted_index.dataset, | 9 |
| abstract_inverted_index.datasets | 190 |
| abstract_inverted_index.empowers | 151 |
| abstract_inverted_index.existing | 108 |
| abstract_inverted_index.features | 88 |
| abstract_inverted_index.learning | 72, 97 |
| abstract_inverted_index.networks | 29, 176 |
| abstract_inverted_index.patterns | 138 |
| abstract_inverted_index.replayed | 128 |
| abstract_inverted_index.benchmark | 174 |
| abstract_inverted_index.datasets, | 44, 160 |
| abstract_inverted_index.enhancing | 162 |
| abstract_inverted_index.framework | 26, 150 |
| abstract_inverted_index.introduce | 23 |
| abstract_inverted_index.knowledge | 35, 124, 157, 186 |
| abstract_inverted_index.learning. | 120 |
| abstract_inverted_index.mechanism | 68 |
| abstract_inverted_index.mimicking | 112 |
| abstract_inverted_index.mirroring | 92 |
| abstract_inverted_index.primarily | 4 |
| abstract_inverted_index.replicate | 131 |
| abstract_inverted_index.surpasses | 193 |
| abstract_inverted_index.triggered | 139 |
| abstract_inverted_index.Generative | 78 |
| abstract_inverted_index.continuous | 185 |
| abstract_inverted_index.de-raining | 2, 34, 102, 153, 175 |
| abstract_inverted_index.generalize | 60 |
| abstract_inverted_index.inadequate | 12 |
| abstract_inverted_index.knowledge. | 147 |
| abstract_inverted_index.previously | 166 |
| abstract_inverted_index.real-world | 16, 200 |
| abstract_inverted_index.scenarios. | 201 |
| abstract_inverted_index.Adversarial | 79 |
| abstract_inverted_index.conditions. | 18 |
| abstract_inverted_index.continually | 161 |
| abstract_inverted_index.facilitates | 184 |
| abstract_inverted_index.framework's | 179 |
| abstract_inverted_index.hippocampal | 116, 141 |
| abstract_inverted_index.inspiration | 50 |
| abstract_inverted_index.interleaved | 119 |
| abstract_inverted_index.neocortex's | 136 |
| abstract_inverted_index.neocortical | 146 |
| abstract_inverted_index.performance | 13, 164 |
| abstract_inverted_index.Furthermore, | 121 |
| abstract_inverted_index.accumulation | 187 |
| abstract_inverted_index.continuously | 57 |
| abstract_inverted_index.distillation | 125 |
| abstract_inverted_index.experiences, | 63 |
| abstract_inverted_index.generalizing | 197 |
| abstract_inverted_index.pre-existing | 145 |
| abstract_inverted_index.Specifically, | 74 |
| abstract_inverted_index.adaptability. | 48 |
| abstract_inverted_index.complementary | 71 |
| abstract_inverted_index.comprehensive | 149 |
| abstract_inverted_index.hippocampus's | 94 |
| abstract_inverted_index.progressively | 31 |
| abstract_inverted_index.significantly | 45 |
| abstract_inverted_index.effectiveness. | 180 |
| abstract_inverted_index.GAN-synthesized | 110 |
| abstract_inverted_index.state-of-the-art | 194 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 6 |
| citation_normalized_percentile |