Network Inversion and Its Applications Article Swipe

PDF

Pirzada Suhail , Hao Tang , Amit Sethi ·

YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2411.17777

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability and reliability, especially in safety-critical scenarios. Network inversion techniques offer a solution by allowing us to peek inside these black boxes, revealing the features and patterns learned by the networks behind their decision-making processes and thereby provide valuable insights into how neural networks arrive at their conclusions, making them more interpretable and trustworthy. This paper presents a simple yet effective approach to network inversion using a meticulously conditioned generator that learns the data distribution in the input space of the trained neural network, enabling the reconstruction of inputs that would most likely lead to the desired outputs. To capture the diversity in the input space for a given output, instead of simply revealing the conditioning labels to the generator, we encode the conditioning label information into vectors and intermediate matrices and further minimize the cosine similarity between features of the generated images. Additionally, we incorporate feature orthogonality as a regularization term to boost image diversity which penalises the deviations of the Gram matrix of the features from the identity matrix, ensuring orthogonality and promoting distinct, non-redundant representations for each label. The paper concludes by exploring immediate applications of the proposed network inversion approach in interpretability, out-of-distribution detection, and training data reconstruction.

Related Topics

Computer Science

Seismology

Concepts

Inversion (geology) Computer science Geology Seismology Tectonics

Metadata

Type: preprint
Language: en
Landing Page: http://arxiv.org/abs/2411.17777
PDF: https://arxiv.org/pdf/2411.17777
OA Status: green
Related Works: 10
OpenAlex ID: https://openalex.org/W4404990124

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4404990124

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2411.17777

Digital Object Identifier
Title: Network Inversion and Its Applications

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2024

Year of publication
Publication date: 2024-11-26

Full publication date if available
Authors: Pirzada Suhail, Hao Tang, Amit Sethi

List of authors in order
Landing page: https://arxiv.org/abs/2411.17777

Publisher landing page
PDF URL: https://arxiv.org/pdf/2411.17777

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2411.17777

Direct OA link when available
Concepts: Inversion (geology), Computer science, Geology, Seismology, Tectonics

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4404990124
doi	https://doi.org/10.48550/arxiv.2411.17777
ids.doi	https://doi.org/10.48550/arxiv.2411.17777
ids.openalex	https://openalex.org/W4404990124
fwci
type	preprint
title	Network Inversion and Its Applications
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T10320
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9117000102996826
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Neural Networks and Applications
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C1893757
concepts[0].level	3
concepts[0].score	0.6687222719192505
concepts[0].wikidata	https://www.wikidata.org/wiki/Q3653001
concepts[0].display_name	Inversion (geology)
concepts[1].id	https://openalex.org/C41008148
concepts[1].level	0
concepts[1].score	0.4399505853652954
concepts[1].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[1].display_name	Computer science
concepts[2].id	https://openalex.org/C127313418
concepts[2].level	0
concepts[2].score	0.30299314856529236
concepts[2].wikidata	https://www.wikidata.org/wiki/Q1069
concepts[2].display_name	Geology
concepts[3].id	https://openalex.org/C165205528
concepts[3].level	1
concepts[3].score	0.09752142429351807
concepts[3].wikidata	https://www.wikidata.org/wiki/Q83371
concepts[3].display_name	Seismology
concepts[4].id	https://openalex.org/C77928131
concepts[4].level	2
concepts[4].score	0.0
concepts[4].wikidata	https://www.wikidata.org/wiki/Q193343
concepts[4].display_name	Tectonics
keywords[0].id	https://openalex.org/keywords/inversion
keywords[0].score	0.6687222719192505
keywords[0].display_name	Inversion (geology)
keywords[1].id	https://openalex.org/keywords/computer-science
keywords[1].score	0.4399505853652954
keywords[1].display_name	Computer science
keywords[2].id	https://openalex.org/keywords/geology
keywords[2].score	0.30299314856529236
keywords[2].display_name	Geology
keywords[3].id	https://openalex.org/keywords/seismology
keywords[3].score	0.09752142429351807
keywords[3].display_name	Seismology
language	en
locations[0].id	pmh:oai:arXiv.org:2411.17777
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2411.17777
locations[0].version	submittedVersion
locations[0].raw_type
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2411.17777
locations[1].id	doi:10.48550/arxiv.2411.17777
locations[1].is_oa	True
locations[1].source.id	https://openalex.org/S4306400194
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	True
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	arXiv (Cornell University)
locations[1].source.host_organization	https://openalex.org/I205783295
locations[1].source.host_organization_name	Cornell University
locations[1].source.host_organization_lineage	https://openalex.org/I205783295
locations[1].license	cc-by
locations[1].pdf_url
locations[1].version
locations[1].raw_type	article
locations[1].license_id	https://openalex.org/licenses/cc-by
locations[1].is_accepted	False
locations[1].is_published
locations[1].raw_source_name
locations[1].landing_page_url	https://doi.org/10.48550/arxiv.2411.17777
indexed_in	arxiv, datacite
authorships[0].author.id	https://openalex.org/A5093967906
authorships[0].author.orcid
authorships[0].author.display_name	Pirzada Suhail
authorships[0].author_position	first
authorships[0].raw_author_name	Suhail, Pirzada
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5101882202
authorships[1].author.orcid	https://orcid.org/0000-0002-3098-179X
authorships[1].author.display_name	Hao Tang
authorships[1].author_position	middle
authorships[1].raw_author_name	Tang, Hao
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5087629613
authorships[2].author.orcid	https://orcid.org/0000-0002-8634-1804
authorships[2].author.display_name	Amit Sethi
authorships[2].author_position	last
authorships[2].raw_author_name	Sethi, Amit
authorships[2].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2411.17777
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Network Inversion and Its Applications
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T06:51:31.235846
primary_topic.id	https://openalex.org/T10320
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9117000102996826
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Neural Networks and Applications
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2324615561, https://openalex.org/W2086120259, https://openalex.org/W2390279801, https://openalex.org/W2245170124, https://openalex.org/W2076393078, https://openalex.org/W4391913857, https://openalex.org/W2358668433
cited_by_count	0
locations_count	2
best_oa_location.id	pmh:oai:arXiv.org:2411.17777
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2411.17777
best_oa_location.version	submittedVersion
best_oa_location.raw_type
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2411.17777
primary_location.id	pmh:oai:arXiv.org:2411.17777
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2411.17777
primary_location.version	submittedVersion
primary_location.raw_type
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2411.17777
publication_date	2024-11-26
publication_year	2024
referenced_works_count	0
abstract_inverted_index.a	42, 88, 97, 138, 180
abstract_inverted_index.To	129
abstract_inverted_index.as	4, 22, 179
abstract_inverted_index.at	76
abstract_inverted_index.by	44, 59, 215
abstract_inverted_index.in	35, 106, 133, 225
abstract_inverted_index.of	110, 118, 142, 170, 191, 195, 219
abstract_inverted_index.to	18, 47, 93, 125, 148, 183
abstract_inverted_index.us	46
abstract_inverted_index.we	151, 175
abstract_inverted_index.The	212
abstract_inverted_index.and	32, 56, 66, 83, 159, 162, 204, 229
abstract_inverted_index.for	137, 209
abstract_inverted_index.how	72
abstract_inverted_index.the	54, 60, 103, 107, 111, 116, 126, 131, 134, 145, 149, 153, 165, 171, 189, 192, 196, 199, 220
abstract_inverted_index.yet	10, 90
abstract_inverted_index.Gram	193
abstract_inverted_index.This	25, 85
abstract_inverted_index.data	104, 231
abstract_inverted_index.each	210
abstract_inverted_index.from	198
abstract_inverted_index.have	2
abstract_inverted_index.into	71, 157
abstract_inverted_index.lead	124
abstract_inverted_index.more	81
abstract_inverted_index.most	122
abstract_inverted_index.peek	48
abstract_inverted_index.term	182
abstract_inverted_index.that	101, 120
abstract_inverted_index.them	19, 80
abstract_inverted_index.about	29
abstract_inverted_index.being	20
abstract_inverted_index.black	51
abstract_inverted_index.boost	184
abstract_inverted_index.given	139
abstract_inverted_index.image	185
abstract_inverted_index.input	108, 135
abstract_inverted_index.label	155
abstract_inverted_index.offer	41
abstract_inverted_index.often	14
abstract_inverted_index.paper	86, 213
abstract_inverted_index.space	109, 136
abstract_inverted_index.their	11, 30, 63, 77
abstract_inverted_index.these	50
abstract_inverted_index.tools	6
abstract_inverted_index.using	96
abstract_inverted_index.which	187
abstract_inverted_index.would	121
abstract_inverted_index."black	23
abstract_inverted_index.Neural	0
abstract_inverted_index.across	7
abstract_inverted_index.arrive	75
abstract_inverted_index.behind	62
abstract_inverted_index.boxes,	52
abstract_inverted_index.cosine	166
abstract_inverted_index.encode	152
abstract_inverted_index.inputs	119
abstract_inverted_index.inside	49
abstract_inverted_index.label.	211
abstract_inverted_index.labels	147
abstract_inverted_index.learns	102
abstract_inverted_index.likely	123
abstract_inverted_index.making	79
abstract_inverted_index.matrix	194
abstract_inverted_index.neural	73, 113
abstract_inverted_index.raises	27
abstract_inverted_index.simple	89
abstract_inverted_index.simply	143
abstract_inverted_index.Network	38
abstract_inverted_index.between	168
abstract_inverted_index.boxes."	24
abstract_inverted_index.capture	130
abstract_inverted_index.desired	127
abstract_inverted_index.emerged	3
abstract_inverted_index.feature	177
abstract_inverted_index.further	163
abstract_inverted_index.images.	173
abstract_inverted_index.instead	141
abstract_inverted_index.leading	17
abstract_inverted_index.learned	58
abstract_inverted_index.matrix,	201
abstract_inverted_index.network	94, 222
abstract_inverted_index.opacity	26
abstract_inverted_index.opaque,	16
abstract_inverted_index.output,	140
abstract_inverted_index.process	13
abstract_inverted_index.provide	68
abstract_inverted_index.remains	15
abstract_inverted_index.thereby	67
abstract_inverted_index.trained	112
abstract_inverted_index.various	8
abstract_inverted_index.vectors	158
abstract_inverted_index.allowing	45
abstract_inverted_index.approach	92, 224
abstract_inverted_index.concerns	28
abstract_inverted_index.enabling	115
abstract_inverted_index.ensuring	202
abstract_inverted_index.features	55, 169, 197
abstract_inverted_index.identity	200
abstract_inverted_index.insights	70
abstract_inverted_index.matrices	161
abstract_inverted_index.minimize	164
abstract_inverted_index.network,	114
abstract_inverted_index.networks	1, 61, 74
abstract_inverted_index.outputs.	128
abstract_inverted_index.patterns	57
abstract_inverted_index.powerful	5
abstract_inverted_index.presents	87
abstract_inverted_index.proposed	221
abstract_inverted_index.solution	43
abstract_inverted_index.training	230
abstract_inverted_index.valuable	69
abstract_inverted_index.concludes	214
abstract_inverted_index.distinct,	206
abstract_inverted_index.diversity	132, 186
abstract_inverted_index.effective	91
abstract_inverted_index.exploring	216
abstract_inverted_index.generated	172
abstract_inverted_index.generator	100
abstract_inverted_index.immediate	217
abstract_inverted_index.inversion	39, 95, 223
abstract_inverted_index.penalises	188
abstract_inverted_index.perceived	21
abstract_inverted_index.processes	65
abstract_inverted_index.promoting	205
abstract_inverted_index.revealing	53, 144
abstract_inverted_index.detection,	228
abstract_inverted_index.deviations	190
abstract_inverted_index.especially	34
abstract_inverted_index.generator,	150
abstract_inverted_index.scenarios.	37
abstract_inverted_index.similarity	167
abstract_inverted_index.techniques	40
abstract_inverted_index.conditioned	99
abstract_inverted_index.incorporate	176
abstract_inverted_index.information	156
abstract_inverted_index.applications	218
abstract_inverted_index.conclusions,	78
abstract_inverted_index.conditioning	146, 154
abstract_inverted_index.distribution	105
abstract_inverted_index.intermediate	160
abstract_inverted_index.meticulously	98
abstract_inverted_index.reliability,	33
abstract_inverted_index.trustworthy.	84
abstract_inverted_index.Additionally,	174
abstract_inverted_index.applications,	9
abstract_inverted_index.interpretable	82
abstract_inverted_index.non-redundant	207
abstract_inverted_index.orthogonality	178, 203
abstract_inverted_index.reconstruction	117
abstract_inverted_index.regularization	181
abstract_inverted_index.decision-making	12, 64
abstract_inverted_index.reconstruction.	232
abstract_inverted_index.representations	208
abstract_inverted_index.safety-critical	36
abstract_inverted_index.interpretability	31
abstract_inverted_index.interpretability,	226
abstract_inverted_index.out-of-distribution	227
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	3
citation_normalized_percentile