Semantic Relative Entropy and Mutual Information Article Swipe

PDF

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.1007/978-981-96-5132-0_4

In this chapter, we introduce the concepts of semantic relative entropy and semantic mutual information. First three measures of semantic relative entropies are defined and the relationship between these measures and the classic counterpart are discussed. Unlike the classic mutual information, it is noted that we use two measures to indicate semantic mutual information, such as the up semantic mutual information and the down semantic mutual information. In addition, the chain rule of semantic mutual information is addressed.

Related Topics

Computer Science

Artificial Intelligence

Concepts

Mutual information Transfer entropy Computer science Natural language processing Artificial intelligence Principle of maximum entropy

Metadata

Type: book-chapter
Language: en
Landing Page: https://doi.org/10.1007/978-981-96-5132-0_4
PDF: https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf
OA Status: hybrid
Related Works: 10
OpenAlex ID: https://openalex.org/W4410921955

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4410921955

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.1007/978-981-96-5132-0_4

Digital Object Identifier
Title: Semantic Relative Entropy and Mutual Information

Work title
Type: book-chapter

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-01-01

Full publication date if available
Authors: Kai Niu, Yanping Zhang

List of authors in order
Landing page: https://doi.org/10.1007/978-981-96-5132-0_4

Publisher landing page
PDF URL: https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: hybrid

Open access status per OpenAlex
OA URL: https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf

Direct OA link when available
Concepts: Mutual information, Transfer entropy, Computer science, Natural language processing, Artificial intelligence, Principle of maximum entropy

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4410921955
doi	https://doi.org/10.1007/978-981-96-5132-0_4
ids.doi	https://doi.org/10.1007/978-981-96-5132-0_4
ids.openalex	https://openalex.org/W4410921955
fwci	0.0
type	book-chapter
title	Semantic Relative Entropy and Mutual Information
biblio.issue
biblio.volume
biblio.last_page	41
biblio.first_page	29
topics[0].id	https://openalex.org/T12002
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.2492000013589859
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1703
topics[0].subfield.display_name	Computational Theory and Mathematics
topics[0].display_name	Computability, Logic, AI Algorithms
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C152139883
concepts[0].level	2
concepts[0].score	0.6408959627151489
concepts[0].wikidata	https://www.wikidata.org/wiki/Q252973
concepts[0].display_name	Mutual information
concepts[1].id	https://openalex.org/C182049051
concepts[1].level	3
concepts[1].score	0.4335364103317261
concepts[1].wikidata	https://www.wikidata.org/wiki/Q17147155
concepts[1].display_name	Transfer entropy
concepts[2].id	https://openalex.org/C41008148
concepts[2].level	0
concepts[2].score	0.43185698986053467
concepts[2].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[2].display_name	Computer science
concepts[3].id	https://openalex.org/C204321447
concepts[3].level	1
concepts[3].score	0.3375403881072998
concepts[3].wikidata	https://www.wikidata.org/wiki/Q30642
concepts[3].display_name	Natural language processing
concepts[4].id	https://openalex.org/C154945302
concepts[4].level	1
concepts[4].score	0.32363662123680115
concepts[4].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[4].display_name	Artificial intelligence
concepts[5].id	https://openalex.org/C9679016
concepts[5].level	2
concepts[5].score	0.20081621408462524
concepts[5].wikidata	https://www.wikidata.org/wiki/Q1417473
concepts[5].display_name	Principle of maximum entropy
keywords[0].id	https://openalex.org/keywords/mutual-information
keywords[0].score	0.6408959627151489
keywords[0].display_name	Mutual information
keywords[1].id	https://openalex.org/keywords/transfer-entropy
keywords[1].score	0.4335364103317261
keywords[1].display_name	Transfer entropy
keywords[2].id	https://openalex.org/keywords/computer-science
keywords[2].score	0.43185698986053467
keywords[2].display_name	Computer science
keywords[3].id	https://openalex.org/keywords/natural-language-processing
keywords[3].score	0.3375403881072998
keywords[3].display_name	Natural language processing
keywords[4].id	https://openalex.org/keywords/artificial-intelligence
keywords[4].score	0.32363662123680115
keywords[4].display_name	Artificial intelligence
keywords[5].id	https://openalex.org/keywords/principle-of-maximum-entropy
keywords[5].score	0.20081621408462524
keywords[5].display_name	Principle of maximum entropy
language	en
locations[0].id	doi:10.1007/978-981-96-5132-0_4
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4210184905
locations[0].source.issn	2191-5768, 2191-5776
locations[0].source.type	book series
locations[0].source.is_oa	False
locations[0].source.issn_l	2191-5768
locations[0].source.is_core	True
locations[0].source.is_in_doaj	False
locations[0].source.display_name	SpringerBriefs in computer science
locations[0].source.host_organization	https://openalex.org/P4310319965
locations[0].source.host_organization_name	Springer Nature
locations[0].source.host_organization_lineage	https://openalex.org/P4310319965
locations[0].source.host_organization_lineage_names	Springer Nature
locations[0].license	cc-by
locations[0].pdf_url	https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf
locations[0].version	publishedVersion
locations[0].raw_type	book-chapter
locations[0].license_id	https://openalex.org/licenses/cc-by
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	SpringerBriefs in Computer Science
locations[0].landing_page_url	https://doi.org/10.1007/978-981-96-5132-0_4
indexed_in	crossref
authorships[0].author.id	https://openalex.org/A5008455605
authorships[0].author.orcid	https://orcid.org/0000-0002-8076-1867
authorships[0].author.display_name	Kai Niu
authorships[0].author_position	first
authorships[0].raw_author_name	Kai Niu
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5100430699
authorships[1].author.orcid	https://orcid.org/0000-0001-8150-7265
authorships[1].author.display_name	Yanping Zhang
authorships[1].author_position	last
authorships[1].raw_author_name	Ping Zhang
authorships[1].is_corresponding	False
has_content.pdf	True
has_content.grobid_xml	True
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf
open_access.oa_status	hybrid
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Semantic Relative Entropy and Mutual Information
has_fulltext	True
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T12002
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.2492000013589859
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1703
primary_topic.subfield.display_name	Computational Theory and Mathematics
primary_topic.display_name	Computability, Logic, AI Algorithms
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2466816617, https://openalex.org/W1970834875, https://openalex.org/W842936808, https://openalex.org/W3174028392, https://openalex.org/W2390279801, https://openalex.org/W3204019825, https://openalex.org/W4313422465
cited_by_count	0
locations_count	1
best_oa_location.id	doi:10.1007/978-981-96-5132-0_4
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4210184905
best_oa_location.source.issn	2191-5768, 2191-5776
best_oa_location.source.type	book series
best_oa_location.source.is_oa	False
best_oa_location.source.issn_l	2191-5768
best_oa_location.source.is_core	True
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	SpringerBriefs in computer science
best_oa_location.source.host_organization	https://openalex.org/P4310319965
best_oa_location.source.host_organization_name	Springer Nature
best_oa_location.source.host_organization_lineage	https://openalex.org/P4310319965
best_oa_location.source.host_organization_lineage_names	Springer Nature
best_oa_location.license	cc-by
best_oa_location.pdf_url	https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf
best_oa_location.version	publishedVersion
best_oa_location.raw_type	book-chapter
best_oa_location.license_id	https://openalex.org/licenses/cc-by
best_oa_location.is_accepted	True
best_oa_location.is_published	True
best_oa_location.raw_source_name	SpringerBriefs in Computer Science
best_oa_location.landing_page_url	https://doi.org/10.1007/978-981-96-5132-0_4
primary_location.id	doi:10.1007/978-981-96-5132-0_4
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4210184905
primary_location.source.issn	2191-5768, 2191-5776
primary_location.source.type	book series
primary_location.source.is_oa	False
primary_location.source.issn_l	2191-5768
primary_location.source.is_core	True
primary_location.source.is_in_doaj	False
primary_location.source.display_name	SpringerBriefs in computer science
primary_location.source.host_organization	https://openalex.org/P4310319965
primary_location.source.host_organization_name	Springer Nature
primary_location.source.host_organization_lineage	https://openalex.org/P4310319965
primary_location.source.host_organization_lineage_names	Springer Nature
primary_location.license	cc-by
primary_location.pdf_url	https://link.springer.com/content/pdf/10.1007/978-981-96-5132-0_4.pdf
primary_location.version	publishedVersion
primary_location.raw_type	book-chapter
primary_location.license_id	https://openalex.org/licenses/cc-by
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	SpringerBriefs in Computer Science
primary_location.landing_page_url	https://doi.org/10.1007/978-981-96-5132-0_4
publication_date	2025-01-01
publication_year	2025
referenced_works_count	0
abstract_inverted_index.In	1, 68
abstract_inverted_index.as	56
abstract_inverted_index.is	43, 77
abstract_inverted_index.it	42
abstract_inverted_index.of	8, 19, 73
abstract_inverted_index.to	50
abstract_inverted_index.up	58
abstract_inverted_index.we	4, 46
abstract_inverted_index.and	12, 25, 31, 62
abstract_inverted_index.are	23, 35
abstract_inverted_index.the	6, 26, 32, 38, 57, 63, 70
abstract_inverted_index.two	48
abstract_inverted_index.use	47
abstract_inverted_index.down	64
abstract_inverted_index.rule	72
abstract_inverted_index.such	55
abstract_inverted_index.that	45
abstract_inverted_index.this	2
abstract_inverted_index.First	16
abstract_inverted_index.chain	71
abstract_inverted_index.noted	44
abstract_inverted_index.these	29
abstract_inverted_index.three	17
abstract_inverted_index.Unlike	37
abstract_inverted_index.mutual	14, 40, 53, 60, 66, 75
abstract_inverted_index.between	28
abstract_inverted_index.classic	33, 39
abstract_inverted_index.defined	24
abstract_inverted_index.entropy	11
abstract_inverted_index.Abstract	0
abstract_inverted_index.chapter,	3
abstract_inverted_index.concepts	7
abstract_inverted_index.indicate	51
abstract_inverted_index.measures	18, 30, 49
abstract_inverted_index.relative	10, 21
abstract_inverted_index.semantic	9, 13, 20, 52, 59, 65, 74
abstract_inverted_index.addition,	69
abstract_inverted_index.entropies	22
abstract_inverted_index.introduce	5
abstract_inverted_index.addressed.	78
abstract_inverted_index.discussed.	36
abstract_inverted_index.counterpart	34
abstract_inverted_index.information	61, 76
abstract_inverted_index.information,	41, 54
abstract_inverted_index.information.	15, 67
abstract_inverted_index.relationship	27
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	2
citation_normalized_percentile.value	0.41483888
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	True