Context-based multimodal interpretation : an integrated approach to multimodal fusion and discourse processing Article Swipe
This thesis is concerned with the context-based interpretation of verbal and nonverbal contributions to interactions in multimodal multiparty dialogue systems. On the basis of a detailed analysis of context-dependent multimodal discourse phenomena, a comprehensive context model is developed. This context model supports the resolution of a variety of referring and elliptical expressions as well as the processing and reactive generation of turn-taking signals and the identification of the intended addressee(s) of a contribution. A major goal of this thesis is the development of a generic component for multimodal fusion and discourse processing. Based on the integration of this component into three distinct multimodal dialogue systems, the generic applicability of the approach is shown.
Related Topics
Concepts
Metadata
- Type
- dissertation
- Language
- en
- Landing Page
- http://doi.org/10.22028/D291-25919
- http://dx.doi.org/10.22028/D291-25919
- OA Status
- green
- Cited By
- 6
- References
- 162
- OpenAlex ID
- https://openalex.org/W1794943985
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W1794943985Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.22028/d291-25919Digital Object Identifier
- Title
-
Context-based multimodal interpretation : an integrated approach to multimodal fusion and discourse processingWork title
- Type
-
dissertationOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2007Year of publication
- Publication date
-
2007-01-01Full publication date if available
- Authors
-
Norbert PflegerList of authors in order
- Landing page
-
https://doi.org/10.22028/D291-25919Publisher landing page
- PDF URL
-
https://dx.doi.org/10.22028/D291-25919Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://dx.doi.org/10.22028/D291-25919Direct OA link when available
- Concepts
-
Context (archaeology), Interpretation (philosophy), Computer science, Component (thermodynamics), Artificial intelligence, Physics, Geography, Archaeology, Thermodynamics, Programming languageTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
6Total citation count in OpenAlex
- Citations by year (recent)
-
2016: 1, 2014: 1Per-year citation counts (last 5 years)
- References (count)
-
162Number of works referenced by this work
Full payload
| id | https://openalex.org/W1794943985 |
|---|---|
| doi | https://doi.org/10.22028/d291-25919 |
| ids.doi | https://doi.org/10.22028/d291-25919 |
| ids.mag | 1794943985 |
| ids.openalex | https://openalex.org/W1794943985 |
| fwci | |
| type | dissertation |
| title | Context-based multimodal interpretation : an integrated approach to multimodal fusion and discourse processing |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12031 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9997000098228455 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Speech and dialogue systems |
| topics[1].id | https://openalex.org/T10456 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9975000023841858 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Multi-Agent Systems and Negotiation |
| topics[2].id | https://openalex.org/T10383 |
| topics[2].field.id | https://openalex.org/fields/12 |
| topics[2].field.display_name | Arts and Humanities |
| topics[2].score | 0.9930999875068665 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1203 |
| topics[2].subfield.display_name | Language and Linguistics |
| topics[2].display_name | Language, Discourse, Communication Strategies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2779343474 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6597030162811279 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q3109175 |
| concepts[0].display_name | Context (archaeology) |
| concepts[1].id | https://openalex.org/C527412718 |
| concepts[1].level | 2 |
| concepts[1].score | 0.4721567630767822 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q855395 |
| concepts[1].display_name | Interpretation (philosophy) |
| concepts[2].id | https://openalex.org/C41008148 |
| concepts[2].level | 0 |
| concepts[2].score | 0.4614374339580536 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[2].display_name | Computer science |
| concepts[3].id | https://openalex.org/C168167062 |
| concepts[3].level | 2 |
| concepts[3].score | 0.43584007024765015 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1117970 |
| concepts[3].display_name | Component (thermodynamics) |
| concepts[4].id | https://openalex.org/C154945302 |
| concepts[4].level | 1 |
| concepts[4].score | 0.3442232012748718 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[4].display_name | Artificial intelligence |
| concepts[5].id | https://openalex.org/C121332964 |
| concepts[5].level | 0 |
| concepts[5].score | 0.10329276323318481 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[5].display_name | Physics |
| concepts[6].id | https://openalex.org/C205649164 |
| concepts[6].level | 0 |
| concepts[6].score | 0.09340113401412964 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1071 |
| concepts[6].display_name | Geography |
| concepts[7].id | https://openalex.org/C166957645 |
| concepts[7].level | 1 |
| concepts[7].score | 0.0 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q23498 |
| concepts[7].display_name | Archaeology |
| concepts[8].id | https://openalex.org/C97355855 |
| concepts[8].level | 1 |
| concepts[8].score | 0.0 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q11473 |
| concepts[8].display_name | Thermodynamics |
| concepts[9].id | https://openalex.org/C199360897 |
| concepts[9].level | 1 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[9].display_name | Programming language |
| keywords[0].id | https://openalex.org/keywords/context |
| keywords[0].score | 0.6597030162811279 |
| keywords[0].display_name | Context (archaeology) |
| keywords[1].id | https://openalex.org/keywords/interpretation |
| keywords[1].score | 0.4721567630767822 |
| keywords[1].display_name | Interpretation (philosophy) |
| keywords[2].id | https://openalex.org/keywords/computer-science |
| keywords[2].score | 0.4614374339580536 |
| keywords[2].display_name | Computer science |
| keywords[3].id | https://openalex.org/keywords/component |
| keywords[3].score | 0.43584007024765015 |
| keywords[3].display_name | Component (thermodynamics) |
| keywords[4].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[4].score | 0.3442232012748718 |
| keywords[4].display_name | Artificial intelligence |
| keywords[5].id | https://openalex.org/keywords/physics |
| keywords[5].score | 0.10329276323318481 |
| keywords[5].display_name | Physics |
| keywords[6].id | https://openalex.org/keywords/geography |
| keywords[6].score | 0.09340113401412964 |
| keywords[6].display_name | Geography |
| language | en |
| locations[0].id | pmh:oai:publikationen.sulb.uni-saarland.de:20.500.11880/25975 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306401551 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | SciDok (Saarland University and State Library) |
| locations[0].source.host_organization | https://openalex.org/I91712215 |
| locations[0].source.host_organization_name | Saarland University |
| locations[0].source.host_organization_lineage | https://openalex.org/I91712215 |
| locations[0].license | other-oa |
| locations[0].pdf_url | http://dx.doi.org/10.22028/D291-25919 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | doc-type:doctoralThesis |
| locations[0].license_id | https://openalex.org/licenses/other-oa |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://doi.org/10.22028/D291-25919 |
| locations[1].id | doi:10.22028/d291-25919 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S7407052975 |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Universität des Saarlandes |
| locations[1].source.host_organization | |
| locations[1].source.host_organization_name | |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.22028/d291-25919 |
| locations[2].id | mag:1794943985 |
| locations[2].is_oa | False |
| locations[2].source | |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | |
| locations[2].raw_type | |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | http://scidok.sulb.uni-saarland.de/volltexte/2008/1414/pdf/Dissertation_3692_Pfle_Norb_2007.pdf |
| indexed_in | datacite |
| authorships[0].author.id | https://openalex.org/A5029137584 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Norbert Pfleger |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Norbert Pfleger |
| authorships[0].is_corresponding | True |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | http://dx.doi.org/10.22028/D291-25919 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Context-based multimodal interpretation : an integrated approach to multimodal fusion and discourse processing |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12031 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9997000098228455 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Speech and dialogue systems |
| cited_by_count | 6 |
| counts_by_year[0].year | 2016 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2014 |
| counts_by_year[1].cited_by_count | 1 |
| locations_count | 3 |
| best_oa_location.id | pmh:oai:publikationen.sulb.uni-saarland.de:20.500.11880/25975 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306401551 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | SciDok (Saarland University and State Library) |
| best_oa_location.source.host_organization | https://openalex.org/I91712215 |
| best_oa_location.source.host_organization_name | Saarland University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I91712215 |
| best_oa_location.license | other-oa |
| best_oa_location.pdf_url | http://dx.doi.org/10.22028/D291-25919 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | doc-type:doctoralThesis |
| best_oa_location.license_id | https://openalex.org/licenses/other-oa |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://doi.org/10.22028/D291-25919 |
| primary_location.id | pmh:oai:publikationen.sulb.uni-saarland.de:20.500.11880/25975 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306401551 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | SciDok (Saarland University and State Library) |
| primary_location.source.host_organization | https://openalex.org/I91712215 |
| primary_location.source.host_organization_name | Saarland University |
| primary_location.source.host_organization_lineage | https://openalex.org/I91712215 |
| primary_location.license | other-oa |
| primary_location.pdf_url | http://dx.doi.org/10.22028/D291-25919 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | doc-type:doctoralThesis |
| primary_location.license_id | https://openalex.org/licenses/other-oa |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://doi.org/10.22028/D291-25919 |
| publication_date | 2007-01-01 |
| publication_year | 2007 |
| referenced_works | https://openalex.org/W2040562301, https://openalex.org/W1486798440, https://openalex.org/W1597441641, https://openalex.org/W4547967, https://openalex.org/W2028919349, https://openalex.org/W2005814556, https://openalex.org/W1996337648, https://openalex.org/W1989060945, https://openalex.org/W1544484417, https://openalex.org/W1491947308, https://openalex.org/W1882254825, https://openalex.org/W2148249921, https://openalex.org/W1586232984, https://openalex.org/W2163477142, https://openalex.org/W2150451032, https://openalex.org/W62589995, https://openalex.org/W1540212288, https://openalex.org/W2264742718, https://openalex.org/W2157184357, https://openalex.org/W2139110260, https://openalex.org/W1909730685, https://openalex.org/W2153166272, https://openalex.org/W105773080, https://openalex.org/W1556417835, https://openalex.org/W2111064971, https://openalex.org/W2013489329, https://openalex.org/W201314978, https://openalex.org/W2075123415, https://openalex.org/W1485536319, https://openalex.org/W2014313181, https://openalex.org/W2001722583, https://openalex.org/W173647602, https://openalex.org/W2113272343, https://openalex.org/W1741471588, https://openalex.org/W2315302242, https://openalex.org/W2129264276, https://openalex.org/W2167605410, https://openalex.org/W2047125192, https://openalex.org/W2756715975, https://openalex.org/W1498018502, https://openalex.org/W2215054329, https://openalex.org/W2102682809, https://openalex.org/W1566056932, https://openalex.org/W2056245254, https://openalex.org/W2027687248, https://openalex.org/W2118577739, https://openalex.org/W2147743504, https://openalex.org/W1502172714, https://openalex.org/W2187625321, https://openalex.org/W2149891956, https://openalex.org/W1963080254, https://openalex.org/W2064342727, https://openalex.org/W2061270248, https://openalex.org/W1539395461, https://openalex.org/W1523171189, https://openalex.org/W2757539505, https://openalex.org/W2120605372, https://openalex.org/W50227226, https://openalex.org/W1504157408, https://openalex.org/W2099442061, https://openalex.org/W1498883201, https://openalex.org/W78204198, https://openalex.org/W1529752812, https://openalex.org/W1589781773, https://openalex.org/W1582717763, https://openalex.org/W2056176153, https://openalex.org/W2118163921, https://openalex.org/W2165753447, https://openalex.org/W2085787384, https://openalex.org/W2100517533, https://openalex.org/W2114528521, https://openalex.org/W2169749310, https://openalex.org/W1980548050, https://openalex.org/W2000343728, https://openalex.org/W1991145433, https://openalex.org/W2108453122, https://openalex.org/W1533285128, https://openalex.org/W1614615401, https://openalex.org/W1832126664, https://openalex.org/W1940888119, https://openalex.org/W2913270876, https://openalex.org/W2126891226, https://openalex.org/W2564204706, https://openalex.org/W1495022714, https://openalex.org/W2033586033, https://openalex.org/W2045066932, https://openalex.org/W1576632330, https://openalex.org/W1579372033, https://openalex.org/W2119868545, https://openalex.org/W2025341897, https://openalex.org/W2217772701, https://openalex.org/W1964725106, https://openalex.org/W2327923151, https://openalex.org/W149383679, https://openalex.org/W79106266, https://openalex.org/W3140196993, https://openalex.org/W2153126854, https://openalex.org/W2145919144, https://openalex.org/W1488550131, https://openalex.org/W3135291502, https://openalex.org/W205871115, https://openalex.org/W182831726, https://openalex.org/W2098437222, https://openalex.org/W2100570710, https://openalex.org/W1589110084, https://openalex.org/W1985370873, https://openalex.org/W156454694, https://openalex.org/W1532070457, https://openalex.org/W2123984441, https://openalex.org/W38913623, https://openalex.org/W2136374365, https://openalex.org/W792814583, https://openalex.org/W2076454503, https://openalex.org/W3211721032, https://openalex.org/W2040646018, https://openalex.org/W1847867086, https://openalex.org/W1552206080, https://openalex.org/W17572786, https://openalex.org/W1966204847, https://openalex.org/W1519642432, https://openalex.org/W2135255848, https://openalex.org/W2995748625, https://openalex.org/W2327733529, https://openalex.org/W340532547, https://openalex.org/W1525895495, https://openalex.org/W2030627453, https://openalex.org/W2128560789, https://openalex.org/W1941994672, https://openalex.org/W1984314754, https://openalex.org/W2124741472, https://openalex.org/W1525654170, https://openalex.org/W1978251445, https://openalex.org/W1961647136, https://openalex.org/W2399068511, https://openalex.org/W64910274, https://openalex.org/W1604576211, https://openalex.org/W332028463, https://openalex.org/W2151194828, https://openalex.org/W1584654258, https://openalex.org/W1549026077, https://openalex.org/W1496828312, https://openalex.org/W2033532845, https://openalex.org/W1605655352, https://openalex.org/W1499739753, https://openalex.org/W2082557450, https://openalex.org/W3035008472, https://openalex.org/W2135643110, https://openalex.org/W2109730238, https://openalex.org/W44010021, https://openalex.org/W2124003719, https://openalex.org/W1679907412, https://openalex.org/W2123550348, https://openalex.org/W1567643929, https://openalex.org/W2016063944, https://openalex.org/W1546879020, https://openalex.org/W1837935209, https://openalex.org/W2110482917, https://openalex.org/W2122555327, https://openalex.org/W1591715535, https://openalex.org/W2153168857, https://openalex.org/W1553976193, https://openalex.org/W2007465845 |
| referenced_works_count | 162 |
| abstract_inverted_index.A | 73 |
| abstract_inverted_index.a | 24, 32, 45, 71, 83 |
| abstract_inverted_index.On | 20 |
| abstract_inverted_index.as | 52, 54 |
| abstract_inverted_index.in | 15 |
| abstract_inverted_index.is | 2, 36, 79, 111 |
| abstract_inverted_index.of | 8, 23, 27, 44, 47, 60, 66, 70, 76, 82, 96, 108 |
| abstract_inverted_index.on | 93 |
| abstract_inverted_index.to | 13 |
| abstract_inverted_index.and | 10, 49, 57, 63, 89 |
| abstract_inverted_index.for | 86 |
| abstract_inverted_index.the | 5, 21, 42, 55, 64, 67, 80, 94, 105, 109 |
| abstract_inverted_index.This | 0, 38 |
| abstract_inverted_index.goal | 75 |
| abstract_inverted_index.into | 99 |
| abstract_inverted_index.this | 77, 97 |
| abstract_inverted_index.well | 53 |
| abstract_inverted_index.with | 4 |
| abstract_inverted_index.Based | 92 |
| abstract_inverted_index.basis | 22 |
| abstract_inverted_index.major | 74 |
| abstract_inverted_index.model | 35, 40 |
| abstract_inverted_index.three | 100 |
| abstract_inverted_index.fusion | 88 |
| abstract_inverted_index.shown. | 112 |
| abstract_inverted_index.thesis | 1, 78 |
| abstract_inverted_index.verbal | 9 |
| abstract_inverted_index.context | 34, 39 |
| abstract_inverted_index.generic | 84, 106 |
| abstract_inverted_index.signals | 62 |
| abstract_inverted_index.variety | 46 |
| abstract_inverted_index.analysis | 26 |
| abstract_inverted_index.approach | 110 |
| abstract_inverted_index.detailed | 25 |
| abstract_inverted_index.dialogue | 18, 103 |
| abstract_inverted_index.distinct | 101 |
| abstract_inverted_index.intended | 68 |
| abstract_inverted_index.reactive | 58 |
| abstract_inverted_index.supports | 41 |
| abstract_inverted_index.systems, | 104 |
| abstract_inverted_index.systems. | 19 |
| abstract_inverted_index.component | 85, 98 |
| abstract_inverted_index.concerned | 3 |
| abstract_inverted_index.discourse | 30, 90 |
| abstract_inverted_index.nonverbal | 11 |
| abstract_inverted_index.referring | 48 |
| abstract_inverted_index.developed. | 37 |
| abstract_inverted_index.elliptical | 50 |
| abstract_inverted_index.generation | 59 |
| abstract_inverted_index.multimodal | 16, 29, 87, 102 |
| abstract_inverted_index.multiparty | 17 |
| abstract_inverted_index.phenomena, | 31 |
| abstract_inverted_index.processing | 56 |
| abstract_inverted_index.resolution | 43 |
| abstract_inverted_index.development | 81 |
| abstract_inverted_index.expressions | 51 |
| abstract_inverted_index.integration | 95 |
| abstract_inverted_index.processing. | 91 |
| abstract_inverted_index.turn-taking | 61 |
| abstract_inverted_index.addressee(s) | 69 |
| abstract_inverted_index.interactions | 14 |
| abstract_inverted_index.applicability | 107 |
| abstract_inverted_index.comprehensive | 33 |
| abstract_inverted_index.context-based | 6 |
| abstract_inverted_index.contribution. | 72 |
| abstract_inverted_index.contributions | 12 |
| abstract_inverted_index.identification | 65 |
| abstract_inverted_index.interpretation | 7 |
| abstract_inverted_index.context-dependent | 28 |
| cited_by_percentile_year | |
| corresponding_author_ids | https://openalex.org/A5029137584 |
| countries_distinct_count | 0 |
| institutions_distinct_count | 1 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/4 |
| sustainable_development_goals[0].score | 0.46000000834465027 |
| sustainable_development_goals[0].display_name | Quality Education |
| citation_normalized_percentile |