- Tytuł:
- Aligning speech and co-speech gestu re in a constraint-based grammar
- Autorzy:
-
Alahverdzhieva, K.
Lascarides, A.
Flickinger, D. - Powiązania:
- https://bibliotekanauki.pl/articles/103813.pdf
- Data publikacji:
- 2017
- Wydawca:
- Polska Akademia Nauk. Instytut Podstaw Informatyki PAN
- Tematy:
-
co-speech gesture
constraint-based grammar
compositional semantics
underspecification - Opis:
- This paper concerns the form-meaning mapping of communicative action consisting of speech and improvised co-speech gestures. Based on the findings of previous cognitive and computational approaches, we advance a new theory in which this form-meaning mapping is analysed in a constraint-based grammar. Motivated by observations in naturally occurring examples, we propose several construction rules, which use linguistic form, gesture form and their relative timing to constrain the derivation of a single speech-gesture syntax tree, from which a meaning representation can be composed via standard methods for semantic composition. The paper further reports on implementing these speech-gesture construction rules within the English Resource Grammar (Flickinger 2000). Since gestural form of ten underspecifies its meaning, the logical formulae that are composed via syntax are underspecified so that current models of the semantics/pragmatics interface support the range of possible interpretations of the speech-gesture act in its context of use.
- Źródło:
-
Journal of Language Modelling; 2017, 5, 3; 421-464
2299-856X
2299-8470 - Pojawia się w:
- Journal of Language Modelling
- Dostawca treści:
- Biblioteka Nauki
Artykuł