- Tytuł:
- Neural heuristics for scaling constructional language processing
- Autorzy:
-
Van Eecke, Paul
Nevens, Jens
Beuls, Katrien - Powiązania:
- https://bibliotekanauki.pl/articles/24201225.pdf
- Data publikacji:
- 2022
- Wydawca:
- Polska Akademia Nauk. Instytut Podstaw Informatyki PAN
- Tematy:
-
neuro-symbolic AI
neural heuristics
language processing
computational construction grammar - Opis:
- Constructionist approaches to language make use of form-meaning pairings, called constructions, to capture all linguistic knowledge that is necessary for comprehending and producing natural language expressions. Language processing consists then in combining the constructions of a grammar in such a way that they solve a given language comprehension or production problem. Finding such an adequate sequence of constructions constitutes a search problem that is combinatorial in nature and becomes intractable as grammars increase in size. In this paper, we introduce a neural methodology for learning heuristics that substantially optimise the search processes involved in constructional language processing. We validate the methodology in a case study for the CLEVR benchmark dataset. We show that our novel methodology outperforms state-of-the-art techniques in terms of size of the search space and time of computation, most markedly in the production direction. The results reported on in this paper have the potential to overcome the major efficiency obstacle that hinders current efforts in learning large-scale construction grammars, thereby contributing to the development of scalable constructional language processing systems.
- Źródło:
-
Journal of Language Modelling; 2022, 10, 2; 287--314.
2299-856X
2299-8470 - Pojawia się w:
- Journal of Language Modelling
- Dostawca treści:
- Biblioteka Nauki
Artykuł