Tuesday, 4th October 2022 - 12pm - G.J. (Gijs) Wijnholds : Seminar Title: Discontinuous Constituency and BERT: A Case Study of Dutch Abstract: In this paper, we set out to quantify the syntactic capacity of BERT in the evaluation regime of non-context free patterns, as occurring in Dutch. We devise a test suite based on a mildly context-sensitive formalism, from which we derive grammars that capture the linguistic phenomena of control verb nesting and verb raising. The grammars, paired with a small lexicon, provide us with a large collection of naturalistic utterances, annotated with verb-subject pairings, that serve as the evaluation test bed for an attention-based span selection probe. Our results, backed by extensive analysis, suggest that the models investigated fail in the implicit acquisition of the dependencies examined. With any leftover time, I will discuss some work in progress where we re-iterate the experiment but starting from an Abstract Categorial Grammar style modelling, which then allows us to perform more detailed analysis of the results. Paper: https://aclanthology.org/2022.findings-acl.298/ Add to your calendar vCal iCal Oct 04 2022 12.00 - 13.00 Tuesday, 4th October 2022 - 12pm - G.J. (Gijs) Wijnholds : Seminar This a joint seminar organised by ILCC/CDT NLP. G.03, Informatics Forum In person only Contact
Tuesday, 4th October 2022 - 12pm - G.J. (Gijs) Wijnholds : Seminar Title: Discontinuous Constituency and BERT: A Case Study of Dutch Abstract: In this paper, we set out to quantify the syntactic capacity of BERT in the evaluation regime of non-context free patterns, as occurring in Dutch. We devise a test suite based on a mildly context-sensitive formalism, from which we derive grammars that capture the linguistic phenomena of control verb nesting and verb raising. The grammars, paired with a small lexicon, provide us with a large collection of naturalistic utterances, annotated with verb-subject pairings, that serve as the evaluation test bed for an attention-based span selection probe. Our results, backed by extensive analysis, suggest that the models investigated fail in the implicit acquisition of the dependencies examined. With any leftover time, I will discuss some work in progress where we re-iterate the experiment but starting from an Abstract Categorial Grammar style modelling, which then allows us to perform more detailed analysis of the results. Paper: https://aclanthology.org/2022.findings-acl.298/ Add to your calendar vCal iCal Oct 04 2022 12.00 - 13.00 Tuesday, 4th October 2022 - 12pm - G.J. (Gijs) Wijnholds : Seminar This a joint seminar organised by ILCC/CDT NLP. G.03, Informatics Forum In person only Contact
Oct 04 2022 12.00 - 13.00 Tuesday, 4th October 2022 - 12pm - G.J. (Gijs) Wijnholds : Seminar This a joint seminar organised by ILCC/CDT NLP.
