Probing Word Syntactic Representations in the Brain by a Feature Elimination Method

Abstract

Neuroimaging studies have identified multiple brain regions that are associated with semantic and syntactic processing when comprehending language. However, existing methods cannot explore the neural correlates of fine-grained word syntactic features, such as part-of-speech and dependency relations. This paper proposes an alternative framework to study how different word syntactic features are represented in the brain. To separate each syntactic feature, we propose a feature elimination method, called Mean Vector Null space Projection (MVNP). This method can remove a specific feature from word representations, resulting in one-feature-removed representations. Then we respectively associate one-feature-removed and the original word vectors with brain imaging data to explore how the brain represents the removed feature. This paper for the first time studies the cortical representations of multiple fine-grained syntactic features simultaneously and suggests some possible contributions of several brain regions to the complex division of syntactic processing. These findings indicate that the brain foundations of syntactic information processing might be broader than those suggested by classical studies.

Cite

Text

Zhang et al. "Probing Word Syntactic Representations in the Brain by a Feature Elimination Method." AAAI Conference on Artificial Intelligence, 2022. doi:10.1609/AAAI.V36I10.21427

Markdown

[Zhang et al. "Probing Word Syntactic Representations in the Brain by a Feature Elimination Method." AAAI Conference on Artificial Intelligence, 2022.](https://mlanthology.org/aaai/2022/zhang2022aaai-probing/) doi:10.1609/AAAI.V36I10.21427

BibTeX

@inproceedings{zhang2022aaai-probing,
  title     = {{Probing Word Syntactic Representations in the Brain by a Feature Elimination Method}},
  author    = {Zhang, Xiaohan and Wang, Shaonan and Lin, Nan and Zhang, Jiajun and Zong, Chengqing},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2022},
  pages     = {11721-11729},
  doi       = {10.1609/AAAI.V36I10.21427},
  url       = {https://mlanthology.org/aaai/2022/zhang2022aaai-probing/}
}