Carnegie Mellon University
Browse
Yang_Just_Brain-Lang-2017_CCBI-preprint_3-languages+supplemental.pdf (2.13 MB)

Commonalities and differences in the neural representations of English, Portuguese, and Mandarin sentences: when knowledge of the brain-language mappings for two languages is better than one

Download (2.13 MB)
journal contribution
posted on 2020-06-17, 23:19 authored by Ying YangYing Yang, Jing WangJing Wang, Cyntia Bailer, Vladimir CherkasskyVladimir Cherkassky, Marcel JustMarcel Just
This study extended cross-language semantic decoding (based on a concept’s fMRI signature) to the decoding of sentences across three different languages (English, Portuguese and Mandarin). A classifier was trained on either the mapping between words and activation patterns in one language or the mappings in two languages (using an equivalent amount of training data), and then tested on its ability to decode the semantic content of a third language. The model trained on two languages was reliably more accurate than a classifier trained on one language for all three pairs of languages. This two-language advantage was selective to abstract concept domains such as social interactions and mental activity. Representational Similarity Analyses (RSA) of the inter-sentence neural similarities resulted in similar clustering of sentences in all the three languages, indicating a shared neural concept space among languages. These findings identify semantic domains that are common across these three languages versus those that are more language or culture-specific.

Funding

IARPA via AFRL FA8650-13-C-7360

History

Publisher Statement

Yang, Y., Wang, J., Bailer, C., Cherkassky, V., & Just, M. A. (2017). Commonalities and differences in the neural representations of English, Portuguese, and Mandarin sentences: When knowledge of the brain-language mappings for two languages is better than one. Brain and Language, 175, 77-85. doi:10.1016/j.bandl.2017.09.007 © 2017 Elsevier Inc.

Date

2017-09-29

Usage metrics

    Categories

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC