PDF] Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses

An encoder-decoder transfer learning method from computer vision is adapted to investigate the structure among 100 different feature spaces extracted from hidden representations of various networks trained on language tasks and reveals a low-dimensional structure where language models and translation models smoothly interpolate between word embeddings, syntactic and semantic tasks, and future word embedDings. How related are the representations learned by neural language models, translation models, and language tagging tasks? We answer this question by adapting an encoder-decoder transfer learning method from computer vision to investigate the structure among 100 different feature spaces extracted from hidden representations of various networks trained on language tasks. This method reveals a low-dimensional structure where language models and translation models smoothly interpolate between word embeddings, syntactic and semantic tasks, and future word embeddings. We call this low-dimensional structure a language representation embedding because it encodes the relationships between representations needed to process language for a variety of NLP tasks. We find that this representation embedding can predict how well each individual feature space maps to human brain responses to natural language stimuli recorded using fMRI. Additionally, we find that the principal dimension of this structure can be used to create a metric which highlights the brain's natural language processing hierarchy. This suggests that the embedding captures some part of the brain's natural language representation structure.

Report of the International Bioethics Committee (IBC) on the principle of protecting future generations

PDF) The representation of space in the brain

Degrees of algorithmic equivalence between the brain and its DNN models: Trends in Cognitive Sciences

PDF) Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses

Sensors, Free Full-Text

How ChatGPT Works: The Model Behind The Bot, by Molly Ruby

Multi-view manifold learning of human brain-state trajectories

Large-scale neural dynamics in a shared low-dimensional state space reflect cognitive and attentional dynamics

PDF] Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses

PDF) The representation of space in the brain

Decoding the information structure underlying the neural representation of concepts

A Focus on Subtle Signs and Motor Behavior to Unveil Awareness in Unresponsive Brain-Impaired Patients

Neural representation of linguistic feature hierarchy reflects second- language proficiency - ScienceDirect

Improving the study of brain-behavior relationships by revisiting basic assumptions: Trends in Cognitive Sciences

Mapping the deficit dimension structure of the National Institutes of Health Stroke Scale - eBioMedicine