Learning shared neural manifolds from multi-subject FMRI data Article Swipe

MAKE IMPACT

Jessie Huang , Erica L. Busch , Tom Wallenstein , Michal Gerasimiuk , Andrew Benz , Guillaume Lajoie , Guy Wolf , Nicholas B. Turk‐Browne , Smita Krishnaswamy · YOU? · · 2021 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2201.00622

Functional magnetic resonance imaging (fMRI) is a notoriously noisy measurement of brain activity because of the large variations between individuals, signals marred by environmental differences during collection, and spatiotemporal averaging required by the measurement resolution. In addition, the data is extremely high dimensional, with the space of the activity typically having much lower intrinsic dimension. In order to understand the connection between stimuli of interest and brain activity, and analyze differences and commonalities between subjects, it becomes important to learn a meaningful embedding of the data that denoises, and reveals its intrinsic structure. Specifically, we assume that while noise varies significantly between individuals, true responses to stimuli will share common, low-dimensional features between subjects which are jointly discoverable. Similar approaches have been exploited previously but they have mainly used linear methods such as PCA and shared response modeling (SRM). In contrast, we propose a neural network called MRMD-AE (manifold-regularized multiple decoder, autoencoder), that learns a common embedding from multiple subjects in an experiment while retaining the ability to decode to individual raw fMRI signals. We show that our learned common space represents an extensible manifold (where new points not seen during training can be mapped), improves the classification accuracy of stimulus features of unseen timepoints, as well as improves cross-subject translation of fMRI signals. We believe this framework can be used for many downstream applications such as guided brain-computer interface (BCI) training in the future.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2201.00622

PDF

https://arxiv.org/pdf/2201.00622

OA Status

green

Cited By

4

Related Works

10

OpenAlex ID

https://openalex.org/W4226429377

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4226429377

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2201.00622

Digital Object Identifier

Title

Learning shared neural manifolds from multi-subject FMRI data

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2021

Year of publication

Publication date

2021-12-22

Full publication date if available

Authors

Jessie Huang, Erica L. Busch, Tom Wallenstein, Michal Gerasimiuk, Andrew Benz, Guillaume Lajoie, Guy Wolf, Nicholas B. Turk‐Browne, Smita Krishnaswamy

List of authors in order

Landing page

https://arxiv.org/abs/2201.00622

Publisher landing page

PDF URL

https://arxiv.org/pdf/2201.00622

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2201.00622

Direct OA link when available

Concepts

Computer science, Embedding, Functional magnetic resonance imaging, Artificial intelligence, Nonlinear dimensionality reduction, Autoencoder, Pattern recognition (psychology), Brain–computer interface, Brain activity and meditation, Stimulus (psychology), Artificial neural network, Machine learning, Dimensionality reduction, Psychology, Neuroscience, Electroencephalography, Cognitive psychology

Top concepts (fields/topics) attached by OpenAlex

Cited by

4

Total citation count in OpenAlex

Citations by year (recent)

2025: 1, 2024: 2, 2022: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload