Dissemin is shutting down on January 1st, 2025

Published in

2012 Second International Workshop on Pattern Recognition in NeuroImaging

DOI: 10.1109/prni.2012.20

Links

Tools

Export citation

Search in Google Scholar

Decoding Visual Percepts Induced by Word Reading with fMRI

Proceedings article published in 2012 by Alexandre Gramfort, Christophe Pallier, Gaël Varoquaux ORCID, Bertrand Thirion
This paper is available in a repository.
This paper is available in a repository.

Full text: Download

Green circle
Preprint: archiving allowed
Green circle
Postprint: archiving allowed
Red circle
Published version: archiving forbidden
Data provided by SHERPA/RoMEO

Abstract

Word reading involves multiple cognitive processes. To infer which word is being visualized, the brain first processes the visual percept, deciphers the letters, bigrams, and activates different words based on context or prior expectation like word frequency. In this contribution, we use supervised machine learning techniques to decode the first step of this processing stream using functional Magnetic Resonance Images (fMRI). We build a decoder that predicts the visual percept formed by four letter words, allowing us to identify words that were not present in the training data. To do so, we cast the learning problem as multiple classification problems after describing words with multiple binary attributes. This work goes beyond the identification or reconstruction of single letters or simple geometrical shapes [1], [2] and addresses a challenging estimation problem, that is the prediction of multiple variables from a single observation, hence facing the problem of learning multiple predictors from correlated inputs.