Recognizing deep grammatical information during reading from event related fMRI

Haim Shalelashvili, Tali Bitan, Alex Frid, Hananel Hazan, Stav Hertz, Yael Weiss, Larry M. Manevitz

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This experiment was designed to see if information related to linguistic characteristics of read text can be deduced from fMRI data via machine learning techniques. Individuals were scanned while reading text the size of words in loud reading. Three experiments were performed corresponding to different degrees of grammatical complexity that is performed during loud reading: (1) words and pseudo-words were presented to subjects; (2) words with diacritical marking and words without diacritical markings were presented to subjects; (3) Hebrew words with Hebrew root and Hebrew words without Hebrew root were presented to subjects. The working hypothesis was that the more complex the needed grammatical processing needed, the more difficult it should be to perform the classification at the level of temporal and spatial resolution given by an fMRI signal. We were able to accomplish the first task completely. The second and third task did not succeed when all the data is used simultaneously. However, the third task was successful when training and testing was done within a continuous scanning run. (The experimental protocol did not allow this for the second task.) This does establish that complex linguistic information is decodable from fMRI scans. On the other hand, the need to restrict to the intra-run situation indicates that additional work is needed to compensate for distortions introduced between scanning runs.

Original languageEnglish
Title of host publication2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479959877
DOIs
StatePublished - 2014
Event2014 28th IEEE Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014 - Eilat, Israel
Duration: 3 Dec 20145 Dec 2014

Publication series

Name2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014

Conference

Conference2014 28th IEEE Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014
Country/TerritoryIsrael
CityEilat
Period3/12/145/12/14

Bibliographical note

Publisher Copyright:
© Copyright 2015 IEEE All rights reserved.

Keywords

  • Cognitive Processing
  • Functional magnetic resonance imaging (fMRI)
  • Machine Learning
  • Multivoxel pattern analysis (MVPA)
  • Neural Networks
  • Pattern Matching

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Recognizing deep grammatical information during reading from event related fMRI'. Together they form a unique fingerprint.

Cite this