fMRI-Based robotic embodiment: Controlling a humanoid robot by thought using real-time fMRI

Ori Cohen; Sébastien Druon; Sébastien Lengagne; Avi Mendelsohn; Rafael Malach; Abderrahmane Kheddar; Doron Friedman

doi:10.1162/PRES_a_00191

fMRI-Based robotic embodiment: Controlling a humanoid robot by thought using real-time fMRI

Ori Cohen, Sébastien Druon, Sébastien Lengagne, Avi Mendelsohn, Rafael Malach, Abderrahmane Kheddar, Doron Friedman

Research output: Contribution to journal › Article › peer-review

Abstract

We present a robotic embodiment experiment based on real-time functional magnetic resonance imaging (rt-fMRI). In this study, fMRI is used as an input device to identify a subject’s intentions and convert them into actions performed by a humanoid robot. The process, based on motor imagery, has allowed four subjects located in Israel to control a HOAP3 humanoid robot in France, in a relatively natural manner, experiencing the whole experiment through the eyes of the robot. Motor imagery or movement of the left hand, the right hand, or the legs were used to control the robotic motions of left, right, or walk forward, respectively.

Original language	English
Pages (from-to)	229-241
Number of pages	13
Journal	Presence: Teleoperators and Virtual Environments
Volume	23
Issue number	3
DOIs	https://doi.org/10.1162/PRES_a_00191
State	Published - 1 Oct 2014
Externally published	Yes

Bibliographical note

Publisher Copyright:
© 2014 by the Massachusetts Institute of Technology.

ASJC Scopus subject areas

Software
Control and Systems Engineering
Human-Computer Interaction
Computer Vision and Pattern Recognition

Access to Document

10.1162/PRES_a_00191

Cite this

@article{5431de5874a74ebfb431cae7af4a9435,

title = "fMRI-Based robotic embodiment: Controlling a humanoid robot by thought using real-time fMRI",

abstract = "We present a robotic embodiment experiment based on real-time functional magnetic resonance imaging (rt-fMRI). In this study, fMRI is used as an input device to identify a subject{\textquoteright}s intentions and convert them into actions performed by a humanoid robot. The process, based on motor imagery, has allowed four subjects located in Israel to control a HOAP3 humanoid robot in France, in a relatively natural manner, experiencing the whole experiment through the eyes of the robot. Motor imagery or movement of the left hand, the right hand, or the legs were used to control the robotic motions of left, right, or walk forward, respectively.",

author = "Ori Cohen and S{\'e}bastien Druon and S{\'e}bastien Lengagne and Avi Mendelsohn and Rafael Malach and Abderrahmane Kheddar and Doron Friedman",

note = "Publisher Copyright: {\textcopyright} 2014 by the Massachusetts Institute of Technology.",

year = "2014",

month = oct,

day = "1",

doi = "10.1162/PRES_a_00191",

language = "English",

volume = "23",

pages = "229--241",

journal = "Presence: Teleoperators and Virtual Environments",

issn = "1054-7460",

publisher = "MIT Press Journals",

number = "3",

}

TY - JOUR

T1 - fMRI-Based robotic embodiment

T2 - Controlling a humanoid robot by thought using real-time fMRI

AU - Cohen, Ori

AU - Druon, Sébastien

AU - Lengagne, Sébastien

AU - Mendelsohn, Avi

AU - Malach, Rafael

AU - Kheddar, Abderrahmane

AU - Friedman, Doron

PY - 2014/10/1

Y1 - 2014/10/1

N2 - We present a robotic embodiment experiment based on real-time functional magnetic resonance imaging (rt-fMRI). In this study, fMRI is used as an input device to identify a subject’s intentions and convert them into actions performed by a humanoid robot. The process, based on motor imagery, has allowed four subjects located in Israel to control a HOAP3 humanoid robot in France, in a relatively natural manner, experiencing the whole experiment through the eyes of the robot. Motor imagery or movement of the left hand, the right hand, or the legs were used to control the robotic motions of left, right, or walk forward, respectively.

AB - We present a robotic embodiment experiment based on real-time functional magnetic resonance imaging (rt-fMRI). In this study, fMRI is used as an input device to identify a subject’s intentions and convert them into actions performed by a humanoid robot. The process, based on motor imagery, has allowed four subjects located in Israel to control a HOAP3 humanoid robot in France, in a relatively natural manner, experiencing the whole experiment through the eyes of the robot. Motor imagery or movement of the left hand, the right hand, or the legs were used to control the robotic motions of left, right, or walk forward, respectively.

UR - http://www.scopus.com/inward/record.url?scp=84918580714&partnerID=8YFLogxK

U2 - 10.1162/PRES_a_00191

DO - 10.1162/PRES_a_00191

M3 - Article

AN - SCOPUS:84918580714

SN - 1054-7460

VL - 23

SP - 229

EP - 241

JO - Presence: Teleoperators and Virtual Environments

JF - Presence: Teleoperators and Virtual Environments

IS - 3

ER -

fMRI-Based robotic embodiment: Controlling a humanoid robot by thought using real-time fMRI

Abstract

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this