Spatial Haptics: A Sensory Substitution Method for Distal Object Detection Using Tactile Cues

Iddo Yehoshua Wald, Donald Degraen, Amber Maimon, Jonas Keppel, Stefan Schneegass, Rainer Malaka

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a sensory substitution-based method for representing locations of remote objects in 3D space via haptics. By imitating auditory localization processes, we enable vibrotactile localization abilities similar to those of some spiders, elephants, and other species. We evaluated this concept in virtual reality by modulating the vibration amplitude of two controllers depending on relative locations to a target. We developed two implementations applying this method using either ear or hand locations. A proof-of-concept study assessed localization performance and user experience, achieving under 30° differentiation between horizontal targets with no prior training. This unique approach enables localization by using only two actuators, requires low computational power, and could potentially assist users in gaining spatial awareness in challenging environments. We compare the implementations and discuss the use of hands as ears in motion, a novel technique not previously explored in the sensory substitution literature.

Original languageEnglish
Title of host publicationCHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400713941
DOIs
StatePublished - 26 Apr 2025
Event2025 CHI Conference on Human Factors in Computing Systems, CHI 2025 - Yokohama, Japan
Duration: 26 Apr 20251 May 2025

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2025 CHI Conference on Human Factors in Computing Systems, CHI 2025
Country/TerritoryJapan
CityYokohama
Period26/04/251/05/25

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Keywords

  • Haptic
  • Localization
  • Sensory substitution
  • Spatial perception
  • Tactile

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint

Dive into the research topics of 'Spatial Haptics: A Sensory Substitution Method for Distal Object Detection Using Tactile Cues'. Together they form a unique fingerprint.

Cite this