Abstract
We present a sensory substitution-based method for representing locations of remote objects in 3D space via haptics. By imitating auditory localization processes, we enable vibrotactile localization abilities similar to those of some spiders, elephants, and other species. We evaluated this concept in virtual reality by modulating the vibration amplitude of two controllers depending on relative locations to a target. We developed two implementations applying this method using either ear or hand locations. A proof-of-concept study assessed localization performance and user experience, achieving under 30° differentiation between horizontal targets with no prior training. This unique approach enables localization by using only two actuators, requires low computational power, and could potentially assist users in gaining spatial awareness in challenging environments. We compare the implementations and discuss the use of hands as ears in motion, a novel technique not previously explored in the sensory substitution literature.
| Original language | English |
|---|---|
| Title of host publication | CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems |
| Publisher | Association for Computing Machinery |
| ISBN (Electronic) | 9798400713941 |
| DOIs | |
| State | Published - 26 Apr 2025 |
| Event | 2025 CHI Conference on Human Factors in Computing Systems, CHI 2025 - Yokohama, Japan Duration: 26 Apr 2025 → 1 May 2025 |
Publication series
| Name | Conference on Human Factors in Computing Systems - Proceedings |
|---|
Conference
| Conference | 2025 CHI Conference on Human Factors in Computing Systems, CHI 2025 |
|---|---|
| Country/Territory | Japan |
| City | Yokohama |
| Period | 26/04/25 → 1/05/25 |
Bibliographical note
Publisher Copyright:© 2025 Copyright held by the owner/author(s).
Keywords
- Haptic
- Localization
- Sensory substitution
- Spatial perception
- Tactile
ASJC Scopus subject areas
- Human-Computer Interaction
- Computer Graphics and Computer-Aided Design
- Software