CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task

Yuhang Zhao; Sarit Szpiro; Jonathan Knighten; Shiri Azenkot

doi:10.1145/2971648.2971730

CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task

Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, Shiri Azenkot

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Visual search is a major challenge for low vision people. Conventional vision enhancements like magnification help low vision people see more details, but cannot indicate the location of a target in a visual search task. In this paper, we explore visual cues-a new approach to facilitate visual search tasks for low vision people. We focus on product search and present CueSee, an augmented reality application on a head-mounted display (HMD) that facilitates product search by recognizing the product automatically and using visual cues to direct the user's attention to the product. We designed five visual cues that users can combine to suit their visual condition. We evaluated the visual cues with 12 low vision participants and found that participants preferred using our cues to conventional enhancements for product search. We also found that CueSee outperformed participants' bestcorrected vision in both time and accuracy.

Original language	English
Title of host publication	UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing
Publisher	Association for Computing Machinery, Inc
Pages	73-84
Number of pages	12
ISBN (Electronic)	9781450344616
DOIs	https://doi.org/10.1145/2971648.2971730
State	Published - 12 Sep 2016
Externally published	Yes
Event	2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016 - Heidelberg, Germany Duration: 12 Sep 2016 → 16 Sep 2016

Publication series

Name	UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Conference

Conference	2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016
Country/Territory	Germany
City	Heidelberg
Period	12/09/16 → 16/09/16

Bibliographical note

Publisher Copyright:
© 2016 ACM.

Keywords

Augmented reality
Head-mounted systems
Low vision

ASJC Scopus subject areas

Information Systems
Hardware and Architecture
Computer Networks and Communications
Software
Human-Computer Interaction

Access to Document

10.1145/2971648.2971730

Cite this

Zhao, Y., Szpiro, S., Knighten, J., & Azenkot, S. (2016). CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task. In UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 73-84). (UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing). Association for Computing Machinery, Inc. https://doi.org/10.1145/2971648.2971730

Zhao, Yuhang ; Szpiro, Sarit ; Knighten, Jonathan et al. / CueSee : Exploring Visual cues for people with low vision to facilitate a visual search task. UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery, Inc, 2016. pp. 73-84 (UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing).

@inproceedings{9578b3e3f8d94c35895c3ad7402304cf,

title = "CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task",

abstract = "Visual search is a major challenge for low vision people. Conventional vision enhancements like magnification help low vision people see more details, but cannot indicate the location of a target in a visual search task. In this paper, we explore visual cues-a new approach to facilitate visual search tasks for low vision people. We focus on product search and present CueSee, an augmented reality application on a head-mounted display (HMD) that facilitates product search by recognizing the product automatically and using visual cues to direct the user's attention to the product. We designed five visual cues that users can combine to suit their visual condition. We evaluated the visual cues with 12 low vision participants and found that participants preferred using our cues to conventional enhancements for product search. We also found that CueSee outperformed participants' bestcorrected vision in both time and accuracy.",

keywords = "Augmented reality, Head-mounted systems, Low vision",

author = "Yuhang Zhao and Sarit Szpiro and Jonathan Knighten and Shiri Azenkot",

note = "Publisher Copyright: {\textcopyright} 2016 ACM.; 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016 ; Conference date: 12-09-2016 Through 16-09-2016",

year = "2016",

month = sep,

day = "12",

doi = "10.1145/2971648.2971730",

language = "English",

series = "UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing",

publisher = "Association for Computing Machinery, Inc",

pages = "73--84",

booktitle = "UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing",

}

Zhao, Y, Szpiro, S, Knighten, J & Azenkot, S 2016, CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task. in UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Association for Computing Machinery, Inc, pp. 73-84, 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016, Heidelberg, Germany, 12/09/16. https://doi.org/10.1145/2971648.2971730

CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task. / Zhao, Yuhang; Szpiro, Sarit; Knighten, Jonathan et al.
UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery, Inc, 2016. p. 73-84 (UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - CueSee

T2 - 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016

AU - Zhao, Yuhang

AU - Szpiro, Sarit

AU - Knighten, Jonathan

AU - Azenkot, Shiri

PY - 2016/9/12

Y1 - 2016/9/12

N2 - Visual search is a major challenge for low vision people. Conventional vision enhancements like magnification help low vision people see more details, but cannot indicate the location of a target in a visual search task. In this paper, we explore visual cues-a new approach to facilitate visual search tasks for low vision people. We focus on product search and present CueSee, an augmented reality application on a head-mounted display (HMD) that facilitates product search by recognizing the product automatically and using visual cues to direct the user's attention to the product. We designed five visual cues that users can combine to suit their visual condition. We evaluated the visual cues with 12 low vision participants and found that participants preferred using our cues to conventional enhancements for product search. We also found that CueSee outperformed participants' bestcorrected vision in both time and accuracy.

AB - Visual search is a major challenge for low vision people. Conventional vision enhancements like magnification help low vision people see more details, but cannot indicate the location of a target in a visual search task. In this paper, we explore visual cues-a new approach to facilitate visual search tasks for low vision people. We focus on product search and present CueSee, an augmented reality application on a head-mounted display (HMD) that facilitates product search by recognizing the product automatically and using visual cues to direct the user's attention to the product. We designed five visual cues that users can combine to suit their visual condition. We evaluated the visual cues with 12 low vision participants and found that participants preferred using our cues to conventional enhancements for product search. We also found that CueSee outperformed participants' bestcorrected vision in both time and accuracy.

KW - Augmented reality

KW - Head-mounted systems

KW - Low vision

UR - http://www.scopus.com/inward/record.url?scp=84991506027&partnerID=8YFLogxK

U2 - 10.1145/2971648.2971730

DO - 10.1145/2971648.2971730

M3 - Conference contribution

AN - SCOPUS:84991506027

T3 - UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

SP - 73

EP - 84

BT - UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

PB - Association for Computing Machinery, Inc

Y2 - 12 September 2016 through 16 September 2016

ER -

Zhao Y, Szpiro S, Knighten J, Azenkot S. CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task. In UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. Association for Computing Machinery, Inc. 2016. p. 73-84. (UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing). doi: 10.1145/2971648.2971730

CueSee: Exploring Visual cues for people with low vision to facilitate a visual search task

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this