Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles

Felix Tener; Joel Lanir

doi:10.1145/3581961.3609845

Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles

Felix Tener, Joel Lanir

Department of Information Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Autonomous vehicles (AVs) are a disruptive mode of transportation that is rapidly advancing. However, it is widely acknowledged in industry and academia that AVs may not be capable of handling every traffic situation independently, necessitating remote human intervention. Existing teleoperation methods face significant challenges, highlighting the need for innovative remote operation approaches. One such approach is tele-assistance, where remote operators (ROs) offer high-level guidance while delegating low-level controls to automation. Our research focuses on designing a tele-assistance interface. By interviewing 14 AV teleoperation experts and conducting an elicitation study with 17 experienced teleoperators, we identify road scenarios requiring remote human assistance. We then devise a set of discrete high-level commands that enable the resolution of these scenarios without manually controlling AVs. Finally, we integrate these findings into the design of a novel user interface for teleoperating autonomous vehicles.

Original language	English
Title of host publication	15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings
Publisher	Association for Computing Machinery
Pages	287-290
Number of pages	4
ISBN (Electronic)	9798400701122
DOIs	https://doi.org/10.1145/3581961.3609845
State	Published - 18 Sep 2023
Event	15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Ingolstadt, Germany Duration: 18 Sep 2023 → 21 Sep 2023

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023
Country/Territory	Germany
City	Ingolstadt
Period	18/09/23 → 21/09/23

Bibliographical note

Publisher Copyright:
© 2023 Owner/Author.

Keywords

Automobile
Qualitative Methods
Teleoperation
User interface design

ASJC Scopus subject areas

Human-Computer Interaction
Computer Networks and Communications
Computer Vision and Pattern Recognition
Software

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3581961.3609845

Cite this

Tener, F., & Lanir, J. (2023). Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles. In 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings (pp. 287-290). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3581961.3609845

Tener, Felix ; Lanir, Joel. / Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles. 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings. Association for Computing Machinery, 2023. pp. 287-290 (ACM International Conference Proceeding Series).

@inproceedings{0ea15726fcfc4a029ace5081f829c3a1,

title = "Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles",

abstract = "Autonomous vehicles (AVs) are a disruptive mode of transportation that is rapidly advancing. However, it is widely acknowledged in industry and academia that AVs may not be capable of handling every traffic situation independently, necessitating remote human intervention. Existing teleoperation methods face significant challenges, highlighting the need for innovative remote operation approaches. One such approach is tele-assistance, where remote operators (ROs) offer high-level guidance while delegating low-level controls to automation. Our research focuses on designing a tele-assistance interface. By interviewing 14 AV teleoperation experts and conducting an elicitation study with 17 experienced teleoperators, we identify road scenarios requiring remote human assistance. We then devise a set of discrete high-level commands that enable the resolution of these scenarios without manually controlling AVs. Finally, we integrate these findings into the design of a novel user interface for teleoperating autonomous vehicles.",

keywords = "Automobile, Qualitative Methods, Teleoperation, User interface design",

author = "Felix Tener and Joel Lanir",

note = "Publisher Copyright: {\textcopyright} 2023 Owner/Author.; 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 ; Conference date: 18-09-2023 Through 21-09-2023",

year = "2023",

month = sep,

day = "18",

doi = "10.1145/3581961.3609845",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

pages = "287--290",

booktitle = "15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings",

address = "United States",

}

Tener, F & Lanir, J 2023, Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles. in 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings. ACM International Conference Proceeding Series, Association for Computing Machinery, pp. 287-290, 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023, Ingolstadt, Germany, 18/09/23. https://doi.org/10.1145/3581961.3609845

Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles. / Tener, Felix ; Lanir, Joel.
15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings. Association for Computing Machinery, 2023. p. 287-290 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles

AU - Tener, Felix

AU - Lanir, Joel

PY - 2023/9/18

Y1 - 2023/9/18

N2 - Autonomous vehicles (AVs) are a disruptive mode of transportation that is rapidly advancing. However, it is widely acknowledged in industry and academia that AVs may not be capable of handling every traffic situation independently, necessitating remote human intervention. Existing teleoperation methods face significant challenges, highlighting the need for innovative remote operation approaches. One such approach is tele-assistance, where remote operators (ROs) offer high-level guidance while delegating low-level controls to automation. Our research focuses on designing a tele-assistance interface. By interviewing 14 AV teleoperation experts and conducting an elicitation study with 17 experienced teleoperators, we identify road scenarios requiring remote human assistance. We then devise a set of discrete high-level commands that enable the resolution of these scenarios without manually controlling AVs. Finally, we integrate these findings into the design of a novel user interface for teleoperating autonomous vehicles.

AB - Autonomous vehicles (AVs) are a disruptive mode of transportation that is rapidly advancing. However, it is widely acknowledged in industry and academia that AVs may not be capable of handling every traffic situation independently, necessitating remote human intervention. Existing teleoperation methods face significant challenges, highlighting the need for innovative remote operation approaches. One such approach is tele-assistance, where remote operators (ROs) offer high-level guidance while delegating low-level controls to automation. Our research focuses on designing a tele-assistance interface. By interviewing 14 AV teleoperation experts and conducting an elicitation study with 17 experienced teleoperators, we identify road scenarios requiring remote human assistance. We then devise a set of discrete high-level commands that enable the resolution of these scenarios without manually controlling AVs. Finally, we integrate these findings into the design of a novel user interface for teleoperating autonomous vehicles.

KW - Automobile

KW - Qualitative Methods

KW - Teleoperation

KW - User interface design

UR - http://www.scopus.com/inward/record.url?scp=85173671558&partnerID=8YFLogxK

U2 - 10.1145/3581961.3609845

DO - 10.1145/3581961.3609845

M3 - Conference contribution

AN - SCOPUS:85173671558

T3 - ACM International Conference Proceeding Series

SP - 287

EP - 290

BT - 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings

PB - Association for Computing Machinery

T2 - 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023

Y2 - 18 September 2023 through 21 September 2023

ER -

Tener F , Lanir J. Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles. In 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Adjunct Conference Proceedings. Association for Computing Machinery. 2023. p. 287-290. (ACM International Conference Proceeding Series). doi: 10.1145/3581961.3609845

Design of a High-Level Guidance User Interface for Teleoperation of Autonomous Vehicles

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this