TY - GEN
T1 - Helping Helpers
T2 - 2022 ACM Designing Interactive Systems Conference: Digital Wellbeing, DIS 2022
AU - Xie, Jingyi
AU - Yu, Rui
AU - Lee, Sooyeon
AU - Lyu, Yao
AU - Billah, Syed Masum
AU - Carroll, John M.
N1 - Funding Information:
We thank Dr. Zihan Zhou, Xinbing Zhang and Michelle McManus for their contribution to this work. We also thank the anonymous reviewers for their insightful comments. This research was supported by the US National Institutes of Health, National Library of Medicine (R01 LM013330).
Publisher Copyright:
© 2022 ACM.
PY - 2022/6/13
Y1 - 2022/6/13
N2 - Remote sighted assistance (RSA) has emerged as a conversational assistive service, where remote sighted workers, i.e., agents, provide real-time assistance to blind users via video-chat-like communication. Prior work identified several challenges for the agents to provide navigational assistance to users and proposed computer vision-mediated RSA service to address those challenges. We present an interactive system implementing a high-fidelity prototype of RSA service using augmented reality (AR) maps with localization and virtual elements placement capabilities. The paper also presents a confederate-based study design to evaluate the effects of AR maps with 13 untrained agents. The study revealed that, compared to baseline RSA, agents were significantly faster in providing indoor navigational assistance to a confederate playing the role of users, and agents' mental workload was significantly reduced - all indicate the feasibility and scalability of AR maps in RSA services.
AB - Remote sighted assistance (RSA) has emerged as a conversational assistive service, where remote sighted workers, i.e., agents, provide real-time assistance to blind users via video-chat-like communication. Prior work identified several challenges for the agents to provide navigational assistance to users and proposed computer vision-mediated RSA service to address those challenges. We present an interactive system implementing a high-fidelity prototype of RSA service using augmented reality (AR) maps with localization and virtual elements placement capabilities. The paper also presents a confederate-based study design to evaluate the effects of AR maps with 13 untrained agents. The study revealed that, compared to baseline RSA, agents were significantly faster in providing indoor navigational assistance to a confederate playing the role of users, and agents' mental workload was significantly reduced - all indicate the feasibility and scalability of AR maps in RSA services.
UR - http://www.scopus.com/inward/record.url?scp=85133611573&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133611573&partnerID=8YFLogxK
U2 - 10.1145/3532106.3533560
DO - 10.1145/3532106.3533560
M3 - Conference contribution
AN - SCOPUS:85133611573
T3 - DIS 2022 - Proceedings of the 2022 ACM Designing Interactive Systems Conference: Digital Wellbeing
SP - 881
EP - 897
BT - DIS 2022 - Proceedings of the 2022 ACM Designing Interactive Systems Conference
PB - Association for Computing Machinery, Inc
Y2 - 13 June 2022 through 17 June 2022
ER -