Write-it-yourself with the aid of smartwatches: A Wizard-of-Oz experiment with blind people

Syed Masum Billah, Vikas Ashok, I. V. Ramakrishnan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Working with non-digital, standard printed materials has always been a challenge for blind people, especially writing. Blind people very often depend on others to fill out printed forms, write checks, sign receipts and documents. Extant assistive technologies for working with printed material have exclusively focused on reading, with little to no support for writing. Also, these technologies employ special-purpose hardware that are usually worn on fingers, making them unsuitable for writing. In this paper, we explore the idea of using off-the-shelf smartwatches (paired with smartphones) to assist blind people in both reading and writing paper forms including checks and receipts. Towards this, we performed a Wizard-of-Oz evaluation of different smartwatch-based interfaces that provide user-customized audio-haptic feedback in real-time, to guide blind users to different form fields, narrate the field labels, and help them write straight while filling out these fields. Finally, we report the findings of this study including the technical challenges and user expectations that can potentially inform the design of Writeit-Yourself AIDS based on smartwatches.

Original languageEnglish (US)
Title of host publicationIUI 2018 - Proceedings of the 23rd International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages427-431
Number of pages5
ISBN (Electronic)9781450349451
DOIs
StatePublished - Mar 5 2018
Event23rd ACM International Conference on Intelligent User Interfaces, IUI 2018 - Tokyo, Japan
Duration: Mar 7 2018Mar 11 2018

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference23rd ACM International Conference on Intelligent User Interfaces, IUI 2018
CountryJapan
CityTokyo
Period3/7/183/11/18

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Write-it-yourself with the aid of smartwatches: A Wizard-of-Oz experiment with blind people'. Together they form a unique fingerprint.

Cite this