Algorithm for decoding visual gestures for an assistive virtual keyboard



Assistive technology, Augmentative and Alternative Communication


Text production is one of the most frequent activities on a computer, a trivial task that can be limiting for individuals affected by severe neuromotor disorders such as Amyotrophic Lateral Sclerosis (ALS) that can lead to Locked-in syndrome (LIS). These individuals need augmentative and alternative communication tools, since they may have only the eye movements as a form of communication and interaction with the outside world. This work investigates methods of interaction based on eye movement tracking and presents a virtual keyboard that utilizes gaze detection as a text input. It describes the development of the shape detection algorithm for the assistive keyboard, typed word voting from a Brazilian Portuguese lexicon and preliminary results on the decoding algorithm.


Download data is not yet available.

Author Biographies

Rafael Augusto da Silva, +55 34 9991760912

Rafael Augusto da Silva is a PhD student in Electrical Engineering (emphasis in Digital Signal Processing) at the Federal University of Uberlândia (UFU). He holds master's and bachelor's degrees in Electrical Engineering by the same institution. He participated in a joint program at the Université Lille 1 (France), with research in ‘Micro et Nanotechnologies: Systèmes de Communication Radio-fréquence’ with CAPES funding.

Antônio Cláudio Paschoarelli Veiga

Antônio Cláudio Paschoarelli Veiga holds a PhD in Electrical Engineering from the State University of Campinas (2002). He is currently a professor at the Federal University of Uberlândia. He has experience in the area of Electrical Engineering, with emphasis on Image Processing and digital communications. He has received several Masters and PhD students in the postgraduate program of the Faculty of Electrical Engineering of UFU. He is currently the coordinator of the Electronic Engineering and Telecommunications course at the Federal University of Uberlândia.



How to Cite

da Silva, R. A., & Paschoarelli Veiga, A. C. (2021). Algorithm for decoding visual gestures for an assistive virtual keyboard. IEEE Latin America Transactions, 18(11), 1909–1916. Retrieved from