Gesture recognition for fingerspelling applications: an approach based on sign language cheremes

Published in Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, 2010

Recommended citation: Madeo, R.C.B., Peres, S. M., Dias, D.B., Boscarioli, C. (2010). "Gesture recognition for fingerspelling applications: an approach based on sign language cheremes." Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility. https://dl.acm.org/doi/abs/10.1145/1878803.1878861

This paper presents an approach for carrying out gesture recognition for the Brazilian Sign Language Manual Alphabet. The gestural patterns are treated as a combination of three primitives, or cheremes-hand configuration, hand orientation and hand movement. The recognizer is built in a modular architecture composed by inductive reasoning modules, which use the artificial neural network Fuzzy Learning Vector Quantization; and rule-based modules. This architecture has been tested and results are presented here. Some strengths of such approach are: robustness of recognition, portability to similar contexts, extensibility of the dataset to be recognize and reduction of the vocabulary recognition problem to the recognition of its primitives.