One-handed Filipino sign language recognition glove prototype using image acquisition and neural networks
Date of Publication
2008
Document Type
Bachelor's Thesis
Degree Name
Bachelor of Science in Manufacturing Engineering and Management
College
Gokongwei College of Engineering
Department/Unit
Manufacturing Engineering and Management
Thesis Adviser
Nilo T. Bugtai
Defense Panel Chair
Julius Maridable
Defense Panel Member
Homer S. Co
Arthur Pius P. Santiago
Abstract/Summary
The Filipino sign language (FSL) is the primary form of communication between members in the local deaf community. Although FSL is already a growing communication tool used also by hearing individuals, there is still a large number who are unfamiliar with such form of communication. Therefore communication barriers still exist between deaf and hearing community. The technique for recognizing signs developed in this research allow the creation of a system to serve as a tutorial in learning Filipino sign language.
This thesis details the development of a computer system (labeled the Helping Hand system) capable of recognizing a set of signs from FSL, based on the classification using feed-forward backpropagation neural networks.
The key element in this research is a prototype glove embedded with Flexpoint bend sensors for finger flexion and improvised touch sensors to measure finger contact. By means of image processing through vision system, words are easily recognized with the help of the color coded FSL glove. There are 20 basic FSL words which are present in the Helping Hand Library.
Experiments were conducted to test the accuracy, consistency and performance of the words. Increasing the number of training data for the network used in the recognition process gives better results. With 5 different users, sufficient varying data were obtained. The glove is giving out at least 95.2% accuracy per word with 40 training samples as compare to 84.66% with only 25 samples from all 5 users. All users were able to reach and surpass the 20 word limit for the study.
Keywords: FSL glove, feedforward backpropagation, flexpoint bendsensor, touch sensor, vision system, Helping Hand, sign recognition.
Abstract Format
html
Language
English
Format
Accession Number
TU15167
Shelf Location
Archives, The Learning Commons, 12F, Henry Sy Sr. Hall
Physical Description
1 v. (various foliations) : ill. (some col.) ; 28 cm.
Keywords
Sign language; Sign language--Study and teaching--Philippines; Sign language--Philippines; Philippine Sign Language; Computer vision; Optical pattern recognition; Neural networks (Computer science)
Recommended Citation
Calolot, C., Hong, P., Gonzales, K., Sia, A., & Villamidez, B. (2008). One-handed Filipino sign language recognition glove prototype using image acquisition and neural networks. Retrieved from https://animorepository.dlsu.edu.ph/etd_bachelors/14495