One-handed Filipino sign language recognition glove prototype using image acquisition and neural networks

Date of Publication

2008

Document Type

Bachelor's Thesis

Degree Name

Bachelor of Science in Manufacturing Engineering and Management

College

Gokongwei College of Engineering

Department/Unit

Manufacturing Engineering and Management

Thesis Adviser

Nilo T. Bugtai

Defense Panel Chair

Julius Maridable

Defense Panel Member

Homer S. Co
Arthur Pius P. Santiago

Abstract/Summary

The Filipino sign language (FSL) is the primary form of communication between members in the local deaf community. Although FSL is already a growing communication tool used also by hearing individuals, there is still a large number who are unfamiliar with such form of communication. Therefore communication barriers still exist between deaf and hearing community. The technique for recognizing signs developed in this research allow the creation of a system to serve as a tutorial in learning Filipino sign language.

This thesis details the development of a computer system (labeled the Helping Hand system) capable of recognizing a set of signs from FSL, based on the classification using feed-forward backpropagation neural networks.

The key element in this research is a prototype glove embedded with Flexpoint bend sensors for finger flexion and improvised touch sensors to measure finger contact. By means of image processing through vision system, words are easily recognized with the help of the color coded FSL glove. There are 20 basic FSL words which are present in the Helping Hand Library.

Experiments were conducted to test the accuracy, consistency and performance of the words. Increasing the number of training data for the network used in the recognition process gives better results. With 5 different users, sufficient varying data were obtained. The glove is giving out at least 95.2% accuracy per word with 40 training samples as compare to 84.66% with only 25 samples from all 5 users. All users were able to reach and surpass the 20 word limit for the study.

Keywords: FSL glove, feedforward backpropagation, flexpoint bendsensor, touch sensor, vision system, Helping Hand, sign recognition.

Abstract Format

html

Language

English

Format

Print

Accession Number

TU15167

Shelf Location

Archives, The Learning Commons, 12F, Henry Sy Sr. Hall

Physical Description

1 v. (various foliations) : ill. (some col.) ; 28 cm.

Keywords

Sign language; Sign language--Study and teaching--Philippines; Sign language--Philippines; Philippine Sign Language; Computer vision; Optical pattern recognition; Neural networks (Computer science)

This document is currently not available here.

Share

COinS