Markerless gesture recognition in the context of affect modeling for intelligent tutoring systems

Date of Publication

2011

Document Type

Bachelor's Thesis

Degree Name

Bachelor of Science in Computer Science

Subject Categories

Computer Sciences

College

College of Computer Studies

Department/Unit

Computer Science

Thesis Adviser

Merlin Suarez

Defense Panel Member

Raymund Sison

Rhia Trogo

Abstract/Summary

Most gesture recognition systems of today use high-technology devices, and markers or wires to capture body movements of the user. These systems present high tracking accuracies. However, high-technology devices can be expensive, and difficult to deploy and duplicate. Markers can also be distracting and impractical. This research proposes on using only the computers web camera in tracking and recognizing gestures. A web camera is low-cost, simple, and unobtrusive. This research presents a novel framework that hopes to solve some of the identified problems of gesture recognition systems.

Three participants were video recorded while studying in front of a computer. Data collection yielded to raw data of approximately 7 hours long. A markerless gesture recognition system implemented in the context of affect modeling for intelligent tutoring system was built. Each of the systems modules namely, (1) hand on face detection module, (2) hand and arm detection module, and (3) posture detection module was tested and achieved an accuracy value of 75%, 70%, and 95%, respectively. The systems emotion recognition module was also tested based on the data of one participant. For three academic emotions namely, bored, flow, and confused, the emotion recognition module achieved an accuracy value of 67%.

Abstract Format

html

Language

English

Format

Print

Accession Number

TU18483

Shelf Location

Archives, The Learning Commons, 12F, Henry Sy Sr. Hall

Physical Description

1v. various foliations : illustrations (some colored) ; 28 cm.

Keywords

Information display systems; Optical pattern recognition; Face perception--Automation

This document is currently not available here.

Share

COinS