Predicting levels of rapport in dyadic interactions through automatic detection of posture and posture congruence

College

College of Computer Studies

Department/Unit

Software Technology

Document Type

Conference Proceeding

Source Title

Proceedings - 2011 IEEE International Conference on Privacy, Security, Risk and Trust and IEEE International Conference on Social Computing, PASSAT/SocialCom 2011

First Page

613

Last Page

616

Publication Date

12-1-2011

Abstract

Research in psychology and SSP often describe posture as one of the most expressive nonverbal cues. Various studies in psychology particularly link posture mirroring behaviour to rapport. Currently, however, there are few studies which deal with the automatic analysis of postures and none at all particularly focus on its connection with rapport. This study presents a method for automatically predicting rapport in dyadic interactions based on posture and congruence. We begin by constructing a dataset of dyadic interactions and selfreported rapport annotations. Then, we present a simple system for posture classification and use it to detect posture congruence in dyads. Sliding time windows are used to collect posture congruence statistics across video segments. And lastly, various machine learning techniques are tested and used to create rapport models. Among the machine learners tested, Support Vector Machines and Multilayer Perceptrons performed best, at around 71% average accuracy. © 2011 IEEE.

html

Digitial Object Identifier (DOI)

10.1109/PASSAT/SocialCom.2011.143

Disciplines

Computer Sciences

Keywords

Image processing; Pattern recognition systems; Posture; Machine learning

Upload File

wf_no

This document is currently not available here.

Share

COinS