Online Feedback System for Public Speakers

Names: Anh-Tuan Nguyen, MSc
Advisors: Prof. Dr. Matthias Rauterberg, Dr. Wei Chen, Prof. Dr. Andrea Cavallaro1
Funding: Erasmus Mundus Joint Doctorate (EMJD) in Interactive and Cognitive Environments (ICE)), which is funded via the Education, Audiovisual and Culture Executive Agency (EACEA) of the European Commission under EMJD ICE FPA nº 2010-0012.

Duration: November 2011 – October 2014

Description

This project works towards a system that automatically evaluates performance of public speakers, based on emotional changes in bodily motion and speech. Our system can be used as an online feedback system for public speakers, as well as a tool for people who learn presentation skills.

Primary components:

  • A Microsoft Kinect for movement and speech capture.
  • Emotion Detection module: The most innovative part of the project. This module implements a framework for emotion detection from skeletal body motion and speech.
  • Presentation Assessment module: Evaluates quality of a presentation from emotional expression of the speaker. Give online feedbacks in textual, vocal and visual forms.

Collaboration

Erasmus Mundus Joint Doctorate (EMJD) in Interactive and Cognitive Environments (ICE)

1School of Electrical Engineering and Computer Science, Queen Mary University of London, United Kingdom