Latest...
The first demonstration of Semaine, titled 'A Demonstration of Audiovisual Sensitive Artificial Listeners', won Best Demo Award at ACII 2009, the International Conference on Affective Computing and Intelligent Interaction, Amsterdam, the Netherlands, in September 2009.
Here is a representative video of the interaction taking place between a human user and one of the virtual characters, recorded with the current system.
We have also demonstrated the Semaine system at IEEE International Conference on Automatic Face and Gesture Recognition in Santa Barbara, California in March 2011. The demo paper can be found here.
Short Bio
I received the Ph.D. degree in Computer Science from University of Technology Sydney (UTS) , Australia, in September 2007 for a multi-cue and multi-sensory approach to automatic recognition of emotions from face-and-body expressions, and their timing and synchronicity. I am currently a Postdoctoral Research Associate at Imperial College London, and an Honorary Associate of University of Technology, Sydney (UTS). At Imperial College, I have worked on the European Community award winning project SEMAINE that aimed to build a multimodal dialogue system which can interact with humans via a virtual character and react appropriately to the user's non-verbal behaviour, and MAHNOB that aims at multimodal analysis of human naturalistic nonverbal behaviour. I have authored over 45 technical papers in the areas of affective computing, visual information processing, machine learning and multimodal human-computer interaction in prestigious journals and conferences in these fields (e.g., IEEE T-SMC-B, IEEE T-TAC, IJHCS, IEEE FGR, IEEE ACII, IEEE ICPR, ACM ICMI, etc.). I have also served as a co-chair of the EmoSPACE Workshop at IEEE FGR 2011, as a member of the Editorial Advisory Board for the Affective Computing and Interaction Book (IGI Global, 2011) and Int’l Journal of Computer Vision & Signal Processing (IJCVSP), as a speaker at the First Summer School on Affective Computing and Social Signal Processing (ACSSP 2010), and as a reviewer for numerous journals and conferences in my areas of expertise. From 2004 to 2007, I was a recipient of the Australian Government International Postgraduate Research Scholarship (IPRS) awarded to top quality international postgraduate students, and the UTS Faculty of IT Research Training Stipend awarded to outstanding Ph.D. candidates at UTS. I have also received a number of other awards including the Outstanding Paper Award at IEEE FG 2011, the Best Demo Award at IEEE ACII 2009, and the Best Student Paper Award at VisHCI 2006.