Publications


WARNING: All material on this website, including papers, text, figures, and graphics is covered by Copyright© unless otherwise stated. You may browse them at your convenience (in the same spirit as you may read a journal or a proceeding article in a public library). Retrieving, copying, or distributing these files, however, may violate the copyright protection law. We recommend that the user abides international law in accessing this directory.


PhD Thesis


  • H. Gunes, "Vision-based Multimodal Analysis of Affective Face and Upper-body Behaviour", University of Technology Sydney (UTS), Computer Systems Department, Sydney, Australia, September 2007.



    • Book Chapters


  • H. Gunes, C. Shan, S. Chen, and YingLi Tian, "Bodily Expression for Automatic Affect Recognition", In Advances in Emotion Recognition, A. Konar, A. Chakraborty (Eds.), Wiley-Blackwell, 2011 (to appear).


  • H. Gunes, M.A. Nicolaou and M. Pantic, "Continuous Analysis of Affect from Voice and Face", In Computer Analysis of Human Behavior, A. Salah and T. Gevers (Eds.), Springer-Verlag, 2011 (to appear).


  • H. Gunes, Foreword, In Affective Computing and Interaction: Psychological, Cognitive and Neuroscientific Perspectives, Didem Gokcay & Gulsen Yildirim (Eds.), IGI Global, 2011, 2 pages.


  • H. Gunes, M. Piccardi and M. Pantic, From the Lab to the Real World: Affect Recognition Using Multiple Cues and Modalities (PDF), In Affective Computing, Focus on Emotion Expression, Synthesis and Recognition, Jimmy Or (Ed.), I-Tech Education and Publishing, Vienna, Austria, ISBN 978-3-902613-23-3, May 2008, pp. 185-218.


  • H. Gunes and M. Piccardi, From Mono-modal to Multi-modal: Affect Recognition Using Visual Modalities, Chapter in Intelligent Environments: Methods, Algorithms and Applications, D. Monekosso, P. Remagnino, and Y. Kuno (Eds.), Springer-Verlag, ISBN: 978-1-84800-345-3, Sep. 2008, pp. 154-182.



    • International Journals


  • M. A. Nicolaou, H. Gunes and M. Pantic, "Output-Associative RVM Regression for Dimensional and Continuous Emotion Prediction", Image and Vision Computing Journal, Special Issue on Best of Automatic Face and Gesture Recognition 2011 (invited paper).



  • M. A. Nicolaou, H. Gunes and M. Pantic, Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence–Arousal Space , IEEE Transactions on Affective Computing, Special Issue on Affect Based Human Behavior Understanding , 2011 (in press).


  • A. F. Otoom, H. Gunes O. P. Concha, and M. Piccardi, MLiT: Mixtures of Gaussians under Linear Transformations , Pattern Analysis and Applications Journal, Volume 14, Number 2, pp. 193-205, 2011.


  • H. Gunes and M. Pantic, Automatic, Dimensional and Continuous Emotion Recognition (PDF), International Journal of Synthetic Emotions, Vol. 1, No. 1, pp. 68-99, 2010 (Copyright© 2010 IGI Global).


  • H. Gunes and M. Piccardi, "Automatic Temporal Segment Detection and Affect Recognition from Face and Body Display", IEEE Transactions on Systems, Man, and Cybernetics - Part B, Special Issue on Human Computing, Vol. 39, No. 1, pp. 64-84, Feb. 2009.


  • H. Gunes and M. Piccardi, "Bi-Modal Emotion Recognition from Expressive Face and Body Gestures", Journal of Network and Computer Applications, Vol. 30, No. 4, pp. 1334-1345, Nov. 2007, Elsevier, ISSN: 1084-8045.


  • H. Gunes and M. Piccardi, "Assessing Facial Beauty Through Proportion Analysis by Image Processing and Supervised Learning", International Journal of Human-Computer Studies, Vol. 64, No. 12, pp. 1184-1199, Dec. 2006, Elsevier, ISSN: 1071-5819.



    • Conference Proceedings


    2011

  • M. A. Nicolaou, H. Gunes and M. Pantic, "A Multi-layer Hybrid Framework for Dimensional Emotion Classification", Proc. of ACM Multimedia Conference (ACM MM’11), 28 Nov. - 1 Dec. 2011, Arizona, USA (accepted for publication).


  • M. A. Nicolaou, H. Gunes and M. Pantic, "Designing Frameworks for Automatic Affect Prediction and Classification in Dimensional Space", Proc. of IEEE Int’l Conf. Computer Vision and Pattern Recognition (CVPR-W’11), Workshop on Gesture Recognition, June 2011, Colorado Springs, USA, pp. 20-26.


  • M. A. Nicolaou, H. Gunes and M. Pantic, "Output-Associative RVM Regression for Dimensional and Continuous Emotion Prediction", Proc. of IEEE FG 2011, the IEEE International Conference on Automatic Face and Gesture Recognition, 21-25 Mar. 2011, Santa Barbara, California, USA, IEEE Press, pp. 16-23. Best Paper Award


  • F. Eyben, M. Woellmer, M. F. Valstar, H. Gunes, B. Schuller and M. Pantic, "String-based Audiovisual Fusion of Behavioural Events for the Assessment of Dimensional Affect", Proc. of IEEE FG 2011, the IEEE International Conference on Automatic Face and Gesture Recognition, 21-25 Mar. 2011, Santa Barbara, California, USA, IEEE Press, pp. 322-329.


  • H. Gunes, B. Schuller, M. Pantic, and R. Cowie, "Emotion Representation, Analysis and Synthesis in Continuous Space: A Survey", Proc. of the 1st International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE, IEEE FG 2011, 21 March 2011, Santa Barbara, California, USA, IEEE Press, pp. 827-834.


  • M. Schroder, S. Pammi, H. Gunes, M. Pantic, M. Valstar, R. Cowie, G. McKeown, D. Heylen, M. ter Maat, F. Eyben, B. Schuller, M. Wollmer, E. Bevacqua, C. Pelachaud, and E. de Sevin, "Come and Have an Emotional Workout with Sensitive Artificial Listeners!", Proc. of IEEE FG 2011, the IEEE International Conference on Automatic Face and Gesture Recognition, 21-25 Mar. 2011, Santa Barbara, California, USA, pp. 646 (demo).



    • 2010

  • M. A. Nicolaou, H. Gunes and M. Pantic, Audio-visual Classification and Fusion of Spontaneous Affective Data in Likelihood Space (PDF), Proc. of ICPR 2010, the 20th IAPR Int. Conf. on Pattern Recognition, 23-26 Aug. 2010, Istanbul, Turkey, pp. 3695-3699 (Copyright© 2010 IEEE Press).


  • H. Gunes and M. Pantic, Automatic Measurement of Affect in Dimensional and Continuous Spaces: Why, What, and How? (PDF), Proc. of Measuring Behavior 2010, Symposium on Unveiling Affective Signals, 24-27 August 2010, Eindhoven, The Netherlands, pp. 122-126 (Copyright© 2010 Noldus Information Technology).


  • H. Gunes and M. Pantic, “Dimensional Emotion Prediction from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners”, Proc. of IVA 2010, the International Conference on Intelligent Virtual Agents, 20-22 Sept. 2010, Philadelphia, Pennsylvania, USA, Springer-Verlag, pp. 371-377.


  • M. A. Nicolaou, H. Gunes and M. Pantic, Automatic Segmentation of Spontaneous Data using Dimensional Labels from Multiple Coders (PDF), Proc. of Int. Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, in association with 7th Int. Conf. on Language Resources and Evaluation (LREC 2010), 17-23 May 2010, Valletta, Malta, pp. 43-48.


  • R. Cowie, H. Gunes, G. McKeown, L. Vaclau-Schneider, J. Armstrong, and E. Douglas-Cowie, The emotional and communicative significance of head nods and shakes in a naturalistic database (PDF), Proc. of Int. Workshop on Emotion: Corpora for Research on Emotion and Affect, in association with 7th Int. Conf. on Language Resources and Evaluation (LREC 2010), 17-23 May 2010, Valletta, Malta, pp. 42-46.


  • M. Schroder, S. Pammi, R. Cowie, G. McKeown, H. Gunes, M. Pantic, M. Valstar, D. Heylen, M. ter Maat, F. Eyben, B. Schuller, M. Wollmer, E. Bevacqua, C. Pelachaud, E. de Sevin, Demo: Have a Chat with Sensitive Artificial Listeners (PDF), Proc. of AISB'10 the Annual Convention of the Society for the Study of Artificial Intelligence and Simulation of Behaviour, Symposium on Comprehensive Test of Intelligence, 29 Mar. " 1 Apr. 2010, Leicester, UK.



    • 2009

  • M. Schroder, E. Bevacqua, F. Eyben, H. Gunes, D. Heylen, M. Maat, S. Pammi, M. Pantic, C. Pelachaud, B. Schuller, E. Sevin, M. Valstar, and M. W"llmer, "A Demonstration of Audiovisual Sensitive Artificial Listeners", Proc. of ACII 2009, Int. Conf. on Affective Computing and Intelligent Interaction, Amsterdam, the Netherlands, 10-12 Sep. 2009, IEEE Press, Vol. 1, pp. 263-264. Best Demo Award


  • A. F. Otoom, ". P. Concha, H. Gunes, and M. Piccardi, "Mixtures of Normalized Linear Projections", Proc. ACIVS 2009, 11th Int. Conf. on Advanced Concepts for Intelligent Vision Systems, Bordeaux, France, 28 Sep. - 2 Oct. 2009, Springer, pp. 66-76.


  • S. Petridis, H. Gunes, S. Kaltwang, and M. Pantic, "Static vs. Dynamic Modeling of Human Nonverbal Behavior from Multiple Cues and Modalities", Proc. ICMI 2009 the 11th ACM Int. Conf. on Multimodal Interfaces, Cambridge, MA, USA, 2-6 Nov. 2009, ACM Press, pp. 23-30.


  • Z. Zhang, H. Gunes, and M. Piccardi, "Head Detection for Video Surveillance Based on Categorical Hair and Skin Colour Models", Proc. of IEEE Int. Conf. on Image Processing, Cairo, Egypt, 7-11 Nov. 2009, IEEE Press, pp. 1137-1140.



    • 2008

  • M. Piccardi, H. Gunes and A. F. Otoom, "Maximum Likelihood Dimensionality Reduction in Gaussian Mixture Models with an Application to Object Classification", Proc. ICPR 2008 the 19th IAPR International Conference on Pattern Recognition, Dec. 2008, Tampa, Florida, U.S.A, IEEE Press, pp. 1-4.


  • A. F. Otoom, H. Gunes and M. Piccardi, "Comparative Performance Analysis of Feature Sets for Abandoned Object Classification", Proc. of IEEE SMC 2008 the International Conference on Systems, Man and Cybernetics, Oct. 12"15, 2008, Singapore, IEEE Press, pp. 1020 - 1025.


  • Z. Zhang, H. Gunes and M. Piccardi, "Tracking People in Crowds by a Part Matching Approach", Proc. of IEEE AVSS 2008, IEEE 5th International Conference on Advanced Video and Signal Based Surveillance, Santa Fe, New Mexico, USA, Sep. 1-3, 2008, IEEE Computer Society Press, pp.88-95.


  • Z. Zhang, H. Gunes and M. Piccardi, "An Accurate Algorithm for Head Detection Based on XYZ and HSV Hair and Skin Color Models", Proc. of IEEE ICIP 2008, the International Conference on Image Processing, Oct. 12"15, 2008, San Diego, California, U.S.A., IEEE Press, pp. 1644-1647.


  • A. F. Otoom, H. Gunes and M. Piccardi, "Feature Extraction Techniques for Abandoned Object Classification in Video Surveillance", Proc. of IEEE ICIP 2008, the International Conference on Image Processing, Oct. 12"15, 2008, San Diego, California, U.S.A., IEEE Press, pp. 1368-1371.



    • 2007

  • A. F. Otoom, H. Gunes and M. Piccardi, "Towards Automatic Abandoned Object Classification in Visual Surveillance Systems", Asia-Pacific Workshop on Visual Information Processing, Tainan, Taiwan, 15-17 Dec. 2007, Yueh-Min Huang and Tzone I. Wang (Eds.), pp. 143-149, ISBN: 978-986-01-0510-0.


  • M. F. Valstar, H. Gunes and M. Pantic, "How to Distinguish Posed from Spontaneous Smiles using Geometric Features", Proc. of ACM ICMI 2007 the Ninth International Conference on Multimodal Interfaces, Nagoya, Japan, 12-15 Nov. 2007, ACM Press, pp. 38-45.



    • 2006

  • H. Gunes and M. Piccardi, Observer Annotation of Affective Display and Evaluation of Expressivity: Face vs. Face-and-Body (PDF), Proc. HCSNet Workshop on the Use of Vision in Human-Computer Interaction (VisHCI 2006), Canberra, Australia, Australian Computer Society Press (Goecke, R., Robles-Kelly, A. and Caelli, T., Eds.), Vol. 56, pp. 35-42 (Copyright© 2006 ACS Press) Best Student Paper Award


  • H. Gunes and M. Piccardi, Creating and Annotating Affect Databases from Face and Body Display: A Contemporary Survey (PDF), Proc. IEEE SMC 2006 the International Conference on Systems, Man and Cybernetics, 8-11 Oct. 2006, Taipei, Taiwan, IEEE Press, pp. 2426-2433, ISBN: 1-4244-0100-3 (Copyright© 2006 IEEE Press).


  • H. Gunes and M. Piccardi, "A Bimodal Face and Body Gesture Database for Automatic Analysis of Human Nonverbal Affective Behavior", Proc. of ICPR 2006 the 18th IAPR International Conference on Pattern Recognition, 22-24 Aug. 2006, Hong Kong, IEEE Computer Society Press, Vol. 1, pp. 1148-1153, ISBN: 0-7695-2521-0.



    • 2005

  • H. Gunes and M. Piccardi, "Fusing Face and Body Display for Bi-Modal Emotion Recognition: Single Frame Analysis and Multi-Frame Post Integration", Proc. of the 1st International Conference on Affective Computing and Intelligent Interaction (ACII 2005), 22-24 Oct. 2005, Beijing, China, J. Tao, T. Tan, and R.W. Picard (Eds.), Springer-Verlag, LNCS 3784, pp. 102 " 111, ISBN: 3-540-29621-2.


  • H. Gunes and M. Piccardi, "Affect Recognition from Face and Body: Early Fusion vs. Late Fusion", Proc. of IEEE SMC 2005 the International Conference on Systems, Man and Cybernetics, Hawaii, USA, 10-12 Oct. 2005, IEEE Press, Vol. 4, pp. 3437 " 3443, ISBN:0-7803-9298-X.


  • H. Gunes and M. Piccardi, "Fusing Face and Body Gesture for Machine Recognition of Emotions", Proc. of IEEE RO-MAN 2005 14th IEEE International Workshop on Robot and Human Interactive Communication, Nashville - TN, USA, 13-15 Aug. 2005, IEEE Press, pp. 306-311, ISBN: 0-7803-9275-2.


  • H. Gunes and M. Piccardi, "Automatic Visual Recognition of Face and Body Action Units", Proc. of ICITA 2005 the 3rd International Conference on Information Technology and Applications, 4-7 July 2005, Sydney, Australia, IEEE Computer Society Press, Vol. 1, pp. 668-673, ISBN: 0-7695-2316-1.



    • 2004

  • H. Gunes, M. Piccardi, T. Jan, "Bimodal Modelling of Facial and Upper-Body Gesture for Affective HCI", Proc. of OZCHI 2004, The annual conference of the Computer-Human Interaction Special Interest Group (CHISIG) of Australia, 22-24 November, 2004, Wollongong, Australia, CD-ROM, 10 pages, ISBN: 1 74128 079.


  • H. Gunes, M. Piccardi, T. Jan, "Comparative Beauty Classification for Pre-Surgery Planning", Proc. of IEEE SMC 2004 the International Conference on Systems, Man and Cybernetics, 10-13 October 2004, The Hague, The Netherlands, IEEE Press, Vol. 3, pp.2168 - 2174.


  • P. Tsai, T. Jan, H. Gunes, "Video object encoder using selective local-space support vector machines", Proc. of IEEE 6th Int'l Workshop on Multimedia Signal Processing, Sept. 29 - Oct. 1 2004, Siena, Italy, IEEE Press, pp.427 - 429.


  • H. Gunes, M. Piccardi, T. Jan, "Face and Body Gesture Analysis for Multimodal HCI", Proc. of APCHI 2004 the 6th Asia-Pacific Conference on Computer - Human Interaction incorporating the 5th ACM SIGCHI-NZ Symposium, June-July, 2004, Rotorua, New Zealand. M. Masoodian et al. (Eds.), LNCS 3101, Springer-Verlag, pp. 585-588.


  • H. Gunes, M. Piccardi, T. Jan, "Automated Classification of Female Facial Beauty by Image Analysis and Supervised Learning", Proc. of SPIE Symposium on Electronic Imaging 2004, Conference on Visual Communications and Image Processing,18-22 January 2004, San Jose, California, USA, Vol. 5308, Part 2, pp.968-978.



    • 2003

  • H. Gunes, M. Piccardi, T.Jan, "Face and Body Gesture Recognition for a Vision-Based Multimodal Analyzer" (A Review). Proc. Pan-Sydney Area Workshop on Visual Information Processing (VIP2003), December, 2003, Sydney, Australia. Australian Computer Society, Conferences in Research and Practice in Information Technology, Vol. 36, Piccardi, M., Hintz, T., He, S., Huang, M. L. and Feng, D. D. (Eds.), pp. 19-28.


  • H. Gunes, M. Piccardi, T.Jan, "Performance Evaluation of an Automated Classifier of Female Facial Beauty", Proc. of CISST'03 the 2003 International Conference on Imaging Science, Systems, and Technology, June 23-26, 2003,Las Vegas, Nevada, USA, Vol 2, pp.652-656.


  • T.Jan, M. Piccardi,H. Gunes, "Suspicious Behavior Assessment for Visual Surveillance Using Neural Network Classifiers", Proc. of CISST'03 the 2003 International Conference on Imaging Science, Systems, and Technology,June 23-26, 2003,Las Vegas, Nevada, USA, Vol 2, pp.657-661.



    • 2002

  • H. Gunes, M. Piccardi, T.Jan, "Automatic Classification of Female Facial Beauty using Learning Algorithms", Proc. of IVCNZ 2002 the International Conference on Image and Vision Computing, 23-26 November, 2002, Auckland, New Zealand, pp. 169-173.


  • H. Gunes, M.Y. Karsligil,"Measuring Female Facial Beauty by Calculating the Proportions of the Face", Proc. of ISCIS XVII the Seventeenth International Symposium on Computer and Information Sciences, October 28-30, 2002, Orlando, Florida, USA, pp. 71-75.



    • Other


  • H. Gunes, Multimodal Affective Computing, Feature article for the Encyclopedia of Interaction Design , Feb. 2008.

  • H. Gunes, Affective Computing, Feature article for HCSNet, the ARC Network in Human Communication Science, Sub-discipline summaries, 2006.



    • Media/Press


    • 'How are you feeling today, user?', Future Living Magazine, Edition 5, Spring Issue 2009, pp. 23, 2009 (interview with David Kidd).

      Invited Talks/Other Presentations


    • Automatic Measurement of Affect in Dimensional and Continuous Spaces, CCNY Media Laboratory , Department of Electrical Engineering, The City College and Graduate School, City University of New York, NY, USA, 24 Sep. 2010.


    • Automatic recognition of affect in dimensional and continuous spaces: Why, what and how?, Summer School on Affective Computing and Social Signal Processing (ACSSP 2010), Edinburgh, Scotland, UK, 30 Aug. 2010


    • Automatic Human Nonverbal Behaviour Analysis, Office of Learning Technologies , Universitat Oberta de Catalunya (UOC), Barcelona, Spain, 28 Sep. 2009.


    • Affective Computing, The Finance IT Network , London, U.K., 8 May 2009.


    • Automatic Assessment of Aesthetics by Using Image Processing and Supervised Learning Techniques, The e-Markets Research Group Seminar Series, Faculty of IT, UTS, Sydney, Australia, 14 Sep. 2007.


    • From Monomodal to Multimodal: Affect Recognition Using Visual Modalities, Australian Commonwealth Scientific and Industrial Research Organisation ( CSIRO ) ICT Centre HAIL Seminar Series, Sydney, Australia, 28 Aug. 2007.


    • Towards Automated Analysis of Bimodal Face and Body Expression Dynamics for Emotion Recognition, HCSNet SummerFest 2006, University of Sydney, Australia, 30 Nov. 2006.


    • Fusing Expressive Face and Body Display for Bi-modal Emotion Recognition, Man-Machine Interaction Research Group"s Seminar Series (MMI colloquium), Delft University of Technology, Delft, the Netherlands, 7 Dec. 2005.


    • Bi-modal affect recognition from expressive face and upper-body gesture by single frame analysis and multi-frame post integration (poster presentation), National ICT Australia (NICTA) - HCSNet Multimodal User Interaction Workshop,Sydney, Australia, 13-14 Sep. 2005.


    • Combining expressive face and upper-body gesture for affect recognition, National ICT Australia (NICTA) Gestural Interaction Workshop 2005, Sydney, Australia, 27-28 Apr. 2005.


    • Eigenvalues, Eigenvectors and Principle Component Analysis, CVRG Group Seminars, UTS, Sydney, Australia, 1 Sep. 2003.


    • Computer Vision-Based Analysis of Facial Expressions (A Review),5th Annual Research Student Conference, UTS, Sydney, Australia, Aug. 2003.


    • Automatic Classification of Female Facial Beauty, Computer Vision and Image Processing Workshop, UTS, Sydney, Australia, Feb.2003.


    • Measuring Female Facial Beauty, poster presentation and demo representing Yildiz Technical Univ. at the 13th Symposium of Head of the Computer Engineering Departments in Turkey,Yeditepe University, Istanbul, Turkey, 26 Oct. 2001.