Jeffrey F. Cohn, PhD

University of Pittsburgh
4327 Sennott Square
Pittsburgh, PA 15260

jeffcohn @ pitt.edu

412.624.8825 office
412.624.2023 fax
412.624.8826 lab
412.624.6682 lab

cohn_jeffrey3

Jeffrey Cohn is Professor of Psychology and Psychiatry at the University of Pittsburgh and Adjunct Professor at the Robotics Institute at Carnegie Mellon University.   He has led interdisciplinary and inter-institutional efforts to develop advanced methods of automatic analysis of facial expression and prosody; and applied those tools to research in human emotion, social development, non-verbal communication, psychopathology, and biomedicine. He co-chaired the 2008 IEEE International Conference on Automatic Face and Gesture Recognition (FG2008) and the2009 International Conference on Affective Computing and Intelligent Interaction (ACII2009).  He has co-edited two recent special issues of the Journal of Image and Vision Computing. His research has been supported by grants from the National Institutes of Health, National Science Foundation, Autism Foundation, Office of Naval Research, Defense Advanced Research Projects Agency, and the Technical Support Working Group.


News

IEEE International Conference on Automatic Face and Geture Recognition, Changhai, China. (FG2013) April, 22-26, 2013.

International Society for Research in Emotion, Berkeley, CA. (ISRE) August 3-5, 2013.

Affective Computing and Intelligent Interaction, Geneva, Switzerland. ACII 2013September 2-5, 2013.

Second International Workshop on Context Based Affect Recognition CBAR. September 2-5, 2013.

3rd International Audio/Visual Emotion Challenge: Depression and Continuous Emotion, Barcelona, Spain. (AVEC 2013) October 21-25, 2013.

Publications

Selected publications

Curriculum Vitae PDF DOC

Demos

Active appearance model (AAM) with action unit detection Demo 1 Demo 2

Mother-infant synchrony using AAM (Messinger et al., 2009) Demo7 (130 MB)

Head Tracking Demo 3

Expression cloning using AAM Demo 4 Demo 5

Constrained local model (CLM). Demo (in group formation task)

Constrained local model (CLM). Demo8 (in mother-infant)

Body tracking (Y. Sheikh) Demo 6 Demo 7

Databases

High-resolution 3D, AU-Coded Spontaneous Facial Expressions of Emotion. TBA at FG 2013.

Denver Intensity of Spontaneous Facial Action Database. DISFA

Cohn-Kanade AU-Coded Facial Expression Database. CK

Cohn-Kanade Expanded. CK+ Download

CMU MultiPie

UNBC-McMaster Pain Archive

Projects

“Automated Facial Expression Analysis for Research and Clinical Use.” National Institute of Mental Health, 2012 to 2017.

“Collaborative Research: CI-ADDO-EN: Multidimensional and Multimodal Dynamic Spontaneous Emotion Corpus for Automated Facial Behavior and Emotion Analysis.” National Science Foundation, 9/1/2012 to 8/31/2015.

Collaborative Research: Communication, Perturbation, and Early Development.” National Science Foundation, 6/15/2011 to 5/31/2014.

“EAGER: Spontaneous 4D-Facial Expression Corpus for Automated Facial Image Analysis.” National Science Foundation, 9/1/2010 to 8/31/2012.final report

"Robotics Collaborative Technology Alliance (RCTA)." Army Research Laboratory, 7/1/2010 to 6/30/2019. 

"Skyping Alan Turing: 'A Grand-Challenge' for ICT Science." Commonswealth Scientific and Industrial Research Organization, 12/1/2010 to 11/30/2011.

"Computational Behavioral Science: Modelling, Analysis, and Visualization of Social and Communicative Behavior." National Science Foundation, 8/1/2010 to 7/31/2015.

Teaching

Undergraduate Courses

Graduate Courses

  • Psychological Assessment
  • Seminar in Infant Social and Emotional Development
  • Seminar in Emotion
Recent Collaborators

Nick Allen, University of Melbourne
Zara Ambadar, University of Pittsburgh
Anne Burrows, Duquesne University
Fernando De la Torre, Carnegie Mellon University
Paul Ekman, University of California, San Francisco
Nathan Fox, University of Maryland
Ralph Gross, Carnegie Mellon University
Takeo Kanade, Carnegie Mellon University
Patrick Lucey, Disney Research Pittsuburgh
Simon Lucey, CSIRO, Australia and Carnegie Mellon University
Mohammad Mahoor, University of Denver
Iain Matthews, Disney Research and Carnegie Mellon University
Ginger Moore, Pennsylvania State University
Maja Pantic, Imperial College, UK
Daniel Messinger, University of Miami
Ken Prkachin, University of Northern British Columbia
Jason Saragih, CSIRO, Australia
Michael Sayette, University of Pittsburgh
Barry John Theobald, University of East Anglia
Lijun Yin, University of Binghamton