Jeffrey F. Cohn, PhD

University of Pittsburgh
4327 Sennott Square
Pittsburgh, PA 15260

jeffcohn @ pitt.edu

412.624.8825 office
412.624.2023 fax
412.624.8826 lab
412.624.6682 lab

cohn_jeffrey

Jeffrey Cohn is Professor of Psychology at the University of Pittsburgh and Adjunct Faculty at the Robotics Institute at Carnegie Mellon University.   He has led interdisciplinary and inter-institutional efforts to develop advanced methods of automatic analysis of facial expression and prosody; and applied those tools to research in human emotion, social development, non-verbal communication, psychopathology, and biomedicine. He co-chaired the 2008 IEEE International Conference on Automatic Face and Gesture Recognition (FG2008) and the2009 International Conference on Affective Computing and Intelligent Interaction (ACII2009).  He has co-edited two recent special issues of the Journal of Image and Vision Computing. His research has been supported by grants from the National Institutes of Health, National Science Foundation, Autism Foundation, Office of Naval Research, Defense Advanced Research Projects Agency, and the Technical Support Working Group.


News

ASE/IEEE International Conference on Social Computing (SocialCom 2012).

International Conference on Multimodal Interfaces (ICMI 2012).

IEEE CVPR Workshop on Gesture Recognition (ChaLearn Gesture Challenge).

IEEE CVPR Tutorial on Looking at People

IEEE International Conference on Automatic Face and Geture Recognition (FG) (FG2013).

International Conference on Infomatics, Electronics, Vision (ICIEV12).

Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis. IEEE Signal Processing Magazine (Nov. 2010).

IEEE Transactions on Affective Computing. Call for papers!

International Journal of Computer Vision and Signal Processing. Call for papers!

Publications

Selected publications

Curriculum Vitae PDF DOC

Demos

Active appearance model (AAM) with action unit detection Demo 1 Demo 2

Mother-infant synchrony using AAM (Messinger et al., 2009) Demo7 (130 MB)

Head Tracking Demo 3

Expression cloning using AAM Demo 4 Demo 5

Constrained local model (CLM). Demo (in group formation task)

Constrained local model (CLM). Demo8 (in mother-infant)

Body tracking (Y. Sheikh) Demo 6 Demo 7

Databases

Cohn-Kanade AU-Coded Facial Expression Database. CK

Cohn-Kanade Expanded. CK+ Download

CMU MultiPie

UNBC-McMaster Pain Archive NEW!

Projects

“Automated Facial Expression Analysis for Research and Clinical Use.” National Institute of Mental Health, 2012 to 2017.

Facial Expression Analysis by Computer Processing.” National Institute of Mental Health: 8/1/95 to 4/30/12.

“EAGER: Spontaneous 4D-Facial Expression Corpus for Automated Facial Image Analysis.” National Science Foundation, 9/1/2010 to 8/31/2012.

Collaborative Research: Communication, Perturbation, and Early Development.” National Science Foundation, 6/15/2011 to 5/31/2014.

"Robotics Collaborative Technology Alliance (RCTA)." Army Research Laboratory, 7/1/2010 to 6/30/2019. 

"Skyping Alan Turing: 'A Grand-Challenge' for ICT Science." Commonswealth Scientific and Industrial Research Organization, 12/1/2010 to 11/30/2011.

"Computational Behavioral Science: Modelling, Analysis, and Visualization of Social and Communicative Behavior." National Science Foundation, 8/1/2010 to 7/31/2011.

“Automated Measurement of Facial Expression in Autism: Deficits in Facial Nerve Function,” Autism Speaks, 10/1/07 to 6/31/2011.

“Reinforcing Effects of Alcohol during Group Formation.” National Institute of Alcohol Abuse and Alcoholism, 9/30/2005 to 8/31/2011.

Teaching

Undergraduate Courses

Graduate Courses

  • Psychological Assessment
  • Seminar in Infant Social and Emotional Development
  • Seminar in Emotion
Recent Collaborators

Nick Allen, University of Melbourne
Zara Ambadar, University of Pittsburgh
Anne Burrows, Duquesne University
Fernando De la Torre, Carnegie Mellon University
Paul Ekman, University of California, San Francisco
Nathan Fox, University of Maryland
Ralph Gross, Carnegie Mellon University
Takeo Kanade, Carnegie Mellon University
Patrick Lucey, Disney Research Pittsuburgh
Simon Lucey, CSIRO, Australia and Carnegie Mellon University
Mohammad Mahoor, University of Denver
Iain Matthews, Disney Research and Carnegie Mellon University
Ginger Moore, Pennsylvania State University
Maja Pantic, Imperial College, UK
Daniel Messinger, University of Miami
Ken Prkachin, University of Northern British Columbia
Jason Saragih, CSIRO, Australia
Michael Sayette, University of Pittsburgh
Barry John Theobald, University of East Anglia
Lijun Yin, University of Binghamton