Jeffrey F. Cohn, PhD

University of Pittsburgh
4327 Sennott Square
Pittsburgh, PA 15260

jeffcohn @

412.624.8825 office
412.624.2023 fax
412.624.8826 lab
412.624.6682 lab

Jeffrey Cohn is Professor of Psychology and Psychiatry at the University of Pittsburgh and Adjunct Professor of Computer Science at the Robotics Institute at Carnegie Mellon University.   He leads interdisciplinary and inter-institutional efforts to develop advanced methods of automatic analysis and synthesis of facial expression and prosody; and applies those tools to research in human emotion, social development, non-verbal communication, psychopathology, and biomedicine. He has served as Co-Chair of the 2008 and 2015 IEEE International Conference on Automatic Face and Gesture Recognition (FG2008) (FG2015), the 2009 International Conference on Affective Computing and Intelligent Interaction (ACII2009), the Steering Committee for IEEE International Conference on Automatic Face and Gesture Recognition, and the 2014 International Conference on Multimodal Interaces (ACM 2014).  He has co-edited special issues of the Journal of Image and Vision Computing and is a Co-Editor of IEEE Transactions in Affective Computing (TAC). His research has been supported by grants from the National Institutes of Health, National Science Foundation, Autism Foundation, Office of Naval Research, Defense Advanced Research Projects Agency, and other sponsors.



Jeni, L. A., Cohn, J. F., & Kanade, T. (2015). Dense 3D face alignment from 2d videos in real-time. Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Ljubljana, Slovenia. Best Paper Award. PDF ... ZFace distribution.

De la Torre, F., Girard, J.M., & Cohn, J.F. (September 2015). Facial expression analysis. IEEE International Conference on Biometrics Theory and Applications, Washington, DC. BTAS2015 Tutorial

Affective Computing and Intelligent Interaction (September 2015), Xi'an, China. ACII2015.

Cohn, J.F. (September 2015). Sentiment and other affects: What are measuring? How well are we doing? 1st International Workshop on Automatic Sentiment Analysis in the Wild, Xi’an, China. WASA15

Hammal, Z., Cohn, J.F., Heike, C. & Speltz, M.L. (2015). What can head and facial movements convey about positive and negative affect? Proceedings of the International Conference on Affective Computing. Xian, China, 2015. BEST PAPER AWARD, ACII2015 PDF

Dibeklioglu, H., Hammal, Z., Yang, Y., & Cohn, J. F. (2015). Multimodal detection of depression in clinical interviews. Proceedings of the ACM International Conference on Multimodal Interaction, Seattle, Washington. ICMI2015 PDF

Chu, W.S., Zeng, J., De la Torre, F., Cohn, J. F., & Messinger, D. S. (2015). Unsupervised synchrony discovery in human interaction. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile. ICCV2015

Zeng, J., Chu, W.S., Cohn, J. F., & De la Torre, F. (2015, in press). Confidence preserving machine for facial action unit detection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.ICCV2015


Selected publications

Curriculum Vitae PDF DOC


3D alignment from 2D video for action unit detection (33 MB)

Dense 3D alignment in a single image (7 MB)

Mother-infant synchrony using AAM (Messinger et al., 2009) Demo7 (130 MB)

Expression cloning using AAM Demo 4 Demo 5 (large files! Please be patient)




Binghamton-Pittsburgh 4D Database (Coming Fall 2013!)

CMU MultiPie

DISFA: Denver Intensity of Spontaneous Facial Actions

UNBC Pain Archive




Continuous Rating and Media Annotation (CARMA)

Discrete Rating and Media Annotation (DARMA)

Reliability AnalysisMatlab script

Face Analysis SDK

Performance Metrics for Imbalanced Data

Early Event Detection


“Automated Facial Expression Analysis for Research and Clinical Use.” National Institute of Mental Health MH096951, 5/1/2012 to 4/30/2017.

“Modeling the Dynamics of Communication and Development.” National Institutes of Health R01 GM105004, 8/1/2013 to 7/31/2017.

"Collaborative Research: CI-ADDO-NEW: 3D Dynamic Multimodal Spontaneous Emotion Corpus for Automated Facial Behavior Analysis." National Science Foundation CNS 1205195, 9/1/2012 to 8/31/2015.

Collaborative Research: Communication, Perturbation, and Early Development.” National Science Foundation BCS 1052603 , 6/15/2011 to 5/31/2015.

"Face De-Identification.” Federal Highway Administration. 02/01/2014 – 02/01/2015.

“Craniofacial Microsomia: Longitudinal Outcomes in Children Pre-Kindergarten (Supplement).” National Institutes of Health, 9/1/2013 to 12/30/2016.

“Collaborative Research: Learning and Sensory-Based Engagement, Arousal, and Self-Efficacy Modeling for Adaptive Web-Empowerment Trauma Treatment.” National Science Foundation, 8/16/2014 – 8/15/2018.

"Robotics Collaborative Technology Alliance (RCTA)." US Army Research Laboratory W911NF-10-2-0016, 7/1/2010 to 6/30/2019. 

“Affective Sensing Technology for the Detection and Monitoring of Depression and Melancholia.” Australian Research Council, 1/01/2013 to 12/31/2015.

Lage Scale, Personalized, Facial Action Unit Detection for Expression Recognition. Australian Research Council, 1/1/2014 to 12/31/2016.

"Computational Behavioral Science: Modelling, Analysis, and Visualization of Social and Communicative Behavior." National Science Foundation, 8/1/2010 to 7/31/2015.

“Doctoral Consortium for the ACM International Conference on Multimodal Interaction.” National Science Foundation, 9/1/2014 – 08/31/2015.


Undergraduate Courses

Graduate Courses

  • Psychological Assessment
  • Seminar in Infant Social and Emotional Development
  • Seminar in Emotion

Recent Collaborators

Zara Ambadar, University of Pittsburgh
Anne Burrows, Duquesne University
Fernando De la Torre, Carnegie Mellon University
Paul Ekman, University of California, San Francisco
Nathan Fox, University of Maryland
Ralph Gross, Carnegie Mellon University
Takeo Kanade, Carnegie Mellon University
Patrick Lucey, Disney Research Pittsuburgh
Simon Lucey, CSIRO, Australia and Carnegie Mellon University
Mohammad Mahoor, University of Denver
Iain Matthews, Disney Research and Carnegie Mellon University
Ginger Moore, Pennsylvania State University
Maja Pantic, Imperial College, UK
Daniel Messinger, University of Miami
Ken Prkachin, University of Northern British Columbia
Jason Saragih, CSIRO, Australia
Michael Sayette, University of Pittsburgh
Barry John Theobald, University of East Anglia
Lijun Yin, University of Binghamton