Jeffrey F. Cohn, PhD

University of Pittsburgh
4327 Sennott Square
Pittsburgh, PA 15260

jeffcohn @

412.624.8825 office
412.624.2023 fax
412.624.8826 lab
412.624.6682 lab

Jeffrey Cohn is Professor of Psychology and Psychiatry at the University of Pittsburgh and Adjunct Professor of Computer Science at the Robotics Institute at Carnegie Mellon University.   He leads interdisciplinary and inter-institutional efforts to develop advanced methods of automatic analysis and synthesis of facial expression and prosody and applies those tools to research in human emotion, social development, non-verbal communication, psychopathology, and biomedicine. His research has been supported by grants from the U.S. National Institutes of Health, National Science Foundation, Autism Foundation, Office of Naval Research, and Defense Advanced Research Projects Agency among other sponsors.

He co-chaired the IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017, FG2015, and FG2008), the International Conference on Affective Computing and Intelligent Interaction (ACII 2009), and the International Conference on Multimodal Interfaces (ACM 2014). He is a co-editor of IEEE Transactions in Affective Computing (TAC) and has co-edited special issues on affective computing for the Journal of Image and Vision Computing, Pattern Recognition Letters, Computer Vision and Image Understanding, and ACM Transactions on Interactive Intelligent Systems.



Congratulaitons to FacioMetrics!

Facial Expression Recognition and Analysis Challenge (FERA 2017) and Special Issue of Image and Vision Computing.

IEEE International Conference on Automatic Face and Gesture Recognition, Washington, DC. May 30 - June 3, 2017 FG 2017

IEEE Tansactions on Pattern Analysis and Machine Vision: Special Issue on the Computational Face

IEEE Transactions on Affective Computing: Special Issue on Human Behavior Analysis in the Wild

Pattern Recognition Letters: Special Issue on Personalized- and Context-sensitive Interfaces in the Wild

Current Projects

Adaptive DBS in Non-Motor Neuropsychiatric Disorders: Regulating Limbic Circuit Imbalance. National Institute of Neurological Disorders and Stroke, 9/1/2016 to 8/31/2021.

Automated Facial Expression Analysis for Research and Clinical Use. National Institute of Mental Health, 5/1/2012 to 2/28/2018.

Modeling the Dynamics of Communication and Development. National Institute of General Medicine, 8/1/2013 to 7/31/2017.

CI-SUSTAIN: Collaborative Research: Extending a Large Multimodal Corpus of Spontaneous Behavior for Automated Emotion Analysis. National Science Foundation, 7/25/2016 to 7/24/2019.

Collaborative Research: Learning and Sensory-Based Engagement, Arousal, and Self-Efficacy Modeling for Adaptive Web-Empowerment Trauma Treatment. National Science Foundation, 8/16/2014 – 8/15/2018.

Craniofacial Microsomia: Longitudinal Outcomes in Children Pre-Kindergarten. National Institutes of Health, 9/1/2013 to 7/31/2017.

Multimodal Assessment of Occurrence and Intensity of Pain for Research and Clinical Use. National Institutes of Health, 3/1/2017 to 2/28/2019.

Robotics Collaborative Technology Alliance (RCTA)." US Army Research Laboratory, 7/1/2010 to 6/30/2019.

Large Scale, Personalized, Facial Action Unit Detection for Expression Recognition. Australian Research Council, 1/1/2014 to 12/31/2016.


3D alignment from 2D video for action unit detection

AU detection using deep learning

Visual emotion recognition in a mobile system for the blind

Dense 3D transfer from a single image

Expression transfer in video-chat


Binghamton-Pittsburgh 4D Database (BP4D)

Cohn-Kanade, Cohn-Kanade+


DISFA: Denver Intensity of Spontaneous Facial Actions

UNBC Pain Archive





Performance Metrics for Imbalanced Data

Early Event Detection

Continuous Rating and Media Annotation (CARMA)

Face Analysis SDK



Selected publications

Curriculum Vitae PDF DOC


Abnormal Psychology
Psychology of Emotion
Seminar in Emotion

Recent Collaborators

David Borton, Brown University
Anne Burrows, Duquesne University
Fernando De la Torre, Carnegie Mellon University
Hamdi Dibeklioglu, Delft University of Technology
Paul Ekman, University of California, San Francisco
Sergio Escalera, University of Barcelona
Roland Goecke, University of Camberra
Wayne Goodman, Baylor Medical School
Ralph Gross, Carnegie Mellon University
Zakia Hammal, Carnegie Mellon University
Laszlo Jeni, Carnegie Mellon University
Takeo Kanade, Carnegie Mellon University
Patrick Lucey, Disney Research Pittsuburgh
Simon Lucey, CSIRO, Australia and Carnegie Mellon University
Mohammad Mahoor, University of Denver
Iain Matthews, Disney Research and Carnegie Mellon University
Ginger Moore, Pennsylvania State University
Maja Pantic, Imperial College, UK
Daniel Messinger, University of Miami
Louis-Phillipe Morency, Carnegie Mellon University
Michael Sayette, University of Pittsburgh
Stefan Scherer, Institute for Creative Technologies, University of Southern California
Matthew Speltz, Seattle Childrens Hospital
Lijun Yin, University of Binghamton