Micro expression classification using facial color and deep learning methods

Hadas Shahar, Hagit Hel-Or

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Micro emotions are a unique type of facial expression as they are involuntary and very brief. They usually occur when a person attempts to suppress or hide their emotions. Lasting less than 500 ms, they can be very hard to detect even for the human eye, however, since they reveal a person's true feelings, they are of extreme interest in many fields of study. Most approaches to automatic detection and classification of micro emotions rely on detecting the small residual facial movements. In this paper, we propose to exploit an aspect of the human face which is much harder to subdue, namely, facial color change due to blood flow during expression of emotion. We propose a system that evaluates color change during micro emotion expression and successfully classifies the emotion type. This approach is unique in that it disregards the motion related aspects of the expression, and relies entirely on the facial color. We show that our system improves over movement based approaches.

Original languageEnglish
Title of host publicationProceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1673-1680
Number of pages8
ISBN (Electronic)9781728150239
DOIs
StatePublished - Oct 2019
Event17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019 - Seoul, Korea, Republic of
Duration: 27 Oct 201928 Oct 2019

Publication series

NameProceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

Conference

Conference17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019
Country/TerritoryKorea, Republic of
CitySeoul
Period27/10/1928/10/19

Bibliographical note

Funding Information:
This research was supported by grant no 1455/16 from the Israeli Science Foundation.

Publisher Copyright:
© 2019 IEEE.

Keywords

  • Deep learning
  • Facial color
  • Micro emotion
  • Micro expression

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Micro expression classification using facial color and deep learning methods'. Together they form a unique fingerprint.

Cite this