Skip to content

A curated list of facial expression recognition in both 7-emotion classification and affect estimation.

Notifications You must be signed in to change notification settings

kdhht2334/awesome-SOTA-FER

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

89 Commits
 
 

Repository files navigation

Awesome-SOTA-FER

A curated list of facial expression recognition in both 7-emotion classification and affect estimation. In addition, this repository includes basic studies on FER and recent datasets.

👀 Update frequently!

🛎 Notice

⭐️: Importance of FER method (from 1 to 3 points)

🏆: Mandatory (research) paper to understand FER technology.

📋 What's New

  • [Sep. 2024] Add Challenge and emotion-related papers.
  • [Jul. 2024] Add Conference and Journal papers.
  • [Jun. 2024] Add some ArXiv and conference accepted papers.
  • [Apr. 2024] Make Multi-modal, EEG-based Emotion Recognition section. Update papers.
  • [Mar. 2024] Update FG papers.
  • [Feb. 2024] Update AAAI and ArXiv papers.
  • [Jan. 2024] Update few ArXiv papers.
  • [Nov. 2023] Update NeurIPS 2023 / ArXiv papers.
  • [Oct. 2023] Update ACII 2023 paper / Fix details.
  • [Sep. 2023] Update BMVC 2023 paper / Add Dataset section.
  • [Aug. 2023] Update ICCV 2023 / ACM MM 2023 papers.
  • [Jul. 2023] Update AAAI 2023 paper.
  • [Jun. 2023] Update ICML 2023 / ICASSP 2023 papers.
  • [Apr. 2023] Update CVPR 2023 papers.
  • [Mar. 2023] Initial update for FER papers.
  • [Mar. 2023] Create awesome-SOTA-FER repository.

👥 Contributing

Please feel free to refer this repository for your FER research/development and send me pull requests or email Daeha Kim to add links.

Table of Contents

7-Emotion Classification

2024

Paper Venue Impact Code
SynFER: Towards Boosting Facial Expression Recognition with Synthetic Data ArXiv ⭐️⭐️ N/A
ExpLLM: Towards Chain of Thought for Facial Expression Recognition ArXiv ⭐️⭐️ Site
A Survey on Facial Expression Recognition of Static and Dynamic Emotions TPAMI ⭐️⭐️⭐️ GitHub
Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistency ArXiv 🏆 N/A
LLDif: Diffusion Models for Low-light Emotion Recognition ICPR ⭐️⭐️ N/A
From Macro to Micro: Boosting Micro-Expression Recognition via Pre-Training on Macro-Expression Videos AriX ⭐️ N/A
FacePhi: Light-Weight Multi-Modal Large Language Model for Facial Landmark Emotion Recognition ICLRW ⭐️⭐️⭐️ N/A
Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer ArXiv ⭐️⭐️ PyTorch
MSSTNET: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition ICASSP ⭐️ N/A
Open-Set Facial Expression Recognition AAAI ⭐️⭐️⭐️ GitHub
MIDAS: Mixing Ambiguous Data with Soft Labels for Dynamic Facial Expression Recognition WACV ⭐️ N/A
Hard Sample-aware Consistency for Low-resolution Facial Expression Recognition WACV ⭐️ N/A

2023

Paper Venue Impact Code
POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition ICCV Workshop (AMFG) ⭐️⭐️ Github
GaFET: Learning Geometry-aware Facial Expression Translation from In-The-Wild Images ICCV ⭐️⭐️⭐️ N/A
LA-Net: Landmark-Aware Learning for Reliable Facial Expression Recognition under Label Noise ICCV ⭐️ N/A
Latent-OFER: Detect, Mask, and Reconstruct with Latent Vectors for Occluded Facial Expression Recognition ICCV ⭐️⭐️ PyTorch
Prompting Visual-Language Models for Dynamic Facial Expression Recognition BMVC ⭐️⭐️⭐️ PyTorch
MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition ACM MM ⭐️⭐️⭐️ PyTorch
Addressing Racial Bias in Facial Emotion Recognition ArXiv ⭐️ N/A
Learning Deep Hierarchical Features with Spatial Regularization for One-Class Facial Expression Recognition AAAI ⭐️ N/A
Facial Expression Recognition with Adaptive Frame Rate based on Multiple Testing Correction ICML ⭐️⭐️ N/A
Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition CVPR ⭐️⭐️ N/A
Rethinking the Learning Paradigm for Facial Expression Recognition CVPR ⭐️⭐️⭐️ N/A
Multi-Domain Norm-Referenced Encoding enables Data Efficient Transformer Learning of Facial Expression Recognition ArXiv ⭐️⭐️ N/A
Uncertainty-aware Label Distribution Learning for Facial Expression Recognition WACV ⭐️⭐️ TensorFlow
POSTER V2: A simpler and stronger facial expression recognition network ArXiv ⭐️⭐️ PyTorch

2022

Paper Venue Impact Code
Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition ECCV ⭐️⭐️⭐️ PyTorch
Learn-to-Decompose: Cascaded Decomposition Network for Cross-Domain Few-Shot Facial Expression Recognition ECCV ⭐️ PyTorch
Teaching with Soft Label Smoothing for Mitigating Noisy Labels in Facial Expressions ECCV ⭐️ PyTorch
Towards Semi-Supervised Deep Facial Expression Recognition with An Adaptive Confidence Margin CVPR ⭐️ PyTorch
Face2Exp: Combating Data Biases for Facial Expression Recognition CVPR ⭐️⭐️⭐️ PyTorch
Facial Expression Recognition By Using a Disentangled Identity Invariant Expression Representation [Poster] ICPR ⭐️⭐️ N/A
Vision Transformer Equipped with Neural Resizer on Facial Expression Recognition Task ICASSP ⭐️ PyTorch
A Prototype-Oriented Contrastive Adaption Network For Cross domain Facial Expression Recognition ACCV ⭐️ N/A
Soft Label Mining and Average Expression Anchoring for Facial Expression Recognition ACCV ⭐️ PyTorch
Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition BMVC ⭐️ Site
Cluster-level pseudo-labelling for source-free cross-domain facial expression recognition BMVC ⭐️⭐️ PyTorch
Analysis of Semi-Supervised Methods for Facial Expression Recognition ACII ⭐️ GitHub
POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition ArXiv 2022 ⭐️

2021

Paper Venue Impact Code
TransFER: Learning Relation-aware Facial Expression Representations with Transformers ICCV ⭐️⭐️ N/A
Understanding and Mitigating Annotation Bias in Facial Expression Recognition ICCV ⭐️ N/A
Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition CVPR ⭐️⭐️⭐️ PyTorch
Affective Processes: stochastic modelling of temporal context for emotion and facial expression recognition CVPR ⭐️⭐️ N/A
Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition CVPR ⭐️ N/A
Learning a Facial Expression Embedding Disentangled from Identity CVPR ⭐️⭐️⭐️ N/A
Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality CVPR ⭐️⭐️⭐️ Site
A Circular-Structured Representation for Visual Emotion Distribution Learning CVPR ⭐️ N/A
Temporal Stochastic Softmax for 3D CNNs: An Application in Facial Expression Recognition WACV ⭐️ PyTorch
Facial Expression Recognition in the Wild via Deep Attentive Center Loss WACV ⭐️⭐️ PyTorch
Identity-Aware Facial Expression Recognition Via Deep Metric Learning Based on Synthesized Images IEEE TMM ⭐️ N/A
Relative Uncertainty Learning for Facial Expression Recognition NeurIPS ⭐️⭐️⭐️ PyTorch
Identity-Free Facial Expression Recognition using conditional Generative Adversarial Network ICIP ⭐️ N/A
Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups Tech.
report
⭐️⭐️⭐️ N/A

2020

Paper Venue Impact Code
Suppressing Uncertainties for Large-Scale Facial Expression Recognition CVPR ⭐️⭐️ PyTorch
Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition CVPR ⭐️ N/A
Graph Neural Networks for Image Understanding Based on Multiple Cues: Group Emotion Recognition and Event Recognition as Use Cases WACV ⭐️ TensorFlow
Detecting Face2Face Facial Reenactment in Videos WACV ⭐️ N/A

Valence-arousal Affect Estimation and Analysis back-to-top

Paper Venue Year Impact Code
Ig3D: Integrating 3D Face Representations in Facial Expression Inference ECCVW 2024 ⭐️⭐️ Site
Detail-Enhanced Intra- and Inter-modal Interaction for Audio-Visual Emotion Recognition ICPR 2024 ⭐️ N/A
Bridging the Gap: Protocol Towards Fair and Consistent Affect Analysis FG 2024 ⭐️⭐️⭐️ PyTorch
Inconsistency-Aware Cross-Attention for Audio-Visual Fusion in Dimensional Emotion Recognition ArXiv 2024 ⭐️ N/A
CAGE: Circumplex Affect Guided Expression Inference CVPRW 2024 ⭐️⭐️ PyTorch
Cross-Attention is Not Always Needed: Dynamic Cross-Attention for Audio-Visual Dimensional Emotion Recognition ICME 2024 ⭐️⭐️ N/A
3DEmo: for Portrait Emotion Recognition with New Dataset ACM Journal on Computing and Cultural Heritage 2023 ⭐️⭐️ None
Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition NeurIPS
(spotlight)
2022 ⭐️⭐️⭐️ PyTorch
Emotion-aware Multi-view Contrastive Learning for Faciel Emotion Recognition ECCV 2022 ⭐️ PyTorch
Learning from Label Relationships in Human Affect ACM MM 2022 ⭐️ N/A
Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities? ArXiv 2022 ⭐️⭐️ N/A
Contrastive Adversarial Learning for Person Independent Facial Emotion Recognition AAAI 2021 ⭐️ PyTorch
Estimating continuous affect with label uncertainty ACII 2021 ⭐️ N/A
Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation CVPR 2020 ⭐️⭐️ N/A
BReG-NeXt: Facial affect computing using adaptive residual networks with bounded gradient IEEE TAC 2020 ⭐️⭐️ TensorFlow

Facial Action Unit (AU) Detection (or Recognition) back-to-top

  • This section also contains landmark detection.
Paper Venue Year Impact Code
Trend-Aware Supervision: On Learning Invariance for Semi-supervised Facial Action Unit Intensity Estimation AAAI 2024 ⭐️⭐️ N/A
FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection WACV 2023 ⭐️ N/A
Knowledge-Driven Self-Supervised Representation Learning for Facial Action Unit Recognition CVPR 2022 ⭐️ N/A
Towards Accurate Facial Landmark Detection via Cascaded Transformers CVPR 2022 ⭐️ N/A
Causal intervention for subject-deconfounded facial action unit recognition AAAI
(Oral)
2022 ⭐️⭐️⭐️ N/A
PIAP-DF: Pixel-Interested and Anti Person-Specific Facial Action Unit Detection Net with Discrete Feedback Learning ICCV 2021 ⭐️ N/A

About Facial Privacy back-to-top

  • Note: Some face recognition studies are included.
  • You can get additional information here
Paper Venue Year Impact Code
Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation ArXiv 2024 ⭐️⭐️ Inside Paper
ϵ-Mesh Attack: A Surface-based Adversarial Point Cloud Attack for Facial Expression Recognition FG 2024 ⭐️⭐️⭐️ PyTorch
Walk as you feel: Privacy preserving emotion recognition from gait patterns EAAI (ELSEVIER) 2023 ⭐️ N/A
GANonymization: A GAN-based Face Anonymization Framework for Preserving Emotional Expressions ACM Transactions on MCCA 2023 ⭐️⭐️ N/A
Simulated adversarial testing of face recognition models CVPR 2022 ⭐️⭐️ N/A
Exploring frequency adversarial attacks for face forgery detection CVPR 2022 ⭐️ N/A
Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer CVPR 2022 ⭐️⭐️ PyTorch
Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain ECCV 2022 ⭐️⭐️ PyTorch
DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domain ACM MM 2022 ⭐️⭐️ PyTorch
AdverFacial: Privacy-Preserving Universal Adversarial Perturbation Against Facial Micro-Expression Leakages ICASSP 2022 ⭐️ N/A
Lie to me: shield your emotions from prying software Sensors 2022 ⭐️ N/A
Point adversarial self-mining: A simple method for facial expression recognition IEEE Transactions on Cybernetics 2022 ⭐️ N/A
Improving transferability of adversarial patches on face recognition with generative models CVPR 2021 ⭐️ N/A
Towards face encryption by generating adversarial identity masks ICCV 2021 ⭐️⭐️ PyTorch
Disentangled Representation with Dual-stage Feature Learning for Face Anti-spoofing WACV 2021 ⭐️ N/A

Multi-modal, EEG-based Emotion Recognition back-to-top

Paper Venue Year Impact Code
A Comprehensive Survey on EEG-Based Emotion Recognition: A Graph-Based Perspective ArXiv 2024 ⭐️⭐️⭐️ N/A
Beyond Mimicking Under-Represented Emotions: Deep Data Augmentation with Emotional Subspace Constraints for EEG-Based Emotion Recognition AAAI 2024 ⭐️⭐️ N/A
A Brain-Inspired Way of Reducing the Network Complexity via Concept-Regularized Coding for Emotion Recognition AAAI 2024 ⭐️⭐️ PyTorch

Facial Expression Manipulation and Synthesis back-to-top

  • Uprising Talking face generation task is included here!
Paper Venue Year Impact Code
Towards Localized Fine-Grained Control for Facial Expression Generation ArXiv 2024 ⭐️⭐️⭐️ GitHub
3D Facial Expressions through Analysis-by-Neural-Synthesis CVPR 2024 ⭐️⭐️⭐️ Project
Learning Adaptive Spatial Coherent Correlations for Speech-Preserving Facial Expression Manipulation CVPR 2024 ⭐️⭐️ PyTorch
FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features CVPR 2024 ⭐️⭐️ Project
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization CVPR 2024 ⭐️⭐️ N/A
EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars CVPR 2024 ⭐️⭐️ Project
FG-EmoTalk: Talking Head Video Generation with Fine-Grained Controllable Facial Expressions AAAI 2024 ⭐️⭐️ N/A
EmoStyle: One-Shot Facial Expression Editing Using Continuous Emotion Parameters WACV 2024 ⭐️⭐️⭐️ Project
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation ICCV 2023 ⭐️⭐️⭐️ Project
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation ICCV 2023 ⭐️⭐️ None
Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation ICCV 2023 ⭐️⭐️ Project
DisCoHead: Audio-and-Video-Driven Talking Head Generation by Disentangled Control of Head Pose and Facial Expressions ICASSP 2023 ⭐️ Project
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert CVPR 2023 ⭐️⭐️ GitHub
LipFormer: High-fidelity and Generalizable Talking Face Generation with A Pre-learned Facial Codebook CVPR 2023 ⭐️ N/A
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation CVPR 2023 🏆 GitHub
Identity-Preserving Talking Face Generation with Landmark and Appearance Priors CVPR 2023 ⭐️ N/A
OTAvatar : One-shot Talking Face Avatar with Controllable Tri-plane Rendering CVPR 2023 ⭐️⭐️⭐️ PyTorch
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning CVPR 2023 ⭐️⭐️⭐️ N/A
4D Facial Expression Diffusion Model ArXiv 2023 ⭐️⭐️⭐️ Github
EMOCA: Emotion Driven Monocular Face Capture and Animation CVPR 2022 ⭐️⭐️ Project
Sparse to Dense Dynamic 3D Facial Expression Generation CVPR 2022 ⭐️ GitHub
Neural Emotion Director: Speech-preserving semantic control of facial expressions in “in-the-wild” videos CVPR
(best paper finalist)
2022 ⭐️⭐️⭐️ Site
TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing CVPR 2022 ⭐️⭐️ PyTorch
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model SIGGRAPH 2022 ⭐️⭐️ Project
Information Bottlenecked Variational Autoencoder for Disentangled 3D Facial Expression Modelling WACV 2022 ⭐️ N/A
Detection and Localization of Facial Expression Manipulations WACV 2022 ⭐️ N/A
Learning an Animatable Detailed 3D Face Model from In-The-Wild Images SIGGRAPH 2021 ⭐️⭐️⭐️ Project
Talk-to-Edit: Fine-Grained Facial Editing via Dialog ICCV 2021 ⭐️⭐️ PyTorch
Audio-Driven Emotional Video Portraits CVPR 2021 ⭐️ Site
GANmut: Learning Interpretable Conditional Space for Gamut of Emotions CVPR 2021 ⭐️⭐️ PyTorch
3D Dense Geometry-Guided Facial Expression Synthesis by Adversarial Learning WACV 2021 ⭐️ N/A
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning ICCV 2021 ⭐️⭐️⭐️ PyTorch
Cascade EF-GAN: Progressive Facial Expression Editing with Local Focuses CVPR 2020 ⭐️ N/A
Interpreting the latent space of gans for semantic face editing CVPR 2020 ⭐️⭐️⭐️ TensorFlow

Emotion Recognition, Facial Representations, and Others back-to-top

Paper Venue Year Impact Code
Generative Technology for Human Emotion Recognition: A Scope Review ArXiv 2024 ⭐️⭐️ N/A
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition ACL 2024 ⭐️⭐️ PyTorch
AffectGPT: Dataset and Framework for Explainable Multimodal Emotion Recognition ArXiv 2024 ⭐️⭐️⭐️ PyTorch
Towards Context-Aware Emotion Recognition Debiasing from a Causal Demystification Perspective via De-confounded Training TPAMI 2024 ⭐️⭐️ None
EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models CVPR 2024 ⭐️⭐️ N/A
A Unified and Interpretable Emotion Representation and Expression Generation CVPR 2024 ⭐️⭐️⭐️ Project
Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation CVPR 2024 ⭐️⭐️ Project
EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning CVPR 2024 ⭐️⭐️⭐️ GitHub
Robust Emotion Recognition in Context Debiasing CVPR 2024 ⭐️⭐️ N/A
Region-Based Emotion Recognition via Superpixel Feature Pooling CVPRW 2024 ⭐️⭐️ N/A
Emotion Recognition from the perspective of Activity Recognition ArXiv 2024 ⭐️ N/A
GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing ArXiv 2024 ⭐️⭐️⭐️ GitHub
The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition ArXiv 2024 ⭐️ N/A
DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition FG 2024 ⭐️⭐️ N/A
Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport ArXiv 2024 ⭐️⭐️ PyTorch
Beyond Accuracy: Fairness, Scalability, and Uncertainty Considerations in Facial Emotion Recognition NLDL 2024 ⭐️⭐️⭐️ None
Evaluating and Inducing Personality in Pre-trained Language Models NeurIPS 2024 ⭐️⭐️⭐️ Site
Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations ArXiv 2023 ⭐️⭐️ None
An Empirical Study of Super-resolution on Low-resolution Micro-expression Recognition ArXiv 2023 ⭐️⭐️ None
EmoCLIP: A Vision-Language Method for Zero-Shot Video Facial Expression Recognition ArXiv 2023 ⭐️⭐️ PyTorch
Towards affective computing that works for everyone ACII 2023 ⭐️⭐️⭐️ None
Emotional Listener Portrait: Realistic Listener Motion Simulation in Conversation ICCV 2023 ⭐️⭐️ None
Affective Image Filter: Reflecting Emotions from Text to Images ICCV 2023 ⭐️⭐️ None
Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Erasing Network CVPR 2023 ⭐️ PyTorch
Learning Emotion Representations from Verbal and Nonverbal Communication CVPR 2023 ⭐️⭐️ GitHub
Multivariate, Multi-frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognition in Conversation CVPR 2023 ⭐️ N/A
How you feelin’? Learning Emotions and Mental States in Movie Scenes CVPR 2023 ⭐️⭐️⭐️ Project
Decoupled Multimodal Distilling for Emotion Recognition CVPR 2023 ⭐️⭐️⭐️ PyTorch
Context De-confounded Emotion Recognition CVPR 2023 ⭐️⭐️ PyTorch
More is Better: A Database for Spontaneous Micro-Expression with High Frame Rates ArXiv 2023 ⭐️ N/A
Pre-training strategies and datasets for facial representation learning ECCV 2022 ⭐️⭐️⭐️ PyTorch
Multi-Dimensional, Nuanced and Subjective – Measuring the Perception of Facial Expressions CVPR 2022 ⭐️⭐️⭐️ N/A
General Facial Representation Learning in a Visual-Linguistic Manner CVPR 2022 ⭐️⭐️ PyTorch
Robust Egocentric Photo-realistic Facial Expression Transfer for Virtual Reality CVPR 2022 ⭐️⭐️⭐️ N/A
Fair Contrastive Learning for Facial Attribute Classification CVPR 2022 ⭐️⭐️ PyTorch
Quantified Facial Expressiveness for Affective Behavior Analytics WACV 2022 ⭐️ N/A
Deep facial expression recognition: A survey IEEE TAC 2020 🏆 N/A
iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis CVPR 2021 ⭐️ Data
Emotions as overlapping causal networks of emotion components: Implications and methodological approaches Emotion Review 2021 ⭐️ N/A
Hidden Emotion Detection using Multi-modal Signals CHI 2021 ⭐️⭐️ Data
Latent to Latent: A Learned Mapper for Identity Preserving Editing of Multiple Face Attributes in StyleGAN-generated Images WACV 2021 ⭐️ PyTorch
FaceForensics++: Learning to Detect Manipulated Facial Images ArXiv 2018 ⭐️⭐️⭐️ Site
Graph-Structured Referring Expression Reasoning in The Wild CVPR 2020 ⭐️ PyTorch
EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege’s Principle CVPR 2020 ⭐️ Site
Learning Visual Emotion Representations from Web Data CVPR 2020 ⭐️ Site
Computational Models of Emotion Inference in Theory of Mind: A Review and Roadmap Topics in cognitive science 2019 ⭐️⭐️⭐️ N/A
Putting feelings into words: Affect labeling as implicit emotion regulation Emotion Review 2018 ⭐️⭐️⭐️ N/A
Affective cognition: Exploring lay theories of emotion Cognition
(ELSEVIER)
2015 ⭐️⭐️⭐️ N/A
Facial Expression Recognition: A Survey Procedia Computer Science
(ELSEVIER)
2015 ⭐️⭐️ N/A
Norms of valence, arousal, and dominance for 13,915 English lemmas Behavior Research Methods 2013 ⭐️⭐️ N/A
Facial expression and emotion American Psychologist 1993 🏆 N/A
Understanding face recognition British journal of psychology 1986 🏆 N/A
A circumplex model of affect Journal of Personality and Social Psychology 1980 🏆 N/A

Datasets back-to-top

Name Venue Year Impact Site
FindingEmo: An Image Dataset for Emotion Recognition in the Wild ArXiv 2024 ⭐️⭐️ N/A
VEATIC: Video-based Emotion and Affect Tracking in Context Dataset WACV 2024 ⭐️ Project
EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributes ICCV 2023 ⭐️⭐️ Project
MimicME: A Large Scale Diverse 4D Database for Facial Expression Analysis ECCV 2022 ⭐️⭐️ Github
CelebV-HQ: A Large-Scale Video Facial Attributes Dataset ECCV 2022 ⭐️⭐️⭐️ Project GitHub Demo
FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videos CVPR 2022 ⭐️⭐️⭐️ Data
MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wild ACM MM 2022 ⭐️ Site
Aff-wild2: Extending the aff-wild database for affect recognition ArXiv 2018 ⭐️⭐️ Project
Aff-wild: valence and arousal 'In-the-Wild' challenge CVPRW 2017 ⭐️⭐️ Project

Challenges back-to-top

Name Venue Year Site
Facial Expression Recognition and Analysis Challenge FG 2015 Site
Emotion Recognition in the Wild Challenge (EmotiW) ICMI 2013-2018 Site
Emotion Recognition in the Wild Challenge (EmotiW) ICMI 2023 Site
Affect Recognition in-the-wild: Uni/Multi-Modal Analysis & VA-AU-Expression Challenges FG 2020 Site
Affective Behavior Analysis In-the-Wild (1st) FG 2020 Site
Deepfake Detection Challenge - 2020 Site Paper GitHub
Affective Behavior Analysis In-the-Wild (2nd) ICCV 2021 Site Paper
Affective Behavior Analysis In-the-Wild (3rd) CVPR 2022 Site Paper
Affective Behavior Analysis In-the-Wild (4th) ECCV 2022 Site
The Multimodal Sentiment Analysis Challenge (MuSe) ACM MM 2022 Site Paper
Affective Behavior Analysis In-the-Wild (5th) CVPR 2023 Site
Emotionally And Culturally Intelligent AI (1st) ICCV 2023 Site
Affective Behavior Analysis in-the-wild (6th) CVPR 2024 Site
Affective Behavior Analysis in-the-wild (7th) ECCV 2024 Site
1M-Deepfakes Detection Challenge ACM MM 2024 Paper Site
Name Paper(/Feature) Site
FLAME Learning a model of facial shape and expression from 4D scans Project TensorFlow PyTorch
FaceNet Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks PyTorch TensorFlow
Landmark detection - PyTorch
Age estimation -
DataGen APIs all about human faces and bodies Web

Remarkable Papers (2019~) back-to-top

Paper Venue Year Impact Code
A Compact Embedding for Facial Expression Similarity CVPR 2019 ⭐️⭐️⭐️ PyTorch
A Personalized Affective Memory Model for Improving Emotion Recognition ICML 2019 ⭐️⭐️ TensorFlow
Facial Expression Recognition via Relation-based Conditional Generative Adversarial Network ICMI 2019 ⭐️ N/A
Facial Expression Recognition by De-expression Residue Learning CVPR 2018 ⭐️⭐️ N/A
Joint pose and expression modeling for facial expression recognition CVPR 2018 ⭐️⭐️ TensorFlow
Identity-Aware Convolutional Neural Network for Facial Expression Recognition FG 2017 ⭐️⭐️⭐️ N/A
Facenet2expnet: Regularizing a deep face recognition net for expression recognition FG 2017 ⭐️⭐️ N/A
Facial expression recognition from near-infrared videos Image and Vision Computing
(ELSEVIER)
2011 ⭐️ N/A
Facial expression decomposition ICCV 2003 🏆 N/A

About

A curated list of facial expression recognition in both 7-emotion classification and affect estimation.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published