Awesome-SOTA-FER

A curated list of facial expression recognition in both 7-emotion classification and affect estimation. In addition, this repository includes basic studies on FER and recent datasets.

👀 Update frequently!

🛎 Notice

⭐️: Importance of FER method (from 1 to 3 points)

🏆: Mandatory (research) paper to understand FER technology.

📋 What's New

• [Dec. 2024] Add ArXiv papers.
• [Nov. 2024] Add ECCV 2024 accepted papers.
• [Sep. 2024] Add Challenge and emotion-related papers.
• [Jul. 2024] Add Conference and Journal papers.
• [Jun. 2024] Add some ArXiv and conference accepted papers.
• [Apr. 2024] Make Multi-modal, EEG-based Emotion Recognition section. Update papers.
• [Mar. 2024] Update FG papers.
• [Feb. 2024] Update AAAI and ArXiv papers.
• [Jan. 2024] Update few ArXiv papers.
• [Nov. 2023] Update NeurIPS 2023 / ArXiv papers.
• [Oct. 2023] Update ACII 2023 paper / Fix details.
• [Sep. 2023] Update BMVC 2023 paper / Add Dataset section.
• [Aug. 2023] Update ICCV 2023 / ACM MM 2023 papers.
• [Jul. 2023] Update AAAI 2023 paper.
• [Jun. 2023] Update ICML 2023 / ICASSP 2023 papers.
• [Apr. 2023] Update CVPR 2023 papers.
• [Mar. 2023] Initial update for FER papers.
• [Mar. 2023] Create awesome-SOTA-FER repository.

👥 Contributing

Please feel free to refer this repository for your FER research/development and send me pull requests or email Daeha Kim to add links.

Table of Contents

• 7-Emotion Classification

  • 2024
  • 2023
  • 2022
  • 2021
  • 2020

• Valence-arousal Affect Estimation and Analysis

• Facial Action Unit (AU) Detection (or Recognition)

• About Facial Privacy

• Multi-modal, EEG-based Emotion Recognition

• Facial Expression Manipulation and Synthesis

• Emotion Recognition, Facial Representations, and Others

• Datasets

• Challenges

• Tools

• Remarkable Papers (2019~)

7-Emotion Classification

2024

Paper	Venue	Impact	Code
Generalizable Facial Expression Recognition	ECCV	⭐️⭐️	GitHub
Norface: Improving Facial Expression Analysis by Identity Normalization	ECCV	⭐️⭐️	Project
Bridging the Gaps: Utilizing Unlabeled Face Recognition Datasets to Boost Semi-Supervised Facial Expression Recognition	ArXiv	⭐️	PyTorch
SynFER: Towards Boosting Facial Expression Recognition with Synthetic Data	ArXiv	⭐️⭐️	N/A
ExpLLM: Towards Chain of Thought for Facial Expression Recognition	ArXiv	⭐️⭐️	Site
A Survey on Facial Expression Recognition of Static and Dynamic Emotions	TPAMI	⭐️⭐️⭐️	GitHub
Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistency	ArXiv	🏆	N/A
LLDif: Diffusion Models for Low-light Emotion Recognition	ICPR	⭐️⭐️	N/A
From Macro to Micro: Boosting Micro-Expression Recognition via Pre-Training on Macro-Expression Videos	AriX	⭐️	N/A
FacePhi: Light-Weight Multi-Modal Large Language Model for Facial Landmark Emotion Recognition	ICLRW	⭐️⭐️⭐️	N/A
Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer	ArXiv	⭐️⭐️	PyTorch
MSSTNET: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition	ICASSP	⭐️	N/A
Open-Set Facial Expression Recognition	AAAI	⭐️⭐️⭐️	GitHub
MIDAS: Mixing Ambiguous Data with Soft Labels for Dynamic Facial Expression Recognition	WACV	⭐️	N/A
Hard Sample-aware Consistency for Low-resolution Facial Expression Recognition	WACV	⭐️	N/A

2023

Paper	Venue	Impact	Code
POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition	ICCV Workshop (AMFG)	⭐️⭐️	Github
GaFET: Learning Geometry-aware Facial Expression Translation from In-The-Wild Images	ICCV	⭐️⭐️⭐️	N/A
LA-Net: Landmark-Aware Learning for Reliable Facial Expression Recognition under Label Noise	ICCV	⭐️	N/A
Latent-OFER: Detect, Mask, and Reconstruct with Latent Vectors for Occluded Facial Expression Recognition	ICCV	⭐️⭐️	PyTorch
Prompting Visual-Language Models for Dynamic Facial Expression Recognition	BMVC	⭐️⭐️⭐️	PyTorch
MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition	ACM MM	⭐️⭐️⭐️	PyTorch
Addressing Racial Bias in Facial Emotion Recognition	ArXiv	⭐️	N/A
Learning Deep Hierarchical Features with Spatial Regularization for One-Class Facial Expression Recognition	AAAI	⭐️	N/A
Facial Expression Recognition with Adaptive Frame Rate based on Multiple Testing Correction	ICML	⭐️⭐️	N/A
Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition	CVPR	⭐️⭐️	N/A
Rethinking the Learning Paradigm for Facial Expression Recognition	CVPR	⭐️⭐️⭐️	N/A
Multi-Domain Norm-Referenced Encoding enables Data Efficient Transformer Learning of Facial Expression Recognition	ArXiv	⭐️⭐️	N/A
Uncertainty-aware Label Distribution Learning for Facial Expression Recognition	WACV	⭐️⭐️	TensorFlow
POSTER V2: A simpler and stronger facial expression recognition network	ArXiv	⭐️⭐️	PyTorch

2022

Paper	Venue	Impact	Code
Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition	ECCV	⭐️⭐️⭐️	PyTorch
Learn-to-Decompose: Cascaded Decomposition Network for Cross-Domain Few-Shot Facial Expression Recognition	ECCV	⭐️	PyTorch
Teaching with Soft Label Smoothing for Mitigating Noisy Labels in Facial Expressions	ECCV	⭐️	PyTorch
Towards Semi-Supervised Deep Facial Expression Recognition with An Adaptive Confidence Margin	CVPR	⭐️	PyTorch
Face2Exp: Combating Data Biases for Facial Expression Recognition	CVPR	⭐️⭐️⭐️	PyTorch
Facial Expression Recognition By Using a Disentangled Identity Invariant Expression Representation [Poster]	ICPR	⭐️⭐️	N/A
Vision Transformer Equipped with Neural Resizer on Facial Expression Recognition Task	ICASSP	⭐️	PyTorch
A Prototype-Oriented Contrastive Adaption Network For Cross domain Facial Expression Recognition	ACCV	⭐️	N/A
Soft Label Mining and Average Expression Anchoring for Facial Expression Recognition	ACCV	⭐️	PyTorch
Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition	BMVC	⭐️	Site
Cluster-level pseudo-labelling for source-free cross-domain facial expression recognition	BMVC	⭐️⭐️	PyTorch
Analysis of Semi-Supervised Methods for Facial Expression Recognition	ACII	⭐️	GitHub
POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition	ArXiv	2022	⭐️

2021

Paper	Venue	Impact	Code
TransFER: Learning Relation-aware Facial Expression Representations with Transformers	ICCV	⭐️⭐️	N/A
Understanding and Mitigating Annotation Bias in Facial Expression Recognition	ICCV	⭐️	N/A
Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition	CVPR	⭐️⭐️⭐️	PyTorch
Affective Processes: stochastic modelling of temporal context for emotion and facial expression recognition	CVPR	⭐️⭐️	N/A
Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition	CVPR	⭐️	N/A
Learning a Facial Expression Embedding Disentangled from Identity	CVPR	⭐️⭐️⭐️	N/A
Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality	CVPR	⭐️⭐️⭐️	Site
A Circular-Structured Representation for Visual Emotion Distribution Learning	CVPR	⭐️	N/A
Temporal Stochastic Softmax for 3D CNNs: An Application in Facial Expression Recognition	WACV	⭐️	PyTorch
Facial Expression Recognition in the Wild via Deep Attentive Center Loss	WACV	⭐️⭐️	PyTorch
Identity-Aware Facial Expression Recognition Via Deep Metric Learning Based on Synthesized Images	IEEE TMM	⭐️	N/A
Relative Uncertainty Learning for Facial Expression Recognition	NeurIPS	⭐️⭐️⭐️	PyTorch
Identity-Free Facial Expression Recognition using conditional Generative Adversarial Network	ICIP	⭐️	N/A
Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups	Tech. report	⭐️⭐️⭐️	N/A

2020

Paper	Venue	Impact	Code
Suppressing Uncertainties for Large-Scale Facial Expression Recognition	CVPR	⭐️⭐️	PyTorch
Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition	CVPR	⭐️	N/A
Graph Neural Networks for Image Understanding Based on Multiple Cues: Group Emotion Recognition and Event Recognition as Use Cases	WACV	⭐️	TensorFlow
Detecting Face2Face Facial Reenactment in Videos	WACV	⭐️	N/A

Valence-arousal Affect Estimation and Analysis back-to-top

Paper	Venue	Year	Impact	Code
Ig3D: Integrating 3D Face Representations in Facial Expression Inference	ECCVW	2024	⭐️⭐️	Site
Detail-Enhanced Intra- and Inter-modal Interaction for Audio-Visual Emotion Recognition	ICPR	2024	⭐️	N/A
Bridging the Gap: Protocol Towards Fair and Consistent Affect Analysis	FG	2024	⭐️⭐️⭐️	PyTorch
Inconsistency-Aware Cross-Attention for Audio-Visual Fusion in Dimensional Emotion Recognition	ArXiv	2024	⭐️	N/A
CAGE: Circumplex Affect Guided Expression Inference	CVPRW	2024	⭐️⭐️	PyTorch
Cross-Attention is Not Always Needed: Dynamic Cross-Attention for Audio-Visual Dimensional Emotion Recognition	ICME	2024	⭐️⭐️	N/A
3DEmo: for Portrait Emotion Recognition with New Dataset	ACM Journal on Computing and Cultural Heritage	2023	⭐️⭐️	None
Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition	NeurIPS (spotlight)	2022	⭐️⭐️⭐️	PyTorch
Emotion-aware Multi-view Contrastive Learning for Faciel Emotion Recognition	ECCV	2022	⭐️	PyTorch
Learning from Label Relationships in Human Affect	ACM MM	2022	⭐️	N/A
Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities?	ArXiv	2022	⭐️⭐️	N/A
Contrastive Adversarial Learning for Person Independent Facial Emotion Recognition	AAAI	2021	⭐️	PyTorch
Estimating continuous affect with label uncertainty	ACII	2021	⭐️	N/A
Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation	CVPR	2020	⭐️⭐️	N/A
BReG-NeXt: Facial affect computing using adaptive residual networks with bounded gradient	IEEE TAC	2020	⭐️⭐️	TensorFlow

Facial Action Unit (AU) Detection (or Recognition) back-to-top

• This section also contains landmark detection.

Paper	Venue	Year	Impact	Code
Trend-Aware Supervision: On Learning Invariance for Semi-supervised Facial Action Unit Intensity Estimation	AAAI	2024	⭐️⭐️	N/A
FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection	WACV	2023	⭐️	N/A
Knowledge-Driven Self-Supervised Representation Learning for Facial Action Unit Recognition	CVPR	2022	⭐️	N/A
Towards Accurate Facial Landmark Detection via Cascaded Transformers	CVPR	2022	⭐️	N/A
Causal intervention for subject-deconfounded facial action unit recognition	AAAI (Oral)	2022	⭐️⭐️⭐️	N/A
PIAP-DF: Pixel-Interested and Anti Person-Specific Facial Action Unit Detection Net with Discrete Feedback Learning	ICCV	2021	⭐️	N/A

About Facial Privacy back-to-top

• Note: Some face recognition studies are included.
• You can get additional information here

Paper	Venue	Year	Impact	Code
Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation	ArXiv	2024	⭐️⭐️	Inside Paper
ϵ-Mesh Attack: A Surface-based Adversarial Point Cloud Attack for Facial Expression Recognition	FG	2024	⭐️⭐️⭐️	PyTorch
Walk as you feel: Privacy preserving emotion recognition from gait patterns	EAAI (ELSEVIER)	2023	⭐️	N/A
GANonymization: A GAN-based Face Anonymization Framework for Preserving Emotional Expressions	ACM Transactions on MCCA	2023	⭐️⭐️	N/A
Simulated adversarial testing of face recognition models	CVPR	2022	⭐️⭐️	N/A
Exploring frequency adversarial attacks for face forgery detection	CVPR	2022	⭐️	N/A
Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer	CVPR	2022	⭐️⭐️	PyTorch
Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain	ECCV	2022	⭐️⭐️	PyTorch
DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domain	ACM MM	2022	⭐️⭐️	PyTorch
AdverFacial: Privacy-Preserving Universal Adversarial Perturbation Against Facial Micro-Expression Leakages	ICASSP	2022	⭐️	N/A
Lie to me: shield your emotions from prying software	Sensors	2022	⭐️	N/A
Point adversarial self-mining: A simple method for facial expression recognition	IEEE Transactions on Cybernetics	2022	⭐️	N/A
Improving transferability of adversarial patches on face recognition with generative models	CVPR	2021	⭐️	N/A
Towards face encryption by generating adversarial identity masks	ICCV	2021	⭐️⭐️	PyTorch
Disentangled Representation with Dual-stage Feature Learning for Face Anti-spoofing	WACV	2021	⭐️	N/A

Multi-modal, EEG-based Emotion Recognition back-to-top

Paper	Venue	Year	Impact	Code
A Comprehensive Survey on EEG-Based Emotion Recognition: A Graph-Based Perspective	ArXiv	2024	⭐️⭐️⭐️	N/A
Beyond Mimicking Under-Represented Emotions: Deep Data Augmentation with Emotional Subspace Constraints for EEG-Based Emotion Recognition	AAAI	2024	⭐️⭐️	N/A
A Brain-Inspired Way of Reducing the Network Complexity via Concept-Regularized Coding for Emotion Recognition	AAAI	2024	⭐️⭐️	PyTorch

Facial Expression Manipulation and Synthesis back-to-top

• Uprising Talking face generation task is included here!

Paper	Venue	Year	Impact	Code
All You Need is Your Voice: Emotional Face Representation with Audio Perspective for Emotional Talking Face Generation	ECCV	2024	⭐️⭐️	GitHub
AnimateMe: 4D Facial Expressions via Diffusion Models	ECCV	2024	⭐️⭐️	N/A
Towards Localized Fine-Grained Control for Facial Expression Generation	ArXiv	2024	⭐️⭐️⭐️	GitHub
3D Facial Expressions through Analysis-by-Neural-Synthesis	CVPR	2024	⭐️⭐️⭐️	Project
Learning Adaptive Spatial Coherent Correlations for Speech-Preserving Facial Expression Manipulation	CVPR	2024	⭐️⭐️	PyTorch
FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features	CVPR	2024	⭐️⭐️	Project
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization	CVPR	2024	⭐️⭐️	N/A
EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars	CVPR	2024	⭐️⭐️	Project
FG-EmoTalk: Talking Head Video Generation with Fine-Grained Controllable Facial Expressions	AAAI	2024	⭐️⭐️	N/A
EmoStyle: One-Shot Facial Expression Editing Using Continuous Emotion Parameters	WACV	2024	⭐️⭐️⭐️	Project
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation	ICCV	2023	⭐️⭐️⭐️	Project
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation	ICCV	2023	⭐️⭐️	None
Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation	ICCV	2023	⭐️⭐️	Project
DisCoHead: Audio-and-Video-Driven Talking Head Generation by Disentangled Control of Head Pose and Facial Expressions	ICASSP	2023	⭐️	Project
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert	CVPR	2023	⭐️⭐️	GitHub
LipFormer: High-fidelity and Generalizable Talking Face Generation with A Pre-learned Facial Codebook	CVPR	2023	⭐️	N/A
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation	CVPR	2023	🏆	GitHub
Identity-Preserving Talking Face Generation with Landmark and Appearance Priors	CVPR	2023	⭐️	N/A
OTAvatar : One-shot Talking Face Avatar with Controllable Tri-plane Rendering	CVPR	2023	⭐️⭐️⭐️	PyTorch
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning	CVPR	2023	⭐️⭐️⭐️	N/A
4D Facial Expression Diffusion Model	ArXiv	2023	⭐️⭐️⭐️	Github
EMOCA: Emotion Driven Monocular Face Capture and Animation	CVPR	2022	⭐️⭐️	Project
Sparse to Dense Dynamic 3D Facial Expression Generation	CVPR	2022	⭐️	GitHub
Neural Emotion Director: Speech-preserving semantic control of facial expressions in “in-the-wild” videos	CVPR (best paper finalist)	2022	⭐️⭐️⭐️	Site
TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing	CVPR	2022	⭐️⭐️	PyTorch
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model	SIGGRAPH	2022	⭐️⭐️	Project
Information Bottlenecked Variational Autoencoder for Disentangled 3D Facial Expression Modelling	WACV	2022	⭐️	N/A
Detection and Localization of Facial Expression Manipulations	WACV	2022	⭐️	N/A
Learning an Animatable Detailed 3D Face Model from In-The-Wild Images	SIGGRAPH	2021	⭐️⭐️⭐️	Project
Talk-to-Edit: Fine-Grained Facial Editing via Dialog	ICCV	2021	⭐️⭐️	PyTorch
Audio-Driven Emotional Video Portraits	CVPR	2021	⭐️	Site
GANmut: Learning Interpretable Conditional Space for Gamut of Emotions	CVPR	2021	⭐️⭐️	PyTorch
3D Dense Geometry-Guided Facial Expression Synthesis by Adversarial Learning	WACV	2021	⭐️	N/A
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning	ICCV	2021	⭐️⭐️⭐️	PyTorch
Cascade EF-GAN: Progressive Facial Expression Editing with Local Focuses	CVPR	2020	⭐️	N/A
Interpreting the latent space of gans for semantic face editing	CVPR	2020	⭐️⭐️⭐️	TensorFlow

Emotion Recognition, Facial Representations, and Others back-to-top

Paper	Venue	Year	Impact	Code
A Survey on Facial Expression Recognition of Static and Dynamic Emotions	ArXiv	2024	⭐️⭐️⭐️	GitHub
Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning	NeurIPS	2024	⭐️⭐️⭐️	Project Demo
Exploring Vision Language Models for Facial Attribute Recognition: Emotion, Race, Gender, and Age	ArXiv	2024	⭐️	N/A
A survey on Graph Deep Representation Learning for Facial Expression Recognition	ArXiv	2024	⭐️	N/A
Training A Small Emotional Vision Language Model for Visual Art Comprehension	ECCV	2024	⭐️⭐️	GitHub
Affective Visual Dialog: A Large-Scale Benchmark for Emotional Reasoning Based on Visually Grounded Conversations	ECCV	2024	⭐️⭐️⭐️	Project
Generative Technology for Human Emotion Recognition: A Scope Review	ArXiv	2024	⭐️⭐️	N/A
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition	ACL	2024	⭐️⭐️	PyTorch
AffectGPT: Dataset and Framework for Explainable Multimodal Emotion Recognition	ArXiv	2024	⭐️⭐️⭐️	PyTorch
Towards Context-Aware Emotion Recognition Debiasing from a Causal Demystification Perspective via De-confounded Training	TPAMI	2024	⭐️⭐️	None
EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models	CVPR	2024	⭐️⭐️	N/A
A Unified and Interpretable Emotion Representation and Expression Generation	CVPR	2024	⭐️⭐️⭐️	Project
Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation	CVPR	2024	⭐️⭐️	Project
EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning	CVPR	2024	⭐️⭐️⭐️	GitHub
Robust Emotion Recognition in Context Debiasing	CVPR	2024	⭐️⭐️	N/A
Region-Based Emotion Recognition via Superpixel Feature Pooling	CVPRW	2024	⭐️⭐️	N/A
Emotion Recognition from the perspective of Activity Recognition	ArXiv	2024	⭐️	N/A
GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing	ArXiv	2024	⭐️⭐️⭐️	GitHub
The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition	ArXiv	2024	⭐️	N/A
DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition	FG	2024	⭐️⭐️	N/A
Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport	ArXiv	2024	⭐️⭐️	PyTorch
Beyond Accuracy: Fairness, Scalability, and Uncertainty Considerations in Facial Emotion Recognition	NLDL	2024	⭐️⭐️⭐️	None
Evaluating and Inducing Personality in Pre-trained Language Models	NeurIPS	2024	⭐️⭐️⭐️	Site
Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations	ArXiv	2023	⭐️⭐️	None
An Empirical Study of Super-resolution on Low-resolution Micro-expression Recognition	ArXiv	2023	⭐️⭐️	None
EmoCLIP: A Vision-Language Method for Zero-Shot Video Facial Expression Recognition	ArXiv	2023	⭐️⭐️	PyTorch
Towards affective computing that works for everyone	ACII	2023	⭐️⭐️⭐️	None
Emotional Listener Portrait: Realistic Listener Motion Simulation in Conversation	ICCV	2023	⭐️⭐️	None
Affective Image Filter: Reflecting Emotions from Text to Images	ICCV	2023	⭐️⭐️	None
Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Erasing Network	CVPR	2023	⭐️	PyTorch
Learning Emotion Representations from Verbal and Nonverbal Communication	CVPR	2023	⭐️⭐️	GitHub
Multivariate, Multi-frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognition in Conversation	CVPR	2023	⭐️	N/A
How you feelin’? Learning Emotions and Mental States in Movie Scenes	CVPR	2023	⭐️⭐️⭐️	Project
Decoupled Multimodal Distilling for Emotion Recognition	CVPR	2023	⭐️⭐️⭐️	PyTorch
Context De-confounded Emotion Recognition	CVPR	2023	⭐️⭐️	PyTorch
More is Better: A Database for Spontaneous Micro-Expression with High Frame Rates	ArXiv	2023	⭐️	N/A
Pre-training strategies and datasets for facial representation learning	ECCV	2022	⭐️⭐️⭐️	PyTorch
Multi-Dimensional, Nuanced and Subjective – Measuring the Perception of Facial Expressions	CVPR	2022	⭐️⭐️⭐️	N/A
General Facial Representation Learning in a Visual-Linguistic Manner	CVPR	2022	⭐️⭐️	PyTorch
Robust Egocentric Photo-realistic Facial Expression Transfer for Virtual Reality	CVPR	2022	⭐️⭐️⭐️	N/A
Fair Contrastive Learning for Facial Attribute Classification	CVPR	2022	⭐️⭐️	PyTorch
Quantified Facial Expressiveness for Affective Behavior Analytics	WACV	2022	⭐️	N/A
Deep facial expression recognition: A survey	IEEE TAC	2020	🏆	N/A
iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis	CVPR	2021	⭐️	Data
Emotions as overlapping causal networks of emotion components: Implications and methodological approaches	Emotion Review	2021	⭐️	N/A
Hidden Emotion Detection using Multi-modal Signals	CHI	2021	⭐️⭐️	Data
Latent to Latent: A Learned Mapper for Identity Preserving Editing of Multiple Face Attributes in StyleGAN-generated Images	WACV	2021	⭐️	PyTorch
FaceForensics++: Learning to Detect Manipulated Facial Images	ArXiv	2018	⭐️⭐️⭐️	Site
Graph-Structured Referring Expression Reasoning in The Wild	CVPR	2020	⭐️	PyTorch
EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege’s Principle	CVPR	2020	⭐️	Site
Learning Visual Emotion Representations from Web Data	CVPR	2020	⭐️	Site
Computational Models of Emotion Inference in Theory of Mind: A Review and Roadmap	Topics in cognitive science	2019	⭐️⭐️⭐️	N/A
Putting feelings into words: Affect labeling as implicit emotion regulation	Emotion Review	2018	⭐️⭐️⭐️	N/A
Affective cognition: Exploring lay theories of emotion	Cognition (ELSEVIER)	2015	⭐️⭐️⭐️	N/A
Facial Expression Recognition: A Survey	Procedia Computer Science (ELSEVIER)	2015	⭐️⭐️	N/A
Norms of valence, arousal, and dominance for 13,915 English lemmas	Behavior Research Methods	2013	⭐️⭐️	N/A
Facial expression and emotion	American Psychologist	1993	🏆	N/A
Understanding face recognition	British journal of psychology	1986	🏆	N/A
A circumplex model of affect	Journal of Personality and Social Psychology	1980	🏆	N/A

Datasets back-to-top

Name	Venue	Year	Impact	Site
FindingEmo: An Image Dataset for Emotion Recognition in the Wild	ArXiv	2024	⭐️⭐️	N/A
VEATIC: Video-based Emotion and Affect Tracking in Context Dataset	WACV	2024	⭐️	Project
EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributes	ICCV	2023	⭐️⭐️	Project
MimicME: A Large Scale Diverse 4D Database for Facial Expression Analysis	ECCV	2022	⭐️⭐️	Github
CelebV-HQ: A Large-Scale Video Facial Attributes Dataset	ECCV	2022	⭐️⭐️⭐️	Project GitHub Demo
FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videos	CVPR	2022	⭐️⭐️⭐️	Data
MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wild	ACM MM	2022	⭐️	Site
Aff-wild2: Extending the aff-wild database for affect recognition	ArXiv	2018	⭐️⭐️	Project
Aff-wild: valence and arousal 'In-the-Wild' challenge	CVPRW	2017	⭐️⭐️	Project

Challenges back-to-top

Name	Venue	Year	Site
Facial Expression Recognition and Analysis Challenge	FG	2015	Site
Emotion Recognition in the Wild Challenge (EmotiW)	ICMI	2013-2018	Site
Emotion Recognition in the Wild Challenge (EmotiW)	ICMI	2023	Site
Affect Recognition in-the-wild: Uni/Multi-Modal Analysis & VA-AU-Expression Challenges	FG	2020	Site
Affective Behavior Analysis In-the-Wild (1st)	FG	2020	Site
Deepfake Detection Challenge	-	2020	Site Paper GitHub
Affective Behavior Analysis In-the-Wild (2nd)	ICCV	2021	Site Paper
Affective Behavior Analysis In-the-Wild (3rd)	CVPR	2022	Site Paper
Affective Behavior Analysis In-the-Wild (4th)	ECCV	2022	Site
The Multimodal Sentiment Analysis Challenge (MuSe)	ACM MM	2022	Site Paper
Affective Behavior Analysis In-the-Wild (5th)	CVPR	2023	Site
Emotionally And Culturally Intelligent AI (1st)	ICCV	2023	Site
Affective Behavior Analysis in-the-wild (6th)	CVPR	2024	Site
Affective Behavior Analysis in-the-wild (7th)	ECCV	2024	Site
1M-Deepfakes Detection Challenge	ACM MM	2024	Paper Site

Tools back-to-top

Name	Paper(/Feature)	Site
FLAME	Learning a model of facial shape and expression from 4D scans	Project TensorFlow PyTorch
FaceNet	Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks	PyTorch TensorFlow
Landmark detection	-	PyTorch
Age estimation	-
DataGen	APIs all about human faces and bodies	Web

Remarkable Papers (2019~) back-to-top

Paper	Venue	Year	Impact	Code
A Compact Embedding for Facial Expression Similarity	CVPR	2019	⭐️⭐️⭐️	PyTorch
A Personalized Affective Memory Model for Improving Emotion Recognition	ICML	2019	⭐️⭐️	TensorFlow
Facial Expression Recognition via Relation-based Conditional Generative Adversarial Network	ICMI	2019	⭐️	N/A
Facial Expression Recognition by De-expression Residue Learning	CVPR	2018	⭐️⭐️	N/A
Joint pose and expression modeling for facial expression recognition	CVPR	2018	⭐️⭐️	TensorFlow
Identity-Aware Convolutional Neural Network for Facial Expression Recognition	FG	2017	⭐️⭐️⭐️	N/A
Facenet2expnet: Regularizing a deep face recognition net for expression recognition	FG	2017	⭐️⭐️	N/A
Facial expression recognition from near-infrared videos	Image and Vision Computing (ELSEVIER)	2011	⭐️	N/A
Facial expression decomposition	ICCV	2003	🏆	N/A