From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos

image

PWC
PWC
PWC

PWC
PWC

From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos
Yin Chen$^{†}$, Jia Li$^{β€ βˆ—}$, Shiguang Shan, Meng Wang, and Richang Hong

πŸ“° News

[2024.9.5] The fine-tuned checkpoints are available.

[2024.9.2] The code and pre-trained models are available.

[2024.8.28] The paper is accepted by IEEE Transactions on Affective Computing.

[2023.12.5] Code and pre-trained models will be released here.

πŸš€ Main Results

Dynamic Facial Expression Recognition

image image

Static Facial Expression Recognition

image

Visualization

image

Fine-tune with pre-trained weights

1、 Download the pre-trained weights from baidu drive or google drive or onedrive, and move it to the ckpts directory.

2、 Run the following command to fine-tune the model on the target dataset.

conda create -n s2d python=3.9
conda activate s2d
pip install -r requirements.txt
bash run.sh

πŸ“‹ Reported Results and Fine-tuned Weights

The fine-tuned checkpoints can be downloaded from baidu driver or huggingface.

[![Star History Chart](https://api.star-history.com/svg?repos=MSA-LMC/S2D&type=Date)](https://star-history.com/#MSA-LMC/S2D&Date)
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support