Action Quality Assessment aims at evaluating and quantifying the overall performance or proficiency of human actions based on the analysis of video or motion data.
In this reprository, interetsting papers in AQA are collected to show the development of the AQA community. Moreover, some papers about similar tasks and datasets are listed.
- A series of works focus on collecting new data to facilitate other branch of research in this field.
- Brand new datasets: CPR-Coach(CVPR-24), Ego-Exo4D(CVPR-24), EgoExoLearn(CVPR-24), EgoExo-Fitness(ECCV-24)
- Expand existing datasets: FineDiving++(IJCV-24), NAE(CVPR-24), FineParser(CVPR-24)
- A few works start focusing on interpretable action assessment (not just predict scores / paired rankings).
- Two papers propose to address continual action assessment concurrently.
- More works start focusing on (online) error detection.
Check Benchmarks.md to get the performance tables on various popular AQA benchmarks.
- A Survey of Video-based Action Quality Assessment (INSAI 2022) [Paper]
- Interpretable Long-term Action Quality Assessment (BMVC 2024) [Paper] [Code]
- RICA2: Rubric-Informed, Calibrated Assessment of Actions (ECCV 2024) [Paper] [Project] [Code]
- MAGR: Manifold-Aligned Graph Regularization for Continual Action Quality Assessment (ECCV 2024) [Paper] [Code]
- Semi-Supervised Teacher-Reference-Student Architecture for Action Quality Assessment (ECCV 2024) [Paper]
- Procedure-Aware Action Quality Assessment: Datasets and Performance Evaluation (IJCV 2024) [Paper] [Code]
- Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distribution Modeling (TCSVT 2024) [Paper] [Code]
- CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction Alignment (IJCAI 2024) [Paper] [Code]
- FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessment (CVPR 2024 Oral) [Paper] [Code]
- Narrative Action Evaluation with Prompt-Guided Multimodal Interaction (CVPR 2024) [Paper] [Code]
- CPR-Coach: Recognizing Composite Error Actions based on Single-class Training (CVPR 2024) [Paper] [Code]
- Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessment (CVPRW 2024) [Paper] [Code]
- Multimodal Action Quality Assessment (TIP 2024) [Paper] [Code]
- Fine-Grained Spatio-Temporal Parsing Network for Action Quality Assessment (TIP 2023) [Paper]
- PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment (WACV 2023 Oral) [Paper] [Code]
- Learning Semantics-Guided Representations for Scoring Figure Skating (TMM 2023) [Paper]
- A Figure Skating Jumping Dataset for Replay-Guided Action Quality Assessment (ACM-MM 2023) [Paper]
- Localization-assisted Uncertainty Score Disentanglement Network for Action Quality Assessment (ACM-MM 2023) [Paper] [Code]
- SEDSkill: Surgical Events Driven Method for Skill Assessment from Thoracoscopic Surgical Videos (MICCAI 2023)[Paper] [Code]
- LOGO: A Long-Form Video Dataset for Group Action Quality Assessment (CVPR 2023) [Paper] [Code] [Citations]
- Herarchical Graph Convolutional Networks for Action Quality Assessment (TCSVT 2023) [Paper] [Code]
- Adaptive Stage-Aware Assessment Skill Transfer for Skill Determination (TMM 2023) [Paper]
- IRIS: Interpretable Rubric-Informed Segmentation for Action Quality Assessment (ACM-IUI 2023) [Paper]
- Skating-Mixer: Multimodal MLP for Scoring Figure Skating (AAAI 2023) [Paper]
- Automatic Modelling for Interactive Action Assessment (IJCV 2022) [Paper] [Citations]
- 3D-Yoga: A 3D Yoga Dataset for Visual-based Hierarchical Sports Action Analysis (ACCV 2022) [Paper]
- Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer (ArXiv 2022) [Paper]
- Action Quality Assessment with Temporal Parsing Transformer (ECCV 2022) [Paper] [Code] [Citations]
- Pairwise Contrastive Learning Network for Action Quality Assessment (ECCV 2022) [Paper] [Code]
- FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessment (CVPR 2022 Oral) [paper] [Code] [Citations]
- Likert Scoring with Grade Decoupling for Long-term Action Assessment (CVPR 2022)[Paper] [Code][Citations]
- Semi-Supervised Action Quality Assessment With Self-Supervised Segment Feature Recovery (TCSVT 2022)[Paper]
- Should I take a walk? Estimating Energy Expenditure from Video Data (CVPRW 2022)[Paper] [Code]
- Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment (ECCV 2022) [Paper] [Code][Citations]
- Uncertainty-Driven Action Quality Assessment (ArXiv 2022) [Paper]
- Surgical Skill Assessment via Video Semantic Aggregation (MICCAI 2022) [Paper][Code]
- Adaptive Action Assessment (TPAMI 2021) [Paper]
- EAGLE-Eye: Extreme-pose Action Grader using detaiL bird’s-Eye view (WACV 2021) [paper] [Code]
- Auto-Encoding Score Distribution Regression for Action Quality Assessmentt (ArXiv 2021)[Paper]
- TSA-Net: Tube Self-Attention Network for Action Quality Assessment (ACM-MM 2021 Oral) [Paper] [Code]
- AIFit: Automatic 3D Human-Interpretable Feedback Models for Fitness Training (CVPR 2021) [Paper] [Project] [Citations]
- Towards Unified Surgical Skill Assessment (CVPR 2021) [Paper] [Code]
- Group-aware Contrastive Regression for Action Quality Assessment (ICCV 2021) [Paper] [Code]
- Will You Ever Become Popular? Learning to Predict Virality of Dance Clips (TMC 2021) [Paper]
- Piano Skill Assessment (ArXiv 2021) [Paper]
- An Asymmetric Modeling for Action Assessment (ECCV 2020) [Paper]
- FALCONS: FAst Learner-grader for CONtorted poses in Sports (CVPRW 2020) [Paper]
- Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos (ACM-MM 2020) [Paper] [Code]
- Uncertainty-aware Score Distribution Learning for Action Quality Assessment (CVPR 2020) [Paper] [Code]
- Action Assessment by Joint Relation Graph (ICCV 2019 Oral) [Paper]
- Manipulation-skill Assessment from Videos with Spatial Attention Network (ICCVW 2019) [Paper]
- The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videos (CVPR 2019) [Paper] [Code]
- What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment (CVPR 2019) [Paper] [Code]
- Who’s Better? Who’s Best? Pairwise Deep Ranking for Skill Determination (CVPR 2018) [Paper]
- S3D: Stacking Segmental P3D for Action Quality Assessment (ICIP 2018) [Paper]
- End-To-End Learning for Action Quality Assessment (PCM 2018) [Paper]
- Am I a Baller? Basketball Performance Assessment from First-Person Videos (ICCV 2017) [Paper]
- Live Fitness Coaching as a Testbed for Situated Interaction (ArXiv 2024) [Paper] [Project]
- EgoExo-Fitness: Towards Egocentric and Exocentric Full-Body Action Understanding (ECCV 2024) [Paper] [Code]
- Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives (CVPR 2024) [Project] [Paper] [Citations] [Code]
- EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World (CVPR 2024) [Paper] [Code]
- FLAG3D: A 3D Fitness Activity Dataset with Language Instruction (CVPR 2023) [Project] [Paper] [Citations]
- Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities (CVPR 2022) [Project] [Paper] [Code] [Citations]
- Narrative Action Evaluation with Prompt-Guided Multimodal Interaction (CVPR 2024) [Paper] [Code]
- Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision (ArXiv 2024) [Paper] [Project] [Code]
- Find the Assembly Mistakes: Error Segmentation for Industrial Applications (ECCVW 2024) [Project] [Code]
- Differentiable Task Graph Learning: Procedural Activity Representation and Online Mistake Detection from Egocentric Videos (ArXiv 2024) [Paper] [Code]
- Error Detection in Egocentric Procedural Task Videos (CVPR 2024) [Paper] [Code]
- PREGO: online mistake detection in PRocedural EGOcentric videos (CVPR 2024) [Paper] [Code]
- IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Setting (WACV 2023) [Paper] [Code]
- Weakly-Supervised Action Segmentation and Unseen Error Detection in Anomalous Instructional Videos (ICCV 2023) [Project] [Paper]
- HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World (ICCV 2023) [Project] [Paper] [Citations] [Citations]
- CaptainCook4D: A dataset for understanding errors in procedural activities (ICMLW 2023) [Project] [Paper] [Code]
- Every Mistake Counts in Assembly (ArXiv 2023) [Paper] [Code]
- Learning Action Changes by Measuring Verb-Adverb Textual Relationships (CVPR 2023) [Paper] [Code] [Citations]