Skip to content

Commit e38a8bd

Browse files
committed
re-org relevant papers
1 parent 6dd5f5d commit e38a8bd

File tree

9 files changed

+1450
-595
lines changed

9 files changed

+1450
-595
lines changed

README.md

Lines changed: 93 additions & 595 deletions
Large diffs are not rendered by default.

README_old.md

Lines changed: 652 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,41 @@
1+
## Co-speech Generation
2+
- [ICCV 2023] Continual Learning for Personalized Co-speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/ICCV2023/html/Ahuja_Continual_Learning_for_Personalized_Co-speech_Gesture_Generation_ICCV_2023_paper.html)
3+
*Chaitanya Ahuja, Pratik Joshi, Ryo Ishii, Louis-Philippe Morency*
4+
- [ICCV 2023] LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/ICCV2023/html/Zhi_LivelySpeaker_Towards_Semantic-Aware_Co-Speech_Gesture_Generation_ICCV_2023_paper.html)
5+
*Yihao Zhi, Xiaodong Cun, Xuelin Chen, Xi Shen, Wen Guo, Shaoli Huang, Shenghua Gao*
6+
- [CVPR 2023] QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/CVPR2023/html/Yang_QPGesture_Quantization-Based_and_Phase-Guided_Motion_Matching_for_Natural_Speech-Driven_Gesture_CVPR_2023_paper.html)
7+
*SiCheng Yang, Zhiyong Wu, Minglei Li, Zhensong Zhang, Lei Hao, Weihong Bao, Haolin Zhuang*
8+
- [CVPR 2023] Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/CVPR2023/html/Zhu_Taming_Diffusion_Models_for_Audio-Driven_Co-Speech_Gesture_Generation_CVPR_2023_paper.html)
9+
*Lingting Zhu, Xian Liu, Xuanyu Liu, Rui Qian, Ziwei Liu, Lequan Yu*
10+
- [CVPR 2023] Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglement.[[paper]](https://openaccess.thecvf.com/content/CVPR2023/html/Qi_Diverse_3D_Hand_Gesture_Prediction_From_Body_Dynamics_by_Bilateral_CVPR_2023_paper.html)
11+
*Xingqun Qi, Chen Liu, Muyi Sun, Lincheng Li, Changjie Fan, Xin Yu*
12+
- [CVPR 2023] Co-speech Gesture Synthesis by Reinforcement Learning with Contrastive Pre-trained Rewards.[[paper]](https://openaccess.thecvf.com/content/CVPR2023/html/Sun_Co-Speech_Gesture_Synthesis_by_Reinforcement_Learning_With_Contrastive_Pre-Trained_Rewards_CVPR_2023_paper.html)
13+
*Mingyang Sun, Mengchen Zhao, Yaqing Hou, Minglei Li, Huang Xu, Songcen Xu, Jianye HAO*
14+
- [ECCV 2022] BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis.[[paper]](https://www.ecva.net/papers/eccv_2022/papers_ECCV/html/296_ECCV_2022_paper.php)
15+
*Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng*
16+
- [ECCV 2022] Audio-Driven Stylized Gesture Generation with Flow-Based Model.[[paper]](https://www.ecva.net/papers/eccv_2022/papers_ECCV/html/3948_ECCV_2022_paper.php)
17+
*Sheng Ye, Yu-Hui Wen, Yanan Sun, Ying He, Ziyang Zhang, Yaoyuan Wang, Weihua He, Yong-Jin Liu*
18+
- [CVPR 2022] Audio-Driven Neural Gesture Reenactment With Video Motion Graphs.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Zhou_Audio-Driven_Neural_Gesture_Reenactment_With_Video_Motion_Graphs_CVPR_2022_paper.html)
19+
*Yang Zhou; Jimei Yang; Dingzeyu Li; Jun Saito; Deepali Aneja; Evangelos Kalogerakis*
20+
- [CVPR 2022] Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Liu_Learning_Hierarchical_Cross-Modal_Association_for_Co-Speech_Gesture_Generation_CVPR_2022_paper.html)
21+
*Xian Liu; Qianyi Wu; Hang Zhou; Yinghao Xu; Rui Qian; Xinyi Lin; Xiaowei Zhou; Wayne Wu; Bo Dai; Bolei Zhou*
22+
- [CVPR 2022] SEEG: Semantic Energized Co-Speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Liang_SEEG_Semantic_Energized_Co-Speech_Gesture_Generation_CVPR_2022_paper.html)
23+
*Yuanzhi Liang; Qianyu Feng; Linchao Zhu; Li Hu; Pan Pan; Yi Yang*
24+
- [CVPR 2022] Low-Resource Adaptation for Personalized Co-Speech Gesture Generation.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Ahuja_Low-Resource_Adaptation_for_Personalized_Co-Speech_Gesture_Generation_CVPR_2022_paper.html)
25+
*Chaitanya Ahuja; Dong Won Lee; Louis-Philippe Morency*
26+
- [ICCV 2021] Speech Drives Templates: Co-Speech Gesture Synthesis With Learned Templates.[[paper]](https://openaccess.thecvf.com/content/ICCV2021/html/Qian_Speech_Drives_Templates_Co-Speech_Gesture_Synthesis_With_Learned_Templates_ICCV_2021_paper.html)
27+
*Shenhan Qian; Zhi Tu; Yihao Zhi; Wen Liu; Shenghua Gao*
28+
- [ICCV 2021] Audio2Gestures: Generating Diverse Gestures From Speech Audio With Conditional Variational Autoencoders.[[paper]](https://openaccess.thecvf.com/content/ICCV2021/html/Li_Audio2Gestures_Generating_Diverse_Gestures_From_Speech_Audio_With_Conditional_Variational_ICCV_2021_paper.html)
29+
*Jing Li; Di Kang; Wenjie Pei; Xuefei Zhe; Ying Zhang; Zhenyu He; Linchao Bao*
30+
- [ACM MM 2021] Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning.[[paper]](https://arxiv.org/abs/2108.00262)
31+
*Uttaran Bhattacharya, Elizabeth Childs, Nicholas S Rewkowski, Dinesh Manocha*
32+
- [CVPR 2021] iMiGUE: An Identity-Free Video Dataset for Micro-Gesture Understanding and Emotion Analysis.[[paper]](https://openaccess.thecvf.com/content/CVPR2021/html/Liu_iMiGUE_An_Identity-Free_Video_Dataset_for_Micro-Gesture_Understanding_and_Emotion_CVPR_2021_paper.html)
33+
*Xin Liu, Henglin Shi, Haoyu Chen, Zitong Yu, Xiaobai Li, Guoying Zhao*
34+
- [CVPR 2021] Body2Hands: Learning To Infer 3D Hands From Conversational Gesture Body Dynamics. [[paper]](https://arxiv.org/abs/2007.12287)
35+
*Evonne Ng, Shiry Ginosar, Trevor Darrell, Hanbyul Joo*
36+
- [ECCV 2020] Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach. [[paper]](https://arxiv.org/pdf/2007.12553.pdf)
37+
*Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, and Louis-Philippe Morency*
38+
- [ICCV 2019] Talking With Hands 16.2M: A Large-Scale Dataset of Synchronized Body-Finger Motion and Audio for Conversational Motion Analysis and Synthesis. [[paper]]( http://openaccess.thecvf.com/content_ICCV_2019/papers/Lee_Talking_With_Hands_16.2M_A_Large-Scale_Dataset_of_Synchronized_Body-Finger_ICCV_2019_paper.pdf )
39+
*Gilwoo Lee, Zhiwei Deng, Shugao Ma, Takaaki Shiratori, Siddhartha S. Srinivasa, Yaser Sheikh*
40+
- [CVPR 2019] Learning Individual Styles of Conversational Gesture. [[paper]](http://openaccess.thecvf.com/content_CVPR_2019/papers/Ginosar_Learning_Individual_Styles_of_Conversational_Gesture_CVPR_2019_paper.pdf)
41+
*Shiry Ginosar, Amir Bar, Gefen Kohavi, Caroline Chan, Andrew Owens, Jitendra Malik*
Lines changed: 66 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,66 @@
1+
## Gesture Recognition
2+
- [ICCV 2023] Learning Robust Representations with Information Bottleneck and Memory Network for RGB-D-based Gesture Recognition.[[paper]](https://openaccess.thecvf.com/content/ICCV2023/html/Li_Learning_Robust_Representations_with_Information_Bottleneck_and_Memory_Network_for_ICCV_2023_paper.html)
3+
*Yunan Li, Huizhou Chen, Guanwen Feng, Qiguang Miao*
4+
- [ICCV 2023] Data-Free Class-Incremental Hand Gesture Recognition.[[paper]](https://openaccess.thecvf.com/content/ICCV2023/html/Aich_Data-Free_Class-Incremental_Hand_Gesture_Recognition_ICCV_2023_paper.html)
5+
*Shubhra Aich, Jesus Ruiz-Santaquiteria, Zhenyu Lu, Prachi Garg, K J Joseph, Alvaro Fernandez Garcia, Vineeth N Balasubramanian, Kenrick Kin, Chengde Wan, Necati Cihan Camgoz, Shugao Ma, Fernando De la Torre*
6+
- [BMVC 2022] Towards more efficient few-shot learning based human gesture recognition via dynamic vision sensors.[[paper]](https://bmvc2022.mpi-inf.mpg.de/0938.pdf)
7+
*Linglin Jing, Yifan Wang, Tailin Chen, Shirin Dora, Zhigang Ji, Hui Fang*
8+
- [BMVC 2022] Continuous Hand Gesture Recognition using Deep Coarse
9+
and Fine Hand Features.[[paper]](https://bmvc2022.mpi-inf.mpg.de/1055.pdf)
10+
*Hazem Wannous, Jean-Philippe Vandeborre*
11+
- [CVPR 2022] LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Liu_LD-ConGR_A_Large_RGB-D_Video_Dataset_for_Long-Distance_Continuous_Gesture_CVPR_2022_paper.html)
12+
*Dan Liu; Libo Zhang; Yanjun Wu*
13+
- [AAAI 2022] Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders.[[paper]](https://openaccess.thecvf.com/content/CVPR2022/html/Ahuja_Low-Resource_Adaptation_for_Personalized_Co-Speech_Gesture_Generation_CVPR_2022_paper.html)
14+
*Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera*
15+
- [ICCV 2021] YouRefIt: Embodied Reference Understanding With Language and Gesture.[[paper]](https://openaccess.thecvf.com/content/ICCV2021/html/Chen_YouRefIt_Embodied_Reference_Understanding_With_Language_and_Gesture_ICCV_2021_paper.html)
16+
*Yixin Chen; Qing Li; Deqian Kong; Yik Lun Kei; Song-Chun Zhu; Tao Gao; Yixin Zhu; Siyuan Huang*
17+
- [AAAI 2021] Regional Attention with Architecture-Rebuilt 3D Network for RGB-D Gesture Recognition.[[paper]](https://arxiv.org/pdf/2102.05348.pdf)
18+
*Benjia Zhou, Yunan Li, Jun Wan*
19+
- [WACV 2021] Whose hand is this? Person Identification from Egocentric Hand Gestures.[[paper]](https://arxiv.org/abs/2011.08900)
20+
*Satoshi Tsutsui; Yanwei Fu; David Crandall*
21+
- [ACM MM 2020] Recognizing Camera Wearer from Hand Gestures in Egocentric Videos.[[paper]](http://www.cse.iitd.ac.in/~chetan/papers/daksh-mm-2020.pdf)
22+
*Thapar, Daksh, Aditya Nigam, and Chetan Arora*
23+
- [FG 2020] Feature Selection for Zero-Shot Gesture Recognition. [[paper]](https://www.computer.org/csdl/proceedings-article/fg/2020/307900a309/1kecI8r1WXC)
24+
*Naveen Madapana, Juan Wachs*
25+
- [FG 2020] Image-Based Pose Representation for Action Recognition and Hand Gesture Recognition. [[paper]]()
26+
*Zeyi Lin, Wei Zhang, Xiaoming Deng, Cuixia Ma, Hongan Wang*
27+
- [ECCV 2020] Collaborative Learning of Gesture Recognition and 3D Hand Pose Estimation with Multi-Order Feature Analysis.[[paper]](http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123480766.pdf)
28+
*Yang, Siyuan, Jun Liu, Shijian Lu, Meng Hwa Er, and Alex C. Kot.*
29+
- [ECCV 2020] Towards Efficient Coarse-to-Fine Networks for Action and Gesture Recognition.[[paper]](https://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123750035.pdf)
30+
*Quader, Niamul, Juwei Lu, Peng Dai, and Wei Li*
31+
- [CVPR 2020] Decoupled Representation Learning for Skeleton-Based Gesture Recognition.[[paper]](<http://openaccess.thecvf.com/content_CVPR_2020/papers/Liu_Decoupled_Representation_Learning_for_Skeleton-Based_Gesture_Recognition_CVPR_2020_paper.pdf>)
32+
*Jianbo Liu, Yongcheng Liu, Ying Wang, Véronique Prinet, Shiming Xiang, Chunhong Pan*
33+
- [CVPR 2020] An Efficient PointLSTM for Point Clouds Based Gesture Recognition.[[paper]](<http://openaccess.thecvf.com/content_CVPR_2020/papers/Min_An_Efficient_PointLSTM_for_Point_Clouds_Based_Gesture_Recognition_CVPR_2020_paper.pdf>)
34+
*Yuecong Min, Yanxiao Zhang, Xiujuan Chai, Xilin Chen*
35+
- [CVPR 2020] Music Gesture for Visual Sound Separation. [[paper]](<https://arxiv.org/pdf/2004.09476.pdf>)
36+
*Chuang Gan, Deng Huang, Hang Zhao, Joshua B. Tenenbaum, Antonio Torralba*
37+
- [ICCV 2019] Drive&Act: A Multi-Modal Dataset for Fine-Grained Driver Behavior Recognition in Autonomous Vehicles. [[paper]]( http://openaccess.thecvf.com/content_ICCV_2019/html/Martin_DriveAct_A_Multi-Modal_Dataset_for_Fine-Grained_Driver_Behavior_Recognition_in_ICCV_2019_paper.html )
38+
*Manuel Martin, Alina Roitberg, Monica Haurilet, Matthias Horne, Simon Reiss, Michael Voit, Rainer Stiefelhagen*
39+
- [CVPR 2019] Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition With Multimodal Training. [[paper]](<http://openaccess.thecvf.com/content_CVPR_2019/papers/Abavisani_Improving_the_Performance_of_Unimodal_Dynamic_Hand-Gesture_Recognition_With_Multimodal_CVPR_2019_paper.pdf>)
40+
*Mahdi Abavisani, Hamid Reza Vaezi Joze, Vishal M. Patel*
41+
- [CVPR 2019] A Neural Network Based on SPD Manifold Learning for Skeleton-Based Hand Gesture Recognition. [[paper]](http://openaccess.thecvf.com/content_CVPR_2019/papers/Nguyen_A_Neural_Network_Based_on_SPD_Manifold_Learning_for_Skeleton-Based_CVPR_2019_paper.pdf)
42+
*Xuan Son Nguyen, Luc Brun, Olivier Lezoray, Sebastien Bougleux*
43+
- [BMVC 2019] Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attention. [[paper]](https://bmvc2019.org/wp-content/uploads/papers/0281-paper.pdf)
44+
*Yuxiao Chen, Long Zhao, Xi Peng, Jianbo Yuan, Dimitris Metaxas*
45+
- [BMVC 2019] FlickerNet: Adaptive 3D Gesture Recognition from Sparse Point Clouds.[[paper]](https://bmvc2019.org/wp-content/uploads/papers/0326-paper.pdf)
46+
*Yuecong Min, Xiujuan Chai, Lei Zhao, Xilin Chen*
47+
- [WACV 2019] Space-time Event Clouds for Gesture Recognition: from RGB Cameras to Event Cameras. [[paper]](https://cse.buffalo.edu/~jsyuan/papers/2019/WACV_2019_Qinyi.pdf)
48+
*Qinyi Wang, Yexin Zhang, Junsong Yuan, Yilong Lu*
49+
- [WACV 2019] Hidden States Exploration for 3D Skeleton-Based Gesture Recognition. [[paper]](http://jultika.oulu.fi/files/nbnfi-fe2019072923218.pdf)
50+
*Xin Liu, Henglin Shi, Xiaopeng Hong, Haoyu Chen, Dacheng Tao, Guoying Zhao*
51+
- [CVPR 2018] Gesture Recognition: Focus on the Hands. [[paper]](http://openaccess.thecvf.com/content_cvpr_2018/papers/Narayana_Gesture_Recognition_Focus_CVPR_2018_paper.pdf)
52+
*Pradyumna Narayana, Ross Beveridge, Bruce A. Draper*
53+
- [CVPR 2018] Making Convolutional Networks Recurrent for Visual Sequence Learning. [[paper]](<http://openaccess.thecvf.com/content_cvpr_2018/papers/Yang_Making_Convolutional_Networks_CVPR_2018_paper.pdf>)
54+
*Xiaodong Yang, Pavlo Molchanov, Jan Kautz*
55+
- [ECCV 2018] Deformable Pose Traversal Convolution for 3D Action and Gesture Recognition. [[paper]](http://openaccess.thecvf.com/content_ECCV_2018/papers/Junwu_Weng_Deformable_Pose_Traversal_ECCV_2018_paper.pdf)
56+
*Junwu Weng, Mengyuan Liu, Xudong Jiang, Junsong Yuan*
57+
- [BMVC 2018] Point Attention Network for Gesture Recognition Using Point Cloud Data. [[paper]](http://bmvc2018.org/contents/papers/0427.pdf)
58+
*Cherdsak Kingkan, Joshua Owoyemi, Koichi Hashimoto*
59+
- [CVPR 2017] Personalizing Gesture Recognition Using Hierarchical Bayesian Neural Networks. [[paper]](http://openaccess.thecvf.com/content_cvpr_2017/papers/Joshi_Personalizing_Gesture_Recognition_CVPR_2017_paper.pdf)
60+
*Ajjen Joshi, Soumya Ghosh, Margrit Betke, Stan Sclaroff, Hanspeter Pfister*
61+
- [CVPR 2017] A Low Power, Fully Event-Based Gesture Recognition System. [[paper]](http://openaccess.thecvf.com/content_cvpr_2017/papers/Amir_A_Low_Power_CVPR_2017_paper.pdf)
62+
*Arnon Amir, Brian Taba, David Berg, Timothy Melano, Jeffrey McKinstry, Carmelo Di Nolfo, Tapan Nayak, Alexander Andreopoulos, Guillaume Garreau, Marcela Mendoza, Jeff Kusnitz, Michael Debole, Steve Esser, Tobi Delbruck, Myron Flickner, Dharmendra Modha*
63+
- [ICCV 2017] Egocentric Gesture Recognition Using Recurrent 3D Convolutional Neural Networks With Spatiotemporal Transformer Modules. [[paper]](http://openaccess.thecvf.com/content_ICCV_2017/papers/Cao_Egocentric_Gesture_Recognition_ICCV_2017_paper.pdf)
64+
*Congqi Cao, Yifan Zhang, Yi Wu, Hanqing Lu, Jian Cheng*
65+
- [CVPR 2016] Online Detection and Classification of Dynamic Hand Gestures With Recurrent 3D Convolutional Neural Network. [[paper]](http://openaccess.thecvf.com/content_cvpr_2016/papers/Molchanov_Online_Detection_and_CVPR_2016_paper.pdf)
66+
*Pavlo Molchanov, Xiaodong Yang, Shalini Gupta, Kihwan Kim, Stephen Tyree, Jan Kautz*
Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
- [ACM MM 2021] Towards Fast and High-Quality Sign Language Production.[[paper]](https://dl.acm.org/doi/10.1145/3474085.3475463)
2+
*Wencan Huang, Wenwen Pan, Zhou Zhao, Qi Tian*
3+
- [CVPR 2021] Model-Aware Gesture-to-Gesture Translation.[[paper]](https://openaccess.thecvf.com/content/CVPR2021/html/Hu_Model-Aware_Gesture-to-Gesture_Translation_CVPR_2021_paper.html)
4+
*Hezhen Hu, Weilun Wang, Wengang Zhou, Weichao Zhao, Houqiang Li*
5+
- [ECCV 2020] Progressive Transformers for End-to-End Sign Language Production.[[paper](https://arxiv.org/pdf/2004.14874.pdf)]
6+
*Ben Saunders, Necati Cihan Camgoz, and Richard Bowden*
7+
- [WACV 2020] Neural Sign Language Synthesis: Words Are Our Glosses. [[paper]](<http://openaccess.thecvf.com/content_WACV_2020/papers/Zelinka_Neural_Sign_Language_Synthesis_Words_Are_Our_Glosses_WACV_2020_paper.pdf>)
8+
*Jan Zelinka, Jakub Kanis*
9+
- [BMVC 2018] Sign Language Production using Neural Machine Translation and Generative Adversarial Networks. [[paper]](http://bmvc2018.org/contents/papers/0906.pdf)
10+
*Stephanie M Stoll, Necati Cihan Camgoz, Simon Hadfield, Richard Bowden*

0 commit comments

Comments
 (0)