Education Background
Sep. 2012 - Nov .2019 Precision Instrument and Machinery, Beihang University
Sep .2008 – Jul .2012 Measurement and Control Technology and Instruments, Hefei University of Technology
Work Experience
Jan .2024 - Present Associate Researcher, National Research Center for Information Science and Technology, Tsinghua University
Jan. 2022 – Jan. 2024 Assistant Researcher, National Research Center for Information Science and Technology, Tsinghua University
Dec. 2019 - Dec .2021 Postdoctoral Fellow, Department of Automation, Tsinghua University
Jun. 2017 - Sep .2017 Research Assistant, University of Southern California
Oct .2017 - Dec .2019 Research Assistant, Tsinghua University
Academic Affiliations
Aug.2024 – Sep.2025 Committee Member of the Organizing Committee of International Workshop on Multimedia Signal Processing 2025
Jun. 2024 – Mar.2025 Area Chair of International Conference on 3D Vision 2025
Dec.2023 - Present Committee Member of the Organizing Committee of China Metaverse Conference
Professional Affiliations
Vice Secretary - Chinese Association for Artificial Intelligence
Research Areas
(1)3D Vision
(2)Motion Capture
(3)Depth Sensing
Research Overview
I mainly conduct cutting - edge research in the field of 3D vision. I focus on the reconstruction of light fields/radiance fields in different scale scenarios from the microscopic to the macroscopic, as well as the fine - grained motion capture and behavior analysis of various objects, ranging from humans (for digital content creation and the metaverse) to animals (for computational behavior research). The relevant research results have been licensed to several well - known companies and applied in industrial products.
Awards and Honors
The Second Prize of the Wu Wenjun Artificial Intelligence Science and Technology Progress Award in 2022
Academic Achievements
(1)Published Papers:
[1] Yitong Jin#; Zhiping Qiu#; Yi Shi; Shuangpeng Sun; Chongwu Wang; Donghao Pan; Jiachen Zhao; Zhenghao Liang; Yuan Wang; Xiaobing Li; Feng Yu; Tao Yu* and Qionghai Dai*; Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture, ACM Transaction on Graphics (TOG) & SIGGRAPH 2024.
[2] Haoxiang Wang, Tao Yu*, Tianwei Yang, Hui Qiao* and Qionghai Dai; Neural Physical Simulation with Multi-Resolution Hash Grid Encoding. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024 Oral Presentation). 38, 6 (Mar. 2024), 5410-5418.
[3] Peng Li; Jiayin Zhao; Jingyao Wu; Chao Deng; Yuqi Han; Haoqian Wang* and Tao Yu*; OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE-TPAMI), 2023, 46(2): 681-694.
[4] Jiachen Zhao; Tao Yu*; Liang An; Yipeng Huang; Fang Deng; Qionghai Dai*; Triangulation Residual Loss for Data-efficient 3D Pose Estimation, Thirty-seventh Annual Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans.
[5] Tao Yu; Zerong Zheng; Kaiwen Guo; Pengpeng Liu; Qionghai Dai and Yebin Liu; Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors, 34th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021 Oral Presentation), Online Virtual Conference.
(2)Patents Granted:
[1] Methods, devices, equipment, and storage media for generating images.
[2] Methods and devices for generating computational holographic fields based on neural fields.
[3] Intelligent 3D reconstruction methods, devices, equipment, and media based on neural basis functions.
[4] Real - time human holographic reconstruction methods and devices based on multiple RGBD cameras.
[5] Multi - view human 3D reconstruction methods and systems based on encoding networks.
[6] Single - human 3D reconstruction methods based on implicit functions and human body templates.
Talent Development
The jointly guided undergraduates and graduate students won two national scholarships, two scholarships for future scholars (Tsinghua), and one talented teenager (Huawei).