Yufei Zhang - Homepage

About Me

I received my PhD from Rensselaer Polytechnic Institute, where I was supervised by Prof. Qiang Ji. Previously, I earned an MS in Music Acoustics and Signal Processing from the University of Rochester and a BE in Optoelectronics from Xi'an Jiaotong University.

My research integrates anatomical, biomechanical, and physical principles with probabilistic modeling to develop advanced computer vision systems for understanding human behavior.

My work primarily focuses on monocular 3D human reconstruction and extends to other human-centered problems, such as biometrics, activity recognition, motion forecasting, and motion synthesis.

Selected Publications

Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidance

Yufei Zhang, Jeffrey O. Kephart, Qiang Ji
ECCV, 2024
Paper | SupMat | Code

PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos

Yufei Zhang, Jeffrey O. Kephart, Zijun Cui, Qiang Ji
CVPR, 2024
Paper | SupMat | Code

Incorporating Physics Principles for Precise Human Motion Prediction

Yufei Zhang, Jeffrey O. Kephart, Qiang Ji
WACV, 2024
Paper | SupMat | Code

Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction

Yufei Zhang, Hanjing Wang, Jeffrey O. Kephart, Qiang Ji
ICCV, 2023
Paper | SupMat | Code

Robust Partial Fingerprint Recognition

Yufei Zhang, Rui Zhao, Ziyi Zhao, Naveen Ramakrishnan, Manoj Aggarwal, Gerard Medioni, Qiang Ji
CVPR Biometrics Workshop, 2023
Paper | SupMat

Projects and Experience

High-fidelity Hand Motion Generation and Retargeting
Research Scientist Intern at Meta Reality Labs, 2024 Summer
Mentor: Priyamvad Deshmukh.

Robust Biometrics Identification under Occlusion
Research Scientist Intern at Amazon One (AWS), 2022 Summer
Mentor: Rui Zhao, Ziyi Zhao.

Environment-driven Conceptual Learning
Research Assistant, Boston Fusion Company, 2023 Summer

Vision-based Automatic Surgery Performance Evaluation
Research Assistant, DEVCOM Army Research Laboratory, 2021.1-2021.12
Advisor: Prof. Qiang Ji, Prof. Suvranu De.

Audio Signal Processing & Music Information Retrieval
Research Assistant, Audio Information Research Lab, 2018.5-2018.9
Advisor: Prof. Zhiyao Duan.

Quantum Entanglement in Four-Wave Mixing
Undergraduate Research Assistant, Shaanxi Key Laboratory of Photonics Technology for Information, 2015.6-2016.1, 2016.6-2017.5
Advisor: Prof. Yanpeng Zhang.

Teaching

Rensselaer Polytechnic Institute: Computer Vision, Robotics I-II, Signal and Systems, General Psychology.

University of Rochester: Computer Audition, Digital Signal Processing.