|
Hi, I'm Erwin! I am an Associate Professor in the Department of Computer Science at Institute of Science Tokyo (Former TokyoTech). I also serve as a Advisory Researcher at Shanda AI Research Tokyo. Before that, I served as a Senior Researcher at Huawei Research Japan, a Visiting Professor at Carniege Mello University, a Guest Researcher at Keio Media Design, and a Research Fellow at Sony CSL. I obtained my Ph.D. at Institute of Science Tokyo, advised by Prof. Hideki Koike. And I've received my Bachelor in Computer Science (with honor, top 10%) at Shanghai Jiao Tong University. My research interest lies in the field of Human-Computer Interaction, Machine Learning, and 3D Vision. My primary works include pose prediction for sports training, 3D body/hand pose estimation, and VR/AR visualizations for skill acquisition. Email / CV / Google Scholar / Linkedin |
News |
| 2025.09 | One paper is accepted to NeurIPS 2025, see you in San Diego! |
| 2025.08 | Two E-tech Demos and one poster is accepted to Siggraph Asia 2025, congrats! |
| 2025.07 | One paper is accepted to ACM MM 2025, see you in Dublin! |
| 2025.06 | I joined the Department of Computer Science, Institute of Science Tokyo as an Associate Professor! |
| 2024.12 | One paper is accepted to CHI 2025, see you in Yokohama! |
| 2024.08 | One paper is accepted to UIST 2024, see you in Pittsburgh! |
| 2024.01 | One paper is accepted to WACV 2024, see you in Arizona! |
| 2023.12 | One paper is accepted to IEEE VR 2024, see you in Orlando! |
| 2023.08 | One paper is accepted to ISMAR 2023, see you in Sydney! |
| 2023.02 | Two papers are accepted to CHI 2023, see you in Hamburg! |
| 2022.11 | One paper is accepted to WACV 2023, see you in Hawaii! |
| 2022.09 | Defended my Ph.D. dissertation and obtained my Ph.D. degree! |
| 2022.02 | Two papers are accepted to AHs 2022, Congrats! |
| 2021.01 | One paper is accepted to IEEE VR 2021 TVCG Journal Track, Congrats! |
| 2020.08 | One paper is accepted to UIST 2020, Congrats! |
| 2019.09 | Honored to receive JSPS Gakushin DC1 Fellowship! |
| 2019.08 | One paper is accepted to UIST 2019, Congrats! |
| 2019.04 | Starting my internship at Sony Computer Science Laboratories (Sony CSL) |
| 2019.01 | One paper is accepted to WACV 2019, Congrats! |
| 2018.03 | Our Demo on VR Ski Coach received the Best Demo award at IEEE VR 2018, Congrats! |
Selected Research |
For a full list, please check my Google Scholar.
|
From Pose to Muscle: Multimodal Learning for Piano Hand Muscle Electromyography
Ruofan Liu, Yichen Peng, Takanori Oku, Chen-Chieh Liao, Erwin Wu, Shinichi Furuya, Hideki Koike NeurIPS, 2025 Project Page | Paper | Video |
|
SkiTechCoach: A Multimodal Alpine Skiing Dataset with 3D Body Pose, Sole Pressure, and Expert Coaching
Toshihiro Hirano, Yuki Tabei, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike ACM MM, 2025 Project Page | Paper | Video |
|
PiaMuscle: Improving Piano Skill Acquisition by Cost-effectively Estimating and Visualizing Activities of Miniature Hand Muscles
Ruofan Liu, Yichen Peng, Takanori Oku, Chen-Chieh Liao, Erwin Wu, Shinichi Furuya, Hideki Koike CHI, 2025 Project Page | Paper | Video |
|
ColorizeDiffusion: Improving Reference-Based Sketch Colorization with Latent Diffusion Model
Dingkun Yan, Liang Yuan, Erwin Wu, Yuma Nishioka, Issei Fujishiro, Suguru Saito WACV, 2025 Project Page | Paper |
|
Soleposer: Full body pose estimation using a single pair of insole sensor
Erwin Wu, Yichen Peng, Rawal Khirodkar, Hideki Koike, Kris Kitani UIST, 2024 Project Page | Paper | Video |
|
ARpenSki: Augmenting Ski Training with Direct and Indirect Postural Visualization
Takashi Matsumoto, Erwin Wu, Chen-Chieh Liao, Hideki Koike IEEE VR, 2024 Project Page | Paper | Video |
|
PianoSyncAR: enhancing piano learning through visualizing synchronized hand pose discrepancies in augmented reality
Ruofan Liu, Erwin Wu, Chen-Chieh Liao, Hayato Nishioka, Shinichi Furuya, Hideki Koike IEEE ISMAR, 2023 Project Page | Paper | Video |
|
OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional Camera
Hui-Shyong Yeo, Erwin Wu, Daehwa Kim, Juyoung Lee, Hyung-il Kim, Seo Young Oh, Luna Takagi, Woontack Woo, Hideki Koike, Aaron Quigley CHI, 2023 Project Page | Paper | Video |
|
Marker-removal Networks to Collect Precise 3D Hand Data for RGB-based Estimation and its Application in Piano
Erwin Wu, Hayato Nishioka, Shinichi Furuya, Hideki Koike WACV, 2023 Project Page | Paper | Video |
|
SPinPong - Virtual Reality Table Tennis Skill Acquisition using Visual, Haptic and Temporal Cues
Erwin Wu, Mitski Piekenbrock, Takuto Nakamura, Hideki Koike IEEE VR (TVCG Journal Track), 2021 Project Page | Paper | Video |
|
Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network
Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, Kris M. Kitani UIST, 2020 Project Page | Paper | Video |
|
FuturePong: Real-time Table Tennis Trajectory Forecasting using Pose Prediction Network
Erwin Wu, Hideki Koike CHI, 2020 Project Page | Paper | Video |
|
Opisthenar: Hand Poses and Finger Tapping Recognition by Observing Back of Hand Using Embedded Wrist Camera
Hui-Shyong Yeo, Erwin Wu, Juyoung Lee, Aaron Quigley, Hideki Koike UIST, 2019 Project Page | Paper | Video |
|
How to VizSki: Visualizing Captured Skier Motion in a VR Ski Training Simulator
Erwin Wu, Florian Perteneder, Takayuki Nozawa, Hideki Koike VRCAI 2019 (Best Paper Award), CVPR Workshop 2019 Project Page | Paper | Video |
|
FuturePose – Mixed Reality Martial Arts Training Using Real‐Time 3D Human Pose Forecasting With a RGB Camera
Erwin Wu, Hideki Koike WACV, 2019 Project Page | Paper | Video |
Miscellanea |
Awards |
AIP Network Director Award, 6th JST CREST AIP Challenge Program, 2022
Seiichi Tejima Research Award, Tokyo Institute of Technology, 2021 AIP Network Director Award, 6th JST CREST AIP Challenge Program, 2021 Graduation with Honor: Excellent Undergraduate Graduates, Shanghai Jiao Tong University, 2017 Outstanding Exchange Student of Study in Kyoto Program, Ritsumeikan University, 2016 Excellent International Student Award, Shanghai Jiao Tong University, 2015 |
Invited Talks |
Invited Talk about AIGC for Digital Human, Huawei Cloud, 2024 Invited Talk about BackHandPose at Miraikan, JSPS, 2022 Invited Talk about SolePoser, JST AIP Challenge, 2022 |
Academic Service |
Session Chair, CHI 2025, 2023; SIGGRAPH Asia 2023;
Poster Chair, MVA 2023, 2025; Area Chair, CHI 2025; Reviewer for Journal: TMM, TVCG, CVIU Reviewer for Conference: NeurIPS, CVPR, ICCV, ECCV, ACM MM, CHI, UIST, ISMAR, IEEE VR, SIGGRAPH |
Patent |
US Patent App. 63/089.139.
US Patent App. 68/084.140. (under review) JP Patent JP2022062672A JP Patent JP2022172499A |
|
This website use the awesome template from Jon Barron. |