Mobile VR Prosthetic Hand Training Platform

Bionic hands are transforming lives — and mobile VR is poised to make that transformation accessible to everyone. We built a platform towards bringing intuitive muscle-signal (EMG) based training directly to users, regardless of where they live or what rehabilitation resources are available nearby.

Surface EMG signals are decoded in real time to drive prosthetic hand control inside immersive, task-based virtual environments — targeting multi-joint movements and diverse grasp patterns that reflect real-world demands.

Platform

• Ecologically valid VR tasks designed around everyday prosthetic use cases
• Real-time performance telemetry enables multi-modal data capturing
• Mobile-first architecture aiming for deployment in rural clinics and resource-limited settings

Validation

• Verified with clinicians and participants with upper-limb loss across full training and assessment pipelines
• Testing for deployment in Glenrose Rehabilitation Hospital

Impact

As prosthetic hardware advances, rehabilitation access becomes the critical gap. This platform positions mobile VR as a scalable, clinical-grade training infrastructure — reaching patients where traditional rehabilitation cannot.

Collaboration: Aashka Desai, Shriram Raghu, Ahmed Shehata, Jacqueline Hebert, Patrick Pilarski.