We present work in progress on a tele-immersion system for telerehabilitation using real-time stereo vision and virtual environments. Stereo reconstruction is used to capture user’s 3D avatar in real time and project it into a shared virtual environment, enabling a patient and therapist to interact remotely. Captured data can also be used to analyze the movement and provide feedback to the patient as we present in a preliminary study of stepping-in-place task. Such tele-presence system could in the future allow patients to interact remotely with remote physical therapist and virtual environment while objectively tracking their performance.
Kurillo G, Koritnik T, Bajd T, Bajcsy R. Real-time 3D avatars for tele-rehabilitation in virtual reality. In: Westwood JD, Westwood SW, Felländer-Tsai L, Haluck RS, Hoffman HM, et al, Editors. Medicine Meets Virtual Reality 18 - NextMed. IOSPress; 2011. p. 290-296.