Augmented Reality in Healthcare

I developed data collection tools for a research project using a Microsoft HoloLens and Magic Leap ML1.


Company

Cleveland Clinic

Role

Development

Date

March 2021

Tools

C#, Unity


Augmented Reality in Healthcare

I designed and developed an application for Microsoft HoloLens and Magic Leap ML1, focusing on leveraging augmented reality to enhance patient assessments. The application presents visual cues prompting patients to perform specific tasks, such as pinching their fingers together repeatedly and pointing at different boxes on the screen. These tasks are designed to measure how quickly and accurately patients can perform them, providing valuable data for evaluating movement disorders.

This application is particularly useful for patients with conditions like Parkinson's disease, as it helps identify challenges such as "freezing" during movement. By calculating performance scores and establishing baselines for patient health, the app aids researchers and healthcare providers in monitoring and assessing the progression of movement disorders.

This project required a deep understanding of both augmented reality technology and healthcare needs, resulting in a tool that significantly contributes to patient care and research.


HoloLens
A screen recording of one of the HoloLens tests.
A demo of the AR software
A demo of the AR software
A demo of the AR software
The devices used in this study
The devices used in this study.
A demo of the AR software
The tests were performed in a motion capture lab with visual markers and high-speed cameras.
HoloLens
While developing these apps, my son was trying to figure out why his dad looked so weird.