Healthcare and Augmented Reality

The Cleveland Clinic Foundation is always on the lookout for new technology to help with patient care. Recently, they started exploring the idea of using augmented reality (AR) devices to monitor patient health.

The HoloLens was one of the first devices we explored.

As it became available, we worked with the Magic Leap ML1.

Context

Capturing objective, quantitative data about patient health is extremely important for devising a care plan. Augmented reality devices like the Microsoft HoloLens and Magic Leap ML1 have sensors that can help collect this data.

Parkinson’s disease (PD), a disorder that affects movement, was the first disorder we explored.

One method doctors use to measure tremor is by asking the patient to hold their hand as steady as possible and then rating them on a scale.

My Role

I was tasked with designing and developing an application that could run on AR devices to collect patient data.


Design Process

Measuring upper and lower extremity function was a priority for this project. I designed software for AR devices that can measure walking speed, balance, manual dexterity, and tremor.


How Success is Measured

The data produced by this software is being compared to established measures, including data generated with a full motion capture system.

A motion capture lab is being used to validate the data from the AR device.

Final Result

The AR software is currently being used in a research study to collect data on patient tremor, movement speed, and balance.

No real patients are depicted in any of the above photos. Stock photography from Shutterstock.com.