← Back to NASA Technology Projects

Virtual Guidance Of Abdominal Trauma Using Augmented Reality

Completed TRL 2 (started at 1, targeting 2)

Description

Ultrasound is the only medical imaging modality on the International Space Station due to its size, power requirements and versatility in medical imaging. Unfortunately, ultrasound is a very operator dependent procedure and astronauts do not have time to train sufficiently before flight. Virtual Guidance, a type of just-in-time training, is a method used to facilitate autonomous operation of medical ultrasound by untrained astronauts with a real-time audio/video tutorial when distances from Earth render remote guidance impractical. Virtual Guidance, viewed through video glasses while actually scanning, has demonstrated successful imaging of the eye and carotid artery. This project improves on earlier successes by incorporating Augmented Reality in the form of 3D anatomy illustrations, thus improving the astronaut's situational awareness for the assessment of abdominal trauma. Untrained ultrasound operators will be recruited in the future to perform Focused Assessment with Sonography in Trauma (FAST) exams using only the Virtual Guidance audio/video tutorial. The quality of the resulting Images will be evaluated by an external expert. On the International Space Station, astronauts have to be guided through ultrasound studies by experts on the ground. This method is called remote guidance, and has been very successful with communication time delays of 2 seconds or less. On missions further from earth, remote guidance will not be possible. Virtual Guidance streams an audio video tutorial to the astronaut through video glasses actually while they are performing the ultrasound study. The tutorial includes step by step instructions in patient positioning, equipment use, how to hold the probe, scanning protocols and required images. For each required image, there is a photograph of the probe location, a representative ultrasound image from the site and audio instructions in how to achieve the view. In addition, there is a section for each required view that covers what can go wrong. This includes images from incorrect locations and how to improve the image to achieve the required results. Virtual guidance has demonstrated successful imaging of the eye and carotid artery. This project builds upon previous successes with Virtual Guidance by incorporating Augmented Reality, in the form of a 3-dimensional anatomical image, improving the astronaut's situational awareness. Untrained ultrasound operators will be recruited in the future to perform Focused Assessment with Sonography in Trauma (FAST) exams using only the Virtual Guidance audio/video tutorial. The quality of the resulting Images will be evaluated by an external expert.

Benefits

Time delays in communication for future missions beyond low Earth orbit will require astronauts to perform most duties autonomously. This would negate the timely exchange of information between the ground and space vehicle needed when an astronaut is attempting to perform a task he/she is unfamiliar with. Virtual Guidance could overcome this problem and help to ensure the health and wellbeing of astronauts on missions beyond low-Earth orbit by providing real time expertise to the crewmember without assistance from the ground. #Currently, there is no method to guide astronauts on exploration class missions through an ultrasound study and there is unlikely to be time to sufficiently train to use ultrasound before flight. Virtual Guidance will address that need. Ultrasound is only medical imaging equipment on the International Space Station and given the size and power requirement of other modalities, ultrasound is likely to be the only medical imaging equipement on future missions. The product of this activity was to develop a system that allows ultrasound operators autonomous acquisition of a FAST ultrasound exam. The resulting product will not require significant alterations to be flight-ready.

Details

Technology areaHuman Health, Life Support, and Habitation Systems > Human Health and Performance > Medical Diagnosis and Prognosis
ProgramCenter Innovation Fund: JSC CIF (JSC CIF)
Lead organizationJohnson Space Center, Houston, TX
Start date2012-10-01
End date2013-09-30

Project contacts

Listed on TechPort itself — the most direct way to ask about this specific project.

How to get involved

This is early/mid-stage (TRL 2) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.