Novel Methods for the Flexible Ultrasound System Utilizing Augmented Reality Just-In-Time Procedural Guidance

The proposed extension of the SBIR Phase II is aimed at extending the techniques, methodology and tools of the autonomous, closed-loop procedural guidance system, designated as VULCAN (Visual Ultrasound Learning Control and Analysis Network), developed for the Flexible Ultrasound System (FUS) developed by GE for NASA’s Exploration Medical Capability group. The work done during Phase I and II focused on developing the core technology to enable 3-dimensional procedural guidance and ultrasound device control through a Microsoft HoloLens Augmented Reality (AR) interface. The system has been extended to enable some plug-n-play capabilities through dynamic connectivity to a standardized electronic procedure library (eProc or ProX) at NASA. A Deep Machine Learning (DML) application monitors procedural execution, providing closed-loop performance feedback and driving users towards correct procedural execution and outcomes. We have demonstrated remote, secure connectivity to AMES’s “MEDICs” DML-based decision support tool that can receive and interpret ultrasound images generated by VULCAN and send back decision support results for display to the user in the HoloLens. The current solution is a digital platform which includes: • Augmented Reality enabled Electronic Medical Procedure toolset • Augmented Reality headset • Adaptive User Interface • Deep Machine Learning toolset for image analysis • Navigational Guidance system • Library of medical procedure with corresponding training material, patient specific medical and anatomical information We plan to test the effectiveness of using a specific ultrasound procedure, nephrolithiasis examination, and expand VULCAN’s autonomous support capability to devices/systems other than the FUS.

• VULCAN will be one of the medical tools for the Journey to Mars in the 2030s • Human/Robotic missions • ACT, Gateway, Deep Space Exploration

• DoD: Medical Training Simulators, JIT support • Commercial: medical device companies, ultrasound manufacturers

This is early/mid-stage (TRL 6) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.