Augmented Reality Electronic Procedures Development and Deep Machine Learning Technology Integration

Augmented Reality (AR) & Deep Machine Learning (DML) are part of solution to support crew autonomy and surface operations at destinations with > 6 second time delay to ground. For an effective and sustainable operations, an integrated development for augmented reality must be available for the ops team to create and manage AR content quickly and easily. To achieve crew independence, DML has the potential to analyze a large number of problems such as medical image analysis, fault detection, or object identification. The approach is to embed DML based knowledge within eProc to provide autonomous guidance instruction cues to the crew. To integrate these two technologies (AR-eProc and DML) in order to provide the crew with both AR cues and expert guidance instruction during procedure execution.

This research is directly targeted to support Mission Operation community of Human Spaceflight programs. The technology is aimed to increase operation efficiency and to enable the operational team to create and manage augmented reality operational products including planning, execution and training on their own. The technology has potential to be adopted by organizations across many industries with complex and expensive maintenance tasks, requiring safety and accuracy. The proposed system can support the need to improve the development of advanced maintenance operating procedures. Industries include the aerospace maintenance services, Oil and Gas, military, and the automobile and heavy machinery industry.

This is early/mid-stage (TRL 5) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.