← Back to NASA Technology Projects

Non-Parametric, Closed-Loop Testing of Autonomy in Unmanned Aircraft Systems

Completed TRL 6 (started at 3, targeting 6)

Description

The proposed Phase II program aims to develop new methods to support safety testing for integration of Unmanned Aircraft Systems into the National Airspace (NAS) with a particular focus on testing the collision avoidance (CA) algorithms of a UAS Sense-and-Avoid (SAA) system. This research addresses the fundamental difficulty of verifying the performance of autonomous systems that dynamically react to the environment. In particular, this research program would develop novel methods for conducting non-parametric, closed-loop simulation testing of collision avoidance algorithms as well as other autonomous operations. The technology generates a campaign of simulation experiments that automatically adapt to the algorithms in question. The purpose of this innovation is to expose potential vulnerabilities in UAS autonomy that are generated through the interaction of autonomous UAS algorithms with other agents such as an intruding aircraft operating under ``right of way rules". This work augments both the probabilistic open-loop testing methods, where agents do not react, and closed-loop testing where agent behavior is fixed a priori.

Benefits

The immediate NASA application is safety analysis for the UAS Integration in the NAS program. In particular, this work would support the Separation Assurance/Sense and Avoid Interoperability (SSI) and Integrated Test and Evaluation (IT&E) subprograms within this effort through tools to improve the efficiency and effectiveness of fast-time and HITL simulation testing. In addition, this technology could be used to test autonomous algorithms within other domains at NASA, such as space exploration.

There is need to test and verify autonomous operations of unmanned aircraft in numerous domains. The Department of Defense has a deep need for testing complex (e.g., autonomous) systems where brute force testing methods are infeasible. This includes the US Air Force, where unmanned aircraft are increasingly ubiquitous, and Missile Defense Agency where Numerica is involved in parametric testing of the Ballistic Missile Defense System.

Details

Technology areaSoftware, Modeling, Simulation, and Information Processing > Software Development, Engineering, and Integrity > Testing and Evaluation
ProgramSmall Business Innovation Research/Small Business Tech Transfer (SBIR/STTR)
Lead organizationNumerica Corporation, Fort Collins, CO
Start date2015-05-14
End date2018-02-13

Project contacts

Listed on TechPort itself — the most direct way to ask about this specific project.

How to get involved

This is early/mid-stage (TRL 6) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.