← Back to NASA Technology Projects

An Optimality Metrics Reporting Toolkit for SMART NAS

Completed TRL 4 (started at 2, targeting 4)

Description

This SBIR project aims to develop a software module for the SMART NAS Test Bed (or another similar simulation environment) that allows an apples-to-apples comparison of system performance across scenarios and a comparison to a 'best possible' case. The module, named TOMO (Toolkit for Optimality Metrics Overlay), is a metrics toolkit for comparing SMART NAS simulation runs to the optimal decisions that should be made/should have been made relative to a selected metric to help compare the performance of the scenario being simulated to a best possible outcome, either in shadow-mode or in post-operations mode. The output from TOMO is not only a normalized metric, but the 4-D trajectories of all aircraft in an optimally-performing system. A key component to the success of any simulation environment is the quality of the metrics that it is able to report back to a user to allow informed decision-making. TOMO addresses the need to develop metrics that are comparable across scenarios by computing a 'baseline' for each scenario that represents the best that the system could perform given the operating constraints, weather, and demand. By normalizing metrics relative to this baseline, it allows for more direct comparisons across scenarios along multiple dimensions both in shadow mode and playback scenarios. When used in shadow mode, TOMO will identify the actions that should be taken to optimize for a given objective. In addition to computing the metrics, TOMO's output includes descriptive information on how the trajectories in the scenario being simulated differ from those in the optimal solution, and provides insight into how system performance may be improved.

Benefits

The core application of the work in this project will be to further NASA's goals to enable safe and efficient Trajectory-Based Operations, and to develop a decision-support capability to enable better decision making. SMART NAS will be the primary application of TOMO; we envision that TOMO can be plugged into SMART NAS as a module enabling metrics computation and comparison. TOMO will display its results on a convenient user interface, to allow SMART NAS users to readily make informed decisions. If successful, it is envisioned that TOMO will not only integrate with SMART NAS to enable scenario simulation and evaluation, but will also provide output on the optimal trajectories that will promote new learning and improved decisions. TOMO can also be used for post-operations evaluation of the existing system and be integrated with real-time data feeds such as SWIM to allow TOMO to be run in playback or shadow mode.

The FAA will have similar interest in TOMO as would NASA, by leveraging TOMO's powerful decision support capability. These simulation and experimental needs are shared by other non-NASA organizations, especially those who possess or are developing large-scale air transportation simulators. Those organizations include Embry Riddle Aeronautical University, MITRE-CAASD, and Volpe. Each of these organizations has a European counterpart with comparable roles and interests. Those organizations include EUROCONTROL, SESAR, and the Ecole Polytechnique. Furthermore, there are many foreign air navigation service providers (ANSP), who are the counterpart of the FAA, with burgeoning air traffic management systems that could benefit from decision support tools for better trajectory planning and understanding of the cost/benefit tradeoffs of flow management initiatives. In some respects, these are even more viable customers for our product than the FAA, because their air traffic management systems are less highly developed (in some cases, nascent) and, therefore, able to incorporate new subsystems. Countries with such ANSPs include South Africa, the Dominican Republic, Australia, and Colombia.

Details

Technology areaSoftware, Modeling, Simulation, and Information Processing > Software Development, Engineering, and Integrity > Testing and Evaluation
ProgramSmall Business Innovation Research/Small Business Tech Transfer (SBIR/STTR)
Lead organizationResilient Ops, Inc, Winchester, MA
Start date2016-05-01
End date2018-04-30

Project contacts

Listed on TechPort itself — the most direct way to ask about this specific project.

How to get involved

This is early/mid-stage (TRL 4) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.