ATC Operations Analysis via Automatic Recognition of Clearances

Recent advances in airport surface surveillance have motivated the creation of new tools for analysis of Air Traffic Control (ATC) operations, such as the Surface Operations Data Analysis and Adaptation (SODAA) tool, which is being used by NASA to conduct airport ATC operations analysis. What is missing from ATC operations analysis, however, is accessible and reliable data regarding the clearances issued by the controller and other communication conducted with the pilot that influences the behavior seen in the surveillance data. The reliance on voice communication in ATC operations presents challenges to the researcher who is trying to obtain data and conduct detailed analyses of ATC operations. During the Phase I effort, we designed and developed a prototype system to perform automatic speech recognition (ASR) of ATC clearances. We demonstrated the feasibility of recognizing ATC clearances from speech audio data and associating the clearance data with the flight that is the subject of the clearance. In the Phase II effort, we will create a complete prototype of the ATC speech recognition, processing and analysis capability in SODAA. In addition, we will integrate ATC speech recognition capabilities into a real-time application in the Surface Management System (SMS).

The capability to perform automatic speech recognition of ATC clearances can provide commercial benefit to airlines in their efforts monitor airport operations and drive efficiencies into their operation. Mosaic ATM provides the surface management application that is being used operationally by UPS airline in Louisville, Kentucky. This speech recognition capability can be integrated into the UPS SMS system to improve data acquisition and prediction performance. Additionally, the automatic speech recognition capability of ATC clearances can be used in additional research and prototype capabilities for integration of Unmanned Aircraft Systems (UASs) into the National Airspace System (NAS). By using speech recognition and additional research, capabilities for UAS to autonomous react to ATC clearances may be possible.

Potential applications for the research results beyond Phase II include use by NASA for continued research of ATC operations and by the FAA. These applications include both off-line analysis applications and real-time applications. NASA and other aviation community researchers can use this data to analyze ATC operations and to measure workload associated with ATC communication. Analysis of conformance to clearances can also be assessed and analyzed. In real-time application, NASA can use the speech recognition of ATC clearances to improve the performance of the Surface Management System at the NASA NTX facility.

This is early/mid-stage (TRL 6) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.