← Back to NASA Technology Projects

Video Compression and Camera Control

Completed TRL 3 (started at 3, targeting 4)

Description

There are two major challenges to overcome with any space video application; limited bandwidth, and extreme environmental constraints. We aim to create a space rated video compression and camera control platform using the new H.265 High Efficiency Video Codec (HEVC) using the latest hardware available. This system will be able to provide twice the video compression when compared to the H.264 codec, which is the current standard. Additionally, it will be able to survive typical launch vehicle environments and handle single event radiation events.

Space rated imagery systems are a rarity, and none exist which utilize the latest imagery compression algorithms. Such a system is highly sought after in the space avionics industry due to the significant reduction in communication bandwidth. If a flexible and standardized platform that is focused on contextual imagery could be created, cost and integration time into a launch vehicle, lander, or other system requiring rugged video feed would be greatly reduced.

If fully funded, a prototype can be built and environmentally tested in a year. Starting in 2020, engineering development units could be created and tested while end users are identified and the platform is advertised and generally made known. We expect a significant Return on Investment (ROI) and future work being brought to MSFC regarding future imagery systems.

Benefits

Steady advancement in the manufacturing feature size of both Field Programmable Gate Arrays (FPGA’s) and microprocessors has enabled more computational power at equivalent energy consumption. The release of the H.265 encoding algorithm, created in 2014, ushered a surge of hardware and software products which utilize this codec. H.265 encodes video using half the bandwidth as its predecessor, H.264, at the cost of higher power consumption. At its release, H.265 wasn’t a problem for high-end and high-power processing systems, but only recently have products been available that can handle this video codec using a low power Reduced Instruction Set Computer (RISC) processor or FPGA.

H.265 offers tailoring to project needs. There are many parameters of an H.265 encoder that can be adjusted: frame rate, frame decimation, cropping, target bitrate, constant or variable bitrate, I frame and P frame variations. The H.265 encoder that we plan to use was developed by Xilinx. It can support up to eight 1080p30 video feeds, and can be tailored to one 8k30 video feed depending on the target application. The high efficiency of H.265 encoders has the capability to compress a 4K 24fps video stream (a cinema standard) from hundreds of Mbps to 10 Mbps without sacrificing video quality as perceived by the human eye. ES34 performed an extensive study on the quality of H.265 encoders. Highly specialized video equipment known as a Picture Quality Analyzer (PQA) was used to perform a quantitative analysis of encoded video from various encoders. We were able to confirm that H.265 is roughly twice as efficient as H.264.

While H.265 encoders are starting to become available in very high-end consumer products, the use of this advanced algorithm has not entered the realm of space flight hardware. An extensive market research trade study, performed by ES34, found no available space qualified H.265 COTS video encoders. Current SLS video systems use COTS components that were not designed with space flight in mind and required extensive modification to survive the extreme environments. The challenges have been overcome but at great cost to weight and elegance.

By building a video compressor and camera controller with space flight in mind, the system can be incredibly small, simple and elegant while at the same time greatly improving performance and power efficiency. The system will be built with standard flight environments in mind. The majority of our team, as defined in this proposal, is currently working on the SLS imagery system, the Flight-Imaging Launch-Monitoring Real-time System (FILMRS) and will leverage many environmental requirements of this program. The design goals of the project include:

With those design goals in mind the system can be implemented in a wide variety of uses including landers, launch vehicles, vehicle docking, external views of space stations, and post flight photogrammetry.

We plan to achieve a TRL4 for this platform by demonstrating a complete system in a laboratory environment and some testing in a relevant environment as defined by SLS EFILMRS program or another interested program. The demonstration would include real-time video compression performed by our system, and displayed on a monitor to show functionality. Video will also be tested using the PQA to provide a quantitative assessment of the compressed video using challenging imagery scenes. The results will be compared to a comparable H.264 encoding system to quantify improvements in bandwidth and quality over currently available systems.

Details

Technology areaRobotic Systems > Autonomous Rendezvous and Docking > Relative Navigation Sensors
ProgramCenter Independent Research & Development: MSFC IRAD (MSFC IRAD)
Lead organizationMarshall Space Flight Center, Huntsville, AL
Start date2018-10-01
End date2019-09-30

Project contacts

Listed on TechPort itself — the most direct way to ask about this specific project.

How to get involved

This is early/mid-stage (TRL 3) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.