A Stream Processing Engine Approach to Earth Science Data Processing, Phase I

Timely processing of raw Earth science data for calibration and validation in a highly distributed and networked environment, and its storage at Distributed Active Archive Centers (DAACs) for presentation to the global scientific community is critical in NASA's mission for Earth Sciences. Here we propose to develop a stream processing engine approach to earth science data processing. Our innovation is based leveraging the emerging stream processing engine technology. Traditionally stream processing applications have been built using customized DBMS., which tend to be costly, and hard to change by non-specialist end-users. Our proposed architecture offers several significant benefits. First, an SPE developed application enables the refinement of stream filtering, the rapid development of new stream filtering capability faster than any other database or middleware based solution using StreamSQL , thus improving the maintainability and adaptivity of the system especially by non-specialist end-users. Second, by design, SPE technology offers inherent fault tolerance against asynchronous data input with attendant drop-outs.

This is a mature technology (TRL 7+) — the realistic path in is usually NASA's Technology Transfer Program: licensing an existing NASA patent, or a Space Act Agreement to use NASA facilities/expertise directly. NASA also runs a startup licensing program with no upfront fee for companies formed to commercialize a specific NASA technology.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.