Photorealistic EVA Simulation and Analytics for Real-Time Digital Twin Environments

In XR simulations for digital twins and astronaut training, the need for accuracy and precision is critical. Environments on the Moon and Mars will prove unpredictable and challenging, especially given the requirements for greater autonomy and reduced reliance on Earth-based support due to communication delays. Training for such missions necessitates simulations that not only emulate these environments but also achieve hyper realistic fidelity. Given the limitations of current state-of-the-art real-time rendering in real-time game engines, the solution to this growing demand for realism resides in more advanced computational strategies, specifically the utilization of parallelization. For Phase II of our NASA STTR proposal, Buendea and University of Central Floridas will focus developing state-of-the-art parallelization techniques, combined with the latest advancements in hardware and software, which can significantly enhance the realism and efficiency of astronaut training in XR environments and digital twins.By leveraging parallel processing, real-time simulations in XR can achieve higher frame rates, more detailed environments, and real-time feedback, all of which are essential to crafting high-fidelity EVA training modules. In simulations for digital twins and XR astronaut training, the need for accuracy and precision is critical. Environments on the Moon and Mars will prove challenging, especially given the requirements for greater autonomy and reduced reliance on Earth-based support due to communication delays. Training for such missions requires simulations that not only emulate these environments but also achieve hyper realistic fidelity. Given the limitations of current rendering in real-time game engines, the solution to this growing demand for realism resides in more advanced strategies, specifically parallelization. For Phase II of our NASA STTR proposal, Buendea and University of Central Florida’s will focus developing state-of-the-art parallelization techniques, combined with the latest advancements in hardware and software, which can significantly enhance the realism and efficiency of astronaut training in XR environments and digital twins.  By leveraging parallel processing, real-time simulations in XR can achieve higher frame rates, more detailed environments, and real-time feedback.   1.Multi-GPU Rendering A proposed multi-GPU (mGPU) architecture, based on the latest Nvidia RTX series GPUs, will be developed for Phase II of the STTR which will aim to maximize the computational potential for use in digital twins and XR scenarios by enabling dedicated rendering for VR and Non-VR sequences in Unreal Engine 5. 2.Multi-GPU XR Wireless Streaming Solution A specialized system will be designed and developed to allow the direct transmission of mGPU rendering from the high powered multi-GPU machines to portable client PCs over WiFi.  3.AI-Powered Parallelization of Lunar and Mars Digital Twins Through Cloud-based Tenants We also seek to demonstrate parallelization over cloud-based tenants which perform processing of large environmental data sets and subsequently stream into real-time environments. For this, we proposing an AI-powered digital twin cloud-based architecture to develop a custom solution that will enable an initial demonstration of an upgradeable planetary digital twin of the Moon and 4.GPU-Driven Dynamic Environmental Weather Simulations Leveraging the GPU's computational capabilities, we will develop high-fidelity Martian weather and dust storm simulations that can be parallelized. They will be based on the best published simulation of Martian weather and specifically on the behavior of Martian dust and its attachment to solar panels and other surfaces.

  1.NASA Artemis Training Simulator  The continued development of training simulations to support Artemis astronaut training. 2.Digital Twin Simulation Test Bed  Using the development of the STTR to produce a highly accurate test bed for Lunar and Mars surface operations and conceptualization 3.Mission Control Video Game  The development of a video game that allows anyone to become an astronaut and envision what the future of human space exploration holds.   Hyper realistic visualization and XR training for a wide range of industries that require maximizing processing power to simulate for real-world applications such as aerospace simulation, XR Training, digital twins, architectural visualization  

This is early/mid-stage (TRL 2) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.