← Back to NASA Technology Projects
CC20 NASA Spacesuit Detection Challenge
Completed
TRL 3 (started at 1, targeting 3)
Description
A spacesuit has unique movement patterns that can be observed in Extravehicular Activities (EVA), and mobility assessments are needed to discern and mitigate suit injury risk. However, current motion capture systems are cost prohibitive and not feasible for some training conditions (i.e. simulated lunar outdoor terrain). Thus, there is a need to quantify suit motion from conventional photographs or video without using any specialized sensors as video information is prevalent and easily collected. Understanding how a person moves in the spacesuit enables the characterization of EVA motions, which can be used to optimize EVA tasks, training, and hardware. What is the current performance of the system and why/how would improvements yield a significant impact? : Preliminary work has been done to estimate suit posture from photographs using an iterative parameter optimization algorithm. However, a broader and more complex machine learning approach is needed to account for variability in viewing angles and environments. The developed system will enable EVA stakeholders to quantify suit kinematic patterns, which can help optimize the suit, hardware and task designs. For example, biomechanical stress assessments for EVA can be performed to mitigate injury risk. The framework is applicable to Neutral Buoyancy Lab (NBL) and Active Response Gravity Offload System (ARGOS) testing, which will help to optimize training procedures. The tool can be further tested against a large wealth of video archives of past EVAs for task and timeline analysis.
A spacesuit has unique movement patterns that can be observed during spacewalks or Extravehicular Activities (EVA), and mobility assessments are needed to discern and mitigate suit injury risk. It is very difficult to measure spacesuit motion in uncontrolled environments such as training facilities, and a novel method is needed to quantify spacesuit motions from conventional and readily available video and photographs without requiring or needing motion capture cameras. Once validated for the accuracy and reliability of the posture extractions, the selected system will be deployed to estimate the EVA postures in current and future missions and analog training events. The framework will be applicable to Neutral Buoyancy Lab (NBL) and Active Response Gravity Offload System (ARGOS) testing, which will help to optimize training procedures. Additionally, the winning solution will be tested and validated on video recordings collected during the next-generation spacesuit testing. NASA is seeking novel solutions to label and identify spacesuit motions from conventional and readily available video and photographs to overcome current system limitations in terms of cost and training feasibility. The winning computer vision algorithms are expected to have the ability to: Detect spacesuits in a variety of environments and lightning conditions. Correctly discriminate between an "unsuited" person and a spacesuit. Robustly extract suit postures from images partially occluded. Capable of functioning with a single or multiple spacesuits. A spacesuit has unique movement patterns that can be observed in Extravehicular Activities (EVA), and mobility assessments are needed to discern and mitigate suit injury risk. However, current motion capture systems are cost prohibitive and not feasible for some training conditions (i.e. simulated lunar outdoor terrain). Thus, there is a need to quantify suit motion from conventional photographs or video without using any specialized sensors as video information is prevalent and easily collected. Understanding how a person moves in the spacesuit enables the characterization of EVA motions, which can be used to optimize EVA tasks, training, and hardware. What is the current performance of the system and why/how would improvements yield a significant impact? : Preliminary work has been done to estimate suit posture from photographs using an iterative parameter optimization algorithm. However, a broader and more complex machine learning approach is needed to account for variability in viewing angles and environments. The developed system will enable EVA stakeholders to quantify suit kinematic patterns, which can help optimize the suit, hardware and task designs. For example, biomechanical stress assessments for EVA can be performed to mitigate injury risk. The framework is applicable to Neutral Buoyancy Lab (NBL) and Active Response Gravity Offload System (ARGOS) testing, which will help to optimize training procedures. The tool can be further tested against a large wealth of video archives of past EVAs for task and timeline analysis.
Benefits
Challenge Launched on March 31st ended on May 03rd : https://www.topcoder.com/challenges/116fc3d9-a4e0-4a93-8ef1-a075ae16ee88?tab=details Heroku DashBoard URL: https://spacesuit-dash.herokuapp.com/ Final Tracking Sheet : https://docs.google.com/spreadsheets/d/15ayDfNGk21pH_UpTSVs0gmLI8paqIeLDdM_aseJlSKE/edit?usp=sharing Marathon Match Summary: https://docs.google.com/presentation/d/1HBUF9dIMJ7yL0_-MlRgtuPckF47idnShtaUoZ34wJeQ/edit?usp=sharing Final Deliverables: https://drive.google.com/drive/folders/16xhMOe22ZDn185O5My4xghnDLn1EgjC_
Solved
Planned for future implementation
Algorithm
Details
| Technology area | Human Health, Life Support, and Habitation Systems > Extravehicular Activity Systems > Informatics and Decision Support Systems > Human Health and Performance |
| Program | Prizes, Challenges, and Crowdsourcing (PCC) |
| Lead organization | Johnson Space Center, Houston, TX |
| Start date | 2021-01-01 |
| End date | 2021-08-31 |
Project contacts
Listed on TechPort itself — the most direct way to ask about this specific project.
How to get involved
This is early/mid-stage (TRL 3) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.
None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.