Evaluation of the BioSleeve Gesture Control Interface for Telerobotics in Microgravity

JPL has developed a “BioSleeve” gesture control interface that can currently recognize 20 hand and finger gestures at >95% accuracy during prototype validations in the laboratory environment. It combines an array of electromyography (EMG) and inertial/magnetic field (IMU or MARG) sensors in a forearm sleeve that measures muscle activity and arm pose, with robust algorithms in embedded software for gesture recognition and command generation. This technology is designed to help address challenges identified in NASA’s Space Technology Roadmap in the area of Human-Systems Interfaces for dexterous telerobotic control, gesture control, and robot telesupervision. This flight demonstration is a continuation of the work performed under T0161. Technology Maturation The specific objectives for the parabolic flights are to: (1) evaluate effects of the microgravity environment on gesture recognition performance, compared to performance in ground tests, after training both on the ground and during flight; and (2) demonstrate BioSleeve interface utility in the microgravity environment by performing a simulated steering/grappling task by an astronaut anchored to the ISS Canadarm2 end effector.

The BioSleeve can be used for human-robot interaction such as astronauts directing rovers on EVA (extra-vehicular activities), or telerobotic control for remote manipulation such as Canadarm2. It will benefit future, unfunded NASA missions. Future Customers The BioSleeve output can be mapped into various command libraries for different robotic platforms. NASA and commercial space companies could use BioSleeve gesture control technology for human-robot interactions such as: natural hand gestures to direct surface rovers by an astronaut on EVA; intuitive telerobotic control for remote manipulation and for high degree-of-freedom robots such as Robonaut and Canadarm2 on ISS; and force control for power-assisted EVA gloves or exoskeletons.

This is early/mid-stage (TRL 5) — the most realistic path in is NASA SBIR/STTR, which funds small businesses and research institutions to develop technology aligned with NASA's needs (equity-free, phased funding). Check whether a current SBIR/STTR solicitation topic overlaps with this project's technology area, or contact the project directly (above) to ask.

None of these are guaranteed paths for this specific project — TechPort itself doesn't have an "apply" button. Reaching out to the contact(s) above with a specific question is usually the fastest way to find out what's actually open.