A smart glove to guide your hands | MIT Technology Review

The wearable device can send tactile feedback to teach users new skills, make robots more dexterous, and help train surgeons and pilots.

Tactile instruction is crucial to learning certain tasks, but unlike video and audio, touch is difficult to record and transfer. Now researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and their colleagues have developed a smart glove that can capture, reproduce, and relay touch-based instructions, along with a machine-learning agent that adapts to how different users react to the feedback.

The system could help teach people physical skills, improve the performance of remote-controlled robots, and help train surgeons, firefighters, and pilots in virtual reality.

To make the glove, an embroidery machine stitches tactile sensors and haptic actuators—devices that provide touch-based feedback—into fabric that is cut out to fit a user’s hand measurements. It’s ready to wear in 10 minutes, and the machine-learning model needs just 15 seconds of user data to personalize the feedback.

In experiments, the system helped users learn to play mobile games, and a demonstration showed how it could even teach people to play the piano. The researchers also found that their glove could transfer force sensations to robotic arms, helping them with more delicate grasping tasks.

“This work is the first step to building personalized AI agents that continuously capture data about the user and the environment,” says Wojciech Matusik, SM ’01, PhD ’03, an MIT professor of electrical engineering and computer science and senior author of a paper on the work. “These agents then assist them in performing complex tasks, learning new skills, and promoting better behaviors.”

This story was part of our May/June 2024 issue.

Since Russia’s invasion, Serhii “Flash” Beskrestnov has become an influential, if sometimes controversial, force—sharing expert advice and intel on the ever-evolving technology that’s taken over the skies. His work may determine the future of Ukraine, and wars far beyond it.

The bulk of LLM progress until now has been language-driven. This new model enters the realm of complex reasoning, with implications for physics, coding, and more.

There’s a surprise twist in the battle to control genome editing.

A once-shuttered nuclear plant could soon return to the grid.

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at [email protected] with a list of newsletters you’d like to receive.