Content
summary Summary

Meta FAIR has developed three new technologies to give robots better touch capabilities. The company plans to make these technologies available to researchers in 2024.

Ad

The key innovation is Meta Digit 360, a sensor-packed artificial finger with more than 18 sensing functions. The sensor can detect forces as small as one millinewton and uses a special optical system with more than 8 million measurement points, according to Meta, which says the sensor "significantly surpasses previous sensors, detecting miniature changes in spatial details."

Close-up of two finger sensors: on the left, an older Digit model; on the right, the new Digit 360 with a white sensor surface and black base.
Meta's new multimodal Digit 360 sensor (right) next to the previous-generation Digit sensor (left). | Image: Meta

According to Meta, the Digit 360 processes information directly through an "on-device AI accelerator," similar to the way the peripheral nervous system works in humans and animals.

New universal sensor technology

Meta also introduced Sparsh, which it calls the first universal encoder for visual tactile sensors. The system trained on more than 460,000 tactile images and uses self-supervised learning to work across different sensor types without specific adjustments.

Ad
Ad

According to Meta, Sparsh performs 95 percent better than task-specific and sensor-specific models in their testing. The company designed it as a pre-trained foundation for future robotics development.

Video: Meta

The third component, Meta Digit Plexus, is a standardized platform that integrates various tactile sensors in robotic hands. The system collects and analyzes data through a single cable connection.

Moving from the lab to the research community

Meta has partnered with two companies to bring these technologies to market. GelSight Inc will produce and sell Digit 360, while Wonik Robotics is creating a new robotic hand with built-in Digit Plexus technology.

Both products are planned for release in 2024, and researchers can now apply for early access. Meta is also releasing the code and designs for all three technologies to the research community.

Recommendation

Meta's Fundamental AI Research (FAIR) team says it developed these technologies to advance AI systems that can physically interact with their environment. Applications could range from healthcare to manufacturing, where machines need to perform precise movements. The technology could also allow people to feel virtual objects, such as touching a jacket in an online store.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Meta has introduced Digit 360, an artificial finger sensor with 18 sensing functions capable of detecting forces as low as one millinewton. The sensor features a special optical system with over 8 million measurement points, enabling human-like precision.
  • Sparsh, a universal encoder, has been trained on more than 460,000 tactile images and uses self-supervised learning to work with different types of sensors without requiring specific customization. In benchmark tests, Sparsh outperforms task and sensor-specific models by an average of 95 percent.
  • Meta has also developed Digit Plexus, a standardized platform for integrating multiple tactile sensors into robotic hands. Partnerships with GelSight Inc. and Wonik Robotics are expected to bring these technologies to market by 2024. In addition, Meta is making code and designs available to the research community.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.