Meta patents robotic fingertip that uses cameras to feel touch


Meta describes a robotic fingertip with a silicone dome and a specialized camera system that captures how light scatters inside the material. The system combines these visual images with data from other sensors and uses machine learning to interpret the physical touch.
In the filing’s own words
In one embodiment, a system includes a silicone hemispherical dome and an omnidirectional optical system. The dome includes a surface including a reflective silver-film layer. The optical system includes a lens including multiple lens elements with the first lens element in direct contact with the hemispherical dome without airgap. The lens is configured to capture scattering of internal incident light generated by the reflective silver-film layer. The optical system also includes an image sensor configured to generate image data from data captured by the lens. The system also includes non-image sensors. The system further includes processors and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to access the image data from the omnidirectional optical system and sensing data from the non-image sensors and generate touch digitization based on the accessed image and sensing data by machine-learning models.
What exactly they claim (claim 1)
1. A system for touch digitization, comprising: a silicone hemispherical dome comprising a surface comprising a reflective silver-film layer; an omnidirectional optical system comprising: a lens comprising a plurality of lens elements, a first lens element of the plurality of lens elements is in direct contact with the silicone hemispherical dome without an airgap, and the lens is configured to capture scattering of internal incident light generated by the reflective silver-film layer; and an image sensor configured to generate image data from data captured by the lens; non-image sensors disposed underneath the omnidirectional optical system; one or more processors; a non-transitory memory coupled to the one or more processors comprising instructions executable by the one or more processors, operable when executing the instructions to: access the image data from the omnidirectional optical system and sensing data from the non-image sensors; and generate, based on the accessed image and the sensing data by machine-learning models, the touch digitization.
Facts
- Company
- Meta (Meta Platforms Technologies, LLC)
- Official title
- Digitizing touch with artificial robotic fingertip
- Patent number
- US12789388B2
- Application number
- 18503727
- Filed
- Nov 7, 2023
- Granted
- Nov 10, 2026
- Inventors
- 6
- Claims
- 20
Classified under
B25J 13/081 Operations & transportB25J 15/0009 Operations & transportB25J 19/023 Operations & transportG06F 3/041 Physics & computingG06V 10/82 Physics & computingMore from Meta in Robots & automation
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.