Apple patents voice commands that use cameras to find specific devices
Apple describes a system where a device uses its camera to visually identify a specific object in your room before acting on a voice command. The system creates a visual profile of the object, such as a smart light or speaker, and links it to a network address so the device knows exactly which item to control.
In the filing’s own words
In one implementation, a method of changing a state of an object is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving a vocal command. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes detecting, in the image of the physical environment, an object based on a visual model of the object stored in the non-transitory memory in association with an object identifier of the object. The method includes generating, based on the vocal command and detection of the object, an instruction including the object identifier of the object. The method includes effectuating the instruction to change a state of the object.
What exactly they claim (claim 1)
1. A method comprising: at a device including an image sensor, one or more processors, and non-transitory memory: obtaining a request to enroll an object; obtaining, using the image sensor, one or more images of the object; determining, based on the one or more images of the object, a visual model of the object; and storing, in the non-transitory memory, the visual model in association with a network address of the object.
Facts
- Company
- Apple (Apple Inc.)
- Official title
- Command Disambiguation based on Environmental Context
- Publication number
- US20260279358A1
- Application number
- 19669680
- Filed
- May 6, 2026
- Published
- Sep 17, 2026
- Inventors
- 5
- Claims
- 20
Classified under
G10L 15/22 Physics & computingG06F 3/013 Physics & computingG06V 10/255 Physics & computingG10L 2015/223 Physics & computingMore from Apple in AI & software
- Apple patents AI that acts on voicemails for you Oct 15, 2026
- Apple patents letting users teach custom hand gestures to their devices Oct 22, 2026
- Apple patents AI that acts on voicemails for you Sep 1, 2026
- Apple patents video tool that swaps focus between subjects after filming Oct 20, 2026
- Apple patents system that changes room ambience based on what you look at Sep 3, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.