Google patents image tricks to help computers hear better
Google describes a method for improving speech recognition software by treating sound as a picture. The system creates new training data by hiding random sections of these sound pictures, forcing the computer to learn to understand audio even when parts are missing or noisy.
In the filing’s own words
Generally, the present disclosure is directed to systems and methods that generate augmented training data for machine-learned models via application of one or more augmentation techniques to audiographic images that visually represent audio signals. In particular, the present disclosure provides a number of novel augmentation operations which can be performed directly upon the audiographic image (e.g., as opposed to the raw audio data) to generate augmented training data that results in improved model performance. As an example, the audiographic images can be or include one or more spectrograms or filter bank sequences.
What exactly they claim (claim 1)
1. A computer-implemented method of data augmentation for training machine-learned models, the method comprising: obtaining a plurality of audiographic images that represent audio signals using pixels; for one or more of the audiographic images, generating one or more augmented images based on masking one or more blocks of consecutive pixel values along a time or frequency axis, the quantity of the one or more blocks of consecutive pixel values defined by a hyperparameter, each respective block having a respective width and a respective location; and training a machine-learned model on the augmented images to output text transcriptions by modifying model parameters based on an evaluation of an objective function.
Facts
- Company
- Google (Google LLC)
- Official title
- Augmentation of Audiographic Images for Improved Machine Learning
- Publication number
- US20260310968A1
- Application number
- 19711519
- Filed
- Jun 17, 2026
- Published
- Oct 8, 2026
- Inventors
- 7
- Claims
- 20
Classified under
G06N 3/084 Physics & computingG06F 18/2148 Physics & computingG06N 20/00 Physics & computingG06V 10/7747 Physics & computingG06V 10/82 Physics & computingG10L 15/063 Physics & computingMore from Google in AI & software
- Google patents video search that answers questions using AI descriptions Sep 15, 2026
- Google patents photo tool that removes people and their gear Sep 15, 2026
- Google patents AI that writes live meeting notes and summaries Sep 15, 2026
- Google patents AI tool that turns messy emergency notes into clear messages Sep 3, 2026
- Google patents AI that clicks through apps to finish tasks for you Sep 24, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.
