Tesla patents faster math for self-driving AI
Tesla describes a method to speed up calculations in transformer models used for self-driving cars. Instead of creating a full grid of rules to block certain data, the system splits the math into smaller chunks and checks rules on the fly, saving memory and processing time.
In the filing’s own words
Embodiments described herein provide for computing masked scores in transformer models without materializing a full mask. A matrix is partitioned into submatrices based on available processing elements. At least one element is initialized with row and column index values and evaluates a masking condition using a comparison operation, which is fused into the softmax computation. This approach supports causal and batched masks with minimal overhead and is well-suited for applications such as autonomous navigation, where computed weights guide downstream decision-making.
What exactly they claim (claim 1)
1. A method for autonomous navigation of an ego using a transformer model, the method comprising: partitioning, by one or more processors, a matrix associated with the transformer model into a plurality of submatrices based on a number of processing elements; assigning, by the one or more processors, the plurality of submatrices to a plurality of processing elements configured to generate a score for the plurality of submatrices; initializing, by the one or more processors, a column index value and a row index value for the plurality of submatrices corresponding to a respective position in the matrix; generating, by the one or more processors, a score in accordance with a softmax computation and a masking condition based on the row index value and the column index value; and transmitting, by the one or more processors, to an autonomous navigation application, at least one weight based on the score, whereby the autonomous navigation application generate at least one executable navigational instruction to be executed by a processor of the ego.
Facts
- Company
- Tesla (Tesla, Inc.)
- Official title
- SYSTEMS AND METHODS FOR ATTENTION MASKING
- Publication number
- US20260296484A1
- Application number
- 19249445
- Filed
- Jun 25, 2025
- Published
- Oct 1, 2026
- Inventors
- 2
- Claims
- 20
Classified under
B60W 60/001 Operations & transportB60W 50/0097 Operations & transportB60W 2050/0022 Operations & transportB60W 2050/0028 Operations & transportB60W 2420/403 Operations & transportB60W 2556/35 Operations & transportMore from Tesla in AI & software
- Tesla patents method to train self-driving software using simulated driving Oct 6, 2026
- Tesla patents method to share object labels between different car sensors Sep 17, 2026
- Tesla patents faster math for car navigation AI Oct 1, 2026
- Tesla patents method to speed up AI calculations in self-driving cars Oct 1, 2026
- Tesla patents method to speed up AI processing in self-driving cars Oct 1, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.