Nvidia patents smart routing of app tasks between CPU and GPU
Nvidia has patented a method that uses machine learning to decide which parts of an application should run on the main processor (CPU) or the graphics card (GPU). The system analyzes how an app is being used to predict which hardware will perform better or use less power, then automatically sends the work to the right chip.
In the filing’s own words
Apparatuses, systems, and techniques for assigning execution of applications to various processing units using machine learning are disclosed herein. Usage data for an application to be executed using a computing system including an integrated processing unit and a discrete processing unit is identified. At least a portion of operations of the application to be executed using the integrated processing unit or the discrete processing unit based on the usage data and in view of at least one of one or more system performance metrics or one or more user experience metrics associated with executing the application using the integrated processing unit and the discrete processing unit.
What exactly they claim (claim 1)
1. A method comprising: identifying usage data associated with an application that is to be executed using a computing system, wherein the computing system comprises an integrated processing unit and a discrete processing unit; processing the usage data using a machine learning model to generate (i) a first value of at least one of one or more system performance metrics or one or more resource utilization metrics corresponding to execution of the one or more operations using the integrated processing unit and (ii) a second value of the at least one of the one or more system performance metrics or the one or more resource utilization metrics corresponding to execution of the one or more operations using the discrete processing unit; determining whether the one or more operations satisfy at least one of a processing cycle criterion or a power consumption criterion based on the first value and the second value; and based on the determination, routing the one or more operations of the application to the integrated processing unit or the discrete processing unit.
Facts
- Company
- Nvidia (NVIDIA Corporation)
- Official title
- Application execution allocation using machine learning
- Patent number
- US12737272B2
- Application number
- 18094028
- Filed
- Jan 6, 2023
- Granted
- Sep 15, 2026
- Inventors
- 1
- Claims
- 20
Classified under
G06F 11/3409 Physics & computingG06N 20/00 Physics & computingMore from Nvidia in Chips & hardware
- Nvidia patents method to skip zero data in neural network math Oct 13, 2026
- Nvidia patents hardware to speed up motion blur in ray tracing Oct 13, 2026
- Nvidia patents method to sync data across split processor chips Sep 17, 2026
- Nvidia patents chip math trick to speed up AI calculations Oct 8, 2026
- Nvidia patents data center cooling that uses cryogenic fluids Oct 15, 2026
Summaries are simplified from the filing’s own abstract and first claim. A patent filing is not a product announcement.
Patent data and drawings: U.S. Patent and Trademark Office (USPTO). Nebula is not affiliated with or endorsed by the USPTO.