Apple patents system to sync sound with multiple camera angles

1. An encoding side method for audio rendering of an audio session or sound program, the method comprising: obtaining a respective video feed and a respective metadata, of the respective video feed, for each of a plurality of cameras of a recording system that are aimed at a scene, wherein the respective metadata comprises a respective camera position and a respective camera orientation or look direction of the camera that is producing the video feed; selecting one of the plurality of cameras as a reference camera, and encoding the respective video feed of the reference camera as a reference feed into a bitstream along with a reference feed metadata, wherein the reference feed metadata comprises a single audio session or sound program of the scene as i) a plurality of audio objects and their respective positions relative to the respective camera position of the reference camera or ii) an HOA representation relative to the respective camera position of the reference camera; and encoding each of the respective video feeds of all others of the plurality of cameras into the bitstream along with a respective relative position of the camera that is producing the respective video feed, wherein the respective relative position is relative to the respective camera position of the reference camera, and wherein in a decoding side method, the single audio session or sound program in the reference feed metadata is to be used for playback from all others of the plurality of cameras.