Google patents image generator that mixes shared and style-specific settings

1. A computer-implemented method comprising: receiving a text prompt specifying a style of an image; processing the text prompt using a text encoder neural network to generate a contextual text embedding; and generating an output image by using a text-to-image generative model, wherein the text-to-image generative model comprises one or more first sets of parameters that are shared across different styles, and one or more second sets of parameters that are specific to the specified style, and wherein the generating comprises, at each of multiple steps: obtaining an intermediate representation of the output image for the step; processing, by the text-to-image generative model and by using both the one or more first sets of parameters and the one or more second sets of parameters, the intermediate representation of the output image for the step and the contextual text embedding to generate a first model output for the step; processing, by the text-to-image generative model and by using the one or more first sets of parameters and without using the one or more second sets of parameters, the intermediate representation of the output image for the step and the contextual text embedding to generate a second model output for the step; and generating an updated intermediate representation of the output image for the step based on the first and second model outputs for the step.