the following is a general representation of ControlNet's architecture. first, it clones the weights of a diffusion model. Then, it trains the cloned weights to control the original model with the task from the input condition.

→ View original post on X — @krea_ai,