XRender News CenterXRender News Center

Soon after the submission of the paper “Adding Conditional Control to Text-to-Image Diffusion Models by Lvmin Zhang and Maneesh Agrawala from Stanford University, the trained model based on Stable Diffusion is now available for download on GitHub!


The paper that submitted to Cornell University on 10th Feb presents the public a “neural network structure, ControlNet, to control pretrained large diffusion models to support additional input conditions”. According to the paper, the neural network architecture ControlNet is able to let large image diffusion models (like Stable Diffusion) to learn task-specific input conditions and generate fine-controlled results based on the prompt and images input by users.


To put it bluntly, it is to control the pre-trained large model through additional input content, a kind of end-to-end training, and the current stable diffusion is achieved in this way.


By introducing a method to enable image diffusion models like Stable Diffusion to use additional input conditions, ControlNet presents an efficient way to tell an AI model which parts of an input image to keep, bring unprecedented levels of control to images based on the previous text-to-image models.

In the code shared in GitHub, the creators explained ma brunch of conditions that ControlNet can have fine control with based on Stable Diffusion, including:

Canny Edge

ConrolNet - Canny Edge

M-LSD Lines

ConrolNet - M-LSD Lines

HED Boundary

ConrolNet - HED Boundary

User scribbles

ConrolNet - User scribbles

Interactive Interface

ConrolNet - Interactive Interface

Human Pose

ConrolNet - Human Pose

Semantic Segmentation

ConrolNet - Semantic Segmentation.png

Anime Line Drawing

ConrolNet - Anime Line Drawing

And more.

You read the paper to check more examples or click here to read tutorial on GitHub and train with your own data with ControlNet.

XRender | Fast · Affordable · Reliable

Key Words

  • BagaPie
  • Unreal Engine
  • AE
  • Adobe
  • CG Magic
  • XRender
  • Render Tips
  • Blender
  • Wandering Earth
  • 3d animation
  • VFX
  • 2023
  • XRender Client
  • Layered render
  • Master Ji Gong
  • CPU
  • XRender dedicated features
  • Cinema 4D
  • Imaxinaria
  • Vertex
  • 3D creation
  • Aspera
  • render online
  • Animated Film
  • CG
  • XRender update
  • Visual effects
  • Render service
  • A Writer's Odyssey
  • GPU rendering
  • XCloud Disk
  • render farm
  • plugins for C4D
  • Animation
  • USD
  • Douluo Continent
  • After Effects
  • Capital Summit
  • add-on
  • Chaos
  • Timeout warning
  • Maya
  • Monster Run
  • Software update
  • Corona
  • Autodesk
  • 3ds Max
  • Intranet Submission
  • 3D Creation Plug-in
  • Render case
  • Maxon
  • Task Clone
  • TV series
  • plugin
  • V-Ray
  • Renderer
  • Zhen Dao Ge
  • Anima
  • sequence review
  • keyshot
  • What to watch
  • AI
  • Geometry node
  • free
  • The Infinitors