Posing in Blender for ControlNet


DO NOT push random buttons / keys in Blender. Blender WILL fuck you if you give it the slightest excuse.

  1. Download and install Blender
  2. Download https://files.catbox.moe/p7ej1t.zip
  3. Unzip somewhere and open the Openpose_bone_03.blend file in Blender

what you should see

old instructions https://rentry.org/s7a3w

Basic controls

? what it do
Middle mouse rotate view
Shift + middle mouse move view
Mouse wheel zoom in / out
F12 render
Alt + S save render (if render window open)
Select a bone, hit A to select all bones, Alt + R/G reset the skeleton pose's rotation and translation
R/G (with something selected) begins to rotate/transform the selected object
R/G followed by X,Y or Z begins to rotate/transform only on the specified axis. RZ = rotate about z axis.
(In top right of viewport) Pose Options > X-Axis Mirror whatever you pose on the left is mirrored on the right and vice versa

The camera is locked to the right-hand viewport. You can move the camera around using that viewport. Use middle mouse in the right viewport to move the camera around (middle mouse, mouse wheel and shift + middle mouse).

Posing the rig

If you are not in pose mode

  1. Click on one of the boxes on the rig in left-hand viewport
    what you should see
  2. Hit Ctrl + Tab
  3. Box in top left should change from "Object Mode" to "Pose Mode". If it doesn't, you probably didn't click on one of the boxes on the rig.
  4. Now you can pose the rig!

If you are in pose mode
Move the limbs around with the translate tool. Optionally use X-axes mirror (see above) to move both arms/legs at the same time.

There are some floating ball shapes which control where intermediate joints will point. For example, if you move the foot upwards to make a squat, you can move the knee sphere around to make the knee point more inwards/outwards. See the example clip below.

  1. Grab the hip bone and sit our skeleton down.
  2. Grab the knee IK things and move the knees out a bit
  3. Grab the feet and move them out.
    We now have our Hello World pose. MP4 video link: https://i.imgur.com/TLW16yK.mp4
    what you should see
  4. On the right hand viewport, move the camera to frame up the subject
  5. F12 to render
  6. Alt + S to save the render
  7. Drag it into WebUI ControlNet to control the pose

You can change the size and aspect of your render by going to Output Properties and setting the resolution.
Output Properties

Orthographic camera

An orthographic projection has no depth (a distant object does not get smaller). You might get a better result from the pose control net in some cases if you use an orthographic projection. If you want to try this out, follow below instructions to make the camera orthographic. The orthographic camera is annoying because you can't zoom in and out and need to use "Orthographic Scale" to control how large your subject is in the camera's frame.

  1. Update the camera and render preview to orthographic (optional, don't fuck with this on first try)
    1. In right-hand properties, change to select Camera
      what you should see
    2. In Camera properties, click small green "Object Data Properties" icon (little 📽 icon)
    3. Change Type from "Perspective" to "Orthographic"
    4. Change "Orthographic Scale" to zoom in and out (there is no depth in orthographic projection)
Pub: 18 Feb 2023 21:43 UTC
Edit: 26 Feb 2023 15:25 UTC
Views: 1565