Stuffy Stable Diffusion Guide (backup)
Setup
Install webui
I use this webui on an NVIDIA GPU.
- Update NVIDIA drivers.
- Download
sd.webui.zip
from here and extract in a folder. - Double click
update.bat
, once it finishes, close it and then double clickrun.bat
(the first time it's going to take a while). - Go to the "webui" folder, find a file called
webui-user.bat
, right click to edit it and add arguments like below
set COMMANDLINE_ARGS=--autolaunch --update-check --no-half-vae --opt-sdp-attention - Any time you want to open the program, double click
run.bat
. When you want to shut it down, close the command terminal. - In the settings tab, go to User interface and in Quicksettings list, add "CLIP_stop_at_last_layers", apply and reload.
Models
- Download my model or any other you like and place it in your stable diffusion models folder.
- Download this vae file, place it in your VAE models folder, then go in the Settings tab > VAE, select and apply settings.
- I also use two negative embedding, EasyNegative and Negative_Hand. Download them and place them in your embeddings folder.
- If you are going to use controlnet, you need to install the extension, then download the models you plan to use and place them in your controlnet models folder.
- To make characters, I make and use my own Loras, here's my free Patreon guide if you're interested in that.
Workflow
The workflow below is what I'm currently using, I often tweak and modify things but I try to keep this guide up to date.
Parameters
Tip: You can set your preferred values once, then go in settings tab > Defaults, view and save the new defaults so you don't have to change them every time.
- Base prompt: (masterpiece, best quality:1.2),
- Negative prompt: (worst quality, low quality:1.2), (easynegative:0.8), negative_hand-neg, (low contrast), (monochrome)
- Sampling method: DPM++ 2M Karras
- Sampling steps: 16
- CFG: 5.5
- Clip skip: 2
Txt2img
- My goal at this step is to get a decent base image I know I can work with.
- Most resolutions are fine but play around with it.
- I usually prompt for whatever I need, but I add or change many things later.
- Sometimes I use controlnet depth, canny or softedge if I have a specific composition in mind or if I can't directly get what I want, for the input image I use other generations I've made.
Img2img
- Once I have an image that I believe is good enough, I run it through img2img while manually making changes and fixing issues in Photoshop in between each pass.
- I find it more convenient to make big changes in the first pass, so this is where I try to redraw anything major and make a lot of attempts, the subsequent passes are more for refining.
- I roughly go up to around 800x1200 or equivalent in pixels for the resolution.
- I enable controlnet here too if I think it might help. Controlnet Tile can be very useful when increasing the resolution here.
- For the resize mode I mostly use Just Resize (latent upscale). I use around 0.6 for the denoising strength.
- But it's best to play around with all these settings to better understand what to do.
Photoshop
Here's some of the tools I use and some examples.
- Brush, eraser, eyedropper tool: I use them all the time to roughly redraw parts manually.
- The new remove tool: it works really well to remove undesired parts or artifacts from an image, it can also fix lines and more...
- Selection tools: I often use them to mix parts of different generations together, also to select parts so I can modify them individually.
- Liquify filter: it's very useful to change the shape of the body, but it can be used for other things too.
- Adjustment layers: I use them to change colors, brightness, etc...
- After upscaling the image, I do some simple post processing and remove any remaining artifact.
- Free Patreon post with some more tips.
Inpaint
- I use inpainting to make medium and small adjustments, and most importantly for the face. I go back and forth between inpainting and Photoshop until I've made all of the changes I wanted.
- I use "Whole picture" for most things, and "Only masked" for the face.
- For the denoising strength I use anywhere from 0.3 to 0.6. But for the face I stay at around 0.4. But play around with all the settings.
Upscale
Finally I upscale the image with these settings:
- Resize: 2
- Upscaler: 4x-AnimeSharp (download and place the .pth file in your ESRGAN models folder)
https://x.com/StuffyAi
https://www.patreon.com/StuffyAi (NSFW)