Stuffy SDXL Guide

Setup

Install webui
I use this webui on an NVIDIA GPU.

  1. Update NVIDIA drivers.
  2. To install the webui, follow the instructions here.
  3. If you're getting artifacts, you can try manually installing this extension.

Models

  • Download my model and place it in your stable diffusion models folder.
  • Download the SDXL vae file that's also in the previous link, place it in your VAE models folder, then in the webui select it.
  • If you are going to use controlnet, you need to download the models you plan to use and place them in your controlnet models folder.

Workflow

The workflow below is what I'm currently using, I often tweak and modify things but I try to keep this guide up to date.

Parameters
Tip: You can set your preferred values once, then go in settings tab > Defaults, view and save the new defaults so you don't have to change them every time.

  • Base prompt: score_9, score_8_up, score_7_up, best quality, source_anime BREAK, 1girl,
  • Negative prompt: (3d, censored), (worst quality, low quality), realistic, text
  • Sampling method: DPM++ 2M Karras
  • Sampling steps: 14
  • CFG: 3.5
  • Clip skip: 2

Txt2img

  • My goal at this step is to get a decent base image I know I can work with.
  • Here are some supported resolutions: 768x1344, 832x1216, 896x1152, 1024x1024. But you can also play around with it.
  • I usually prompt for whatever I need and gradually add and removed words to find what works. Both tags and phrases work fine.
  • Sometimes I use controlnet if I have a specific composition in mind or if I can't directly get what I want, for the input image I use other generations I've made.

Img2img

  • Once I have an image that I believe is good enough, I run it through img2img while manually making changes and fixing issues in Photoshop in between each pass.
  • I find it more convenient to make big changes in the first pass, so this is where I try to redraw anything major and make a lot of attempts, the subsequent passes are more for refining. Sometimes I also change the prompt and add things to it.
  • I roughly go 1.5x up in resolution. But I might keep it the same while making major changes and when using a higher denoising strength.
  • For the resize mode I mostly use Just Resize. I use between 0.4 to 0.7 for the denoising strength.
  • But it's best to play around with all these settings to better understand what to do.

Photoshop
Here's some of the tools I use and some examples.

  • Brush, eraser, eyedropper tool: I use them all the time to roughly redraw parts manually.
  • The new remove tool: it works really well to remove undesired parts or artifacts from an image, it can also fix lines and more...
  • Selection tools: I often use them to mix parts of different generations together, also to select parts so I can modify them individually.
  • Liquify filter: it's very useful to change the shape of the body, but it can be used for other things too.
  • Adjustment layers: I use them to change colors, brightness, etc...
  • Free Patreon post with some more tips.

Inpaint

  • I use inpainting to make medium and small adjustments, and for the face. I go back and forth between inpainting and Photoshop until I've made all of the changes I wanted.
  • I use "Whole picture" for most things, and "Only masked" for the face.
  • For the denoising strength I use anywhere from 0.3 to 0.6. But for the face I stay at around 0.4. But play around with all the settings.

https://x.com/StuffyAi
https://www.patreon.com/StuffyAi (NSFW)
SD 1.5 Guide backup: https://rentry.co/stuffyaibackup

Edit
Pub: 15 Nov 2022 16:57 UTC
Edit: 28 Apr 2024 02:17 UTC
Views: 72398