• Sat. Dec 21st, 2024

How to use AI tool

How to use AI tools and How to use AI to make money

How to use SDXL with ComfyUI

how to use sdxl with comfyui

In the previous post, we described how to install and use ComfyUI,You can check it out by clicking here:How to install ComfyUI and How to use ComfyUI for Stable Diffusion

Today we share how to use sdxl in ComfyUI。First download the sdxl related models,3 and 4 are not required, you can skip the downloads。

Downloading SDXL v1.0 Models

1. Checkpoints

To run SDXL, you’ll initially need to download the checkpoint models. Depending on your requirements, you might need additional models later on.

Location: Store the checkpoints in the ComfyUI/models/checkpoints directory.

2. VAE (Variational Autoencoder)

Location: Store the VAEs in the ComfyUI/models/vae directory.

3. LoRAs (Local Randomizations)

Location: Store the LoRAs in the ComfyUI/models/loras directory.

4. Upscaler

Depending on your workflow, you might need upscalers. Some workflows might not include them, while others might necessitate them.

Location: Store the upscalers in the ComfyUI/models/upscaler directory.

How to run ComfyUI

Windows systems can directly double-click “run_nvidia_gpu.bat” to run ComfyUI, after the command is loaded, it will automatically open the ComfyUI interface in the browser.

How to run ComfyUI

Loading SDXL workflows using ComfyUI official examples

ComfyUI officially provides numerous examples for us to refer to the loading workflow: ComfyUI_examples

SDXL workflows using ComfyUI

Let’s open the SDXL example,Save one of the sample images,The original image generated by comfyui can be loaded directly using the load command and then the entire workflow will be opened, isn’t that cool?

sdxl workflow with comfyui

Then use the Load button in the command window on the right to load the just saved image to load the ComfyUI workflow. Then select the corresponding filename in the Base and Refiner model loaders that you downloaded earlier and click Queue Prompt.

sdxl workflow with comfyui

You can now change the positive and negative cues to get the image you want!

How to use SDXL’s LoRA in ComfyUI

ComfyUI also provides LoRA examples , We can observe the way it is wired for reference

how to use sdxl LoRA with comfyui

You can see that the LoRA loader node is placed between the big model and the text encoder, we just need to link the Base model pins to the LoRA loader.

how to use sdxl with comfyui

You can load the LoRA model you downloaded earlier or other LoRAs from the Civitai to generate your own images.

That’s the easy way to use SDXL and LoRA in ComfyUI, hope it helps!

Leave a Reply

Your email address will not be published. Required fields are marked *