Stable Diffusion

4338 readers

8 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 2 years ago

MODERATORS

db0@lemmy.dbzer0.com

What models can we use for img2img today? (lemmy.dbzer0.com)

submitted 2 months ago by hok@lemmy.dbzer0.com to c/stable_diffusion@lemmy.dbzer0.com

1 comments fedilink hide all child comments

I'd like to fine tune a model that does img2img with a text prompt to guide the output. I think img2img-turbo might be the closest to what I'm after, though by default it uses a fixed prompt which can be made variable with some tweaking of the training code.

At the moment I only have access to 24GB VRAM which limits my options. What I'm after is training a model to make specific text-based modifications to images, and I have plenty of before to after images plus the modification text prompts to train on. Worst case, I can try to see if reducing the image size during training makes it possible with my setup.

Are there any other options available today?

you are viewing a single comment's thread
view the rest of the comments

[–] Even_Adder@lemmy.dbzer0.com 2 points 2 months ago

I found this guide on how to make an inpainting model out of any model. Though it's pretty out of date.