yashvoladoddi37's picture
Update README.md
715343d verified
metadata
base_model: runwayml/stable-diffusion-v1-5
library_name: diffusers
license: creativeml-openrail-m
tags:
  - stable-diffusion
  - stable-diffusion-diffusers
  - text-to-image
  - diffusers
  - diffusers-training
  - lora
inference: true

LoRA text2image fine-tuning - yashvoladoddi37/kanji-diffusion-v1-5

These are LoRA adaption weights for runwayml/stable-diffusion-v1-5. The weights were fine-tuned on the yashvoladoddi37/kanjienglish dataset. You can find some example images in the following.

img_0 img_1 img_2 img_3

How to use

from diffusers import StableDiffusionPipeline
import torch

model_path = "yashvoladoddi37/kanji-diffusion-v1-5"
pipe = StableDiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16, use_safetensors = True).to("cuda")
pipe.unet.load_attn_procs(model_path)
pipe.to("cuda")

prompt = "a Kanji meaning YouTube"
image = pipe(prompt).images[0]
image.save("youtube-kanji-v1-4.png")