metadata
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora
widget:
- text: >-
Ghibli Art, a vibrant orange van is parked on a rocky hillside. The van is
adorned with a white roof, adorned with an orange patch, adding a pop of
color to the scene. A man in a yellow hooded sweatshirt and jeans is
standing on the roof of the van, looking out at the view of the mountain
range. The sky is a deep blue, dotted with fluffy white clouds. To the
right of the man, a large brown backpack is draped over the vans head. The
mountain range is covered in snow, adding to the authenticity of the
image.
output:
url: images/1.png
- text: >-
Ghibli Art, a cartoon-like scene features a young man with short brown
hair, dressed in a white t-shirt, brown pants, and brown boots, standing
on a cliff overlooking a valley. He is holding a map in his right hand,
and a brown backpack on his left shoulder. The valley is filled with lush
green trees, and the valley is bordered by a mountain range. The sky is a
deep blue, dotted with white clouds, adding a pop of color to the scene.
output:
url: images/2.png
- text: >-
Ghibli Art, a young boy is riding a bicycle on a wet, rainy day. The boy
is dressed in a bright orange shirt, gray pants, and a red backpack. His
helmet is black, and he is facing the right side of the frame. The bicycle
is casting a shadow on the water, and the water is reflecting the boys
reflection. To the left of the boy, a field of yellow corn is growing, and
to the right of the field is a house with a red roof. The sky is filled
with dark gray clouds, adding a touch of color to the scene.
output:
url: images/3.png
- text: >-
Ghibli Art, Captured at eye-level on a vibrant day, a man in a blue shirt,
and a straw hat is standing in a field of wheat. The man is holding a
rifle in his right hand, while his left hand is resting on a wooden fence.
In the distance, a brown barn with a brown roof is seen, nestled in the
field. The barn is surrounded by trees and a metal tower. The sky is a
deep blue, dotted with white clouds, adding a touch of color to the scene.
output:
url: images/4.png
- text: >-
Ghibli Art: A bustling village square on a sunny afternoon. A boy in a red
scarf and green jacket rides a vintage bicycle through the cobblestone
streets, carrying a basket full of bread loaves. To his left, a lively
market is set up with colorful stalls, while to his right, a fountain with
a bronze statue glistens in the sunlight. The sky is a vivid blue with
cotton-like clouds, and the buildings are adorned with flowering vines and
wooden shutters.
output:
url: images/5.png
- text: >-
Ghibli Art: A young girl with short black hair and a yellow raincoat
stands under a red umbrella in the middle of a cobblestone street. Rain
falls steadily, creating ripples in puddles around her feet. Behind her, a
small bakery with a warm, glowing light spills onto the street, and its
wooden sign sways gently in the wind. The sky is heavy with dark gray
clouds, and a single beam of light breaks through, illuminating the scene.
output:
url: images/6.png
- text: >-
Ghibli Art: A narrow mountain path shrouded in rain and mist. A traveler
in a wide-brimmed straw hat and a long green cloak leans on a wooden staff
as they walk. Water cascades down the rocky slopes, forming small streams
that crisscross the path. The dark clouds above roll ominously, and a
single bird soars against the turbulent sky, adding a sense of movement to
the stillness.
output:
url: images/7.png
- text: >-
Ghibli Art: A vibrant spring meadow at dawn. A young woman in a lavender
dress and straw hat is painting on an easel under a large cherry blossom
tree. Pink petals gently fall around her, and a curious white rabbit sits
nearby, watching. The meadow is dotted with yellow and purple wildflowers,
and a small brook winds its way through the scene. In the background, a
quaint cottage with a stone chimney is nestled among rolling green hills
output:
url: images/8.png
- text: >-
Ghibli Art: A young boy with tousled black hair sits on a grassy hill
under a dark, star-filled sky. He wears a light blue sweater and brown
pants, with a small telescope set up in front of him. Around him,
fireflies dance in the cool night air, adding a magical glow. A crescent
moon hangs low on the horizon, and in the distance, the faint silhouette
of a village is visible against the hills.
output:
url: images/9.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: Ghibli Art
license: openrail
Flux-Ghibli-Art-LoRA
- Prompt
- Ghibli Art, a vibrant orange van is parked on a rocky hillside. The van is adorned with a white roof, adorned with an orange patch, adding a pop of color to the scene. A man in a yellow hooded sweatshirt and jeans is standing on the roof of the van, looking out at the view of the mountain range. The sky is a deep blue, dotted with fluffy white clouds. To the right of the man, a large brown backpack is draped over the vans head. The mountain range is covered in snow, adding to the authenticity of the image.
- Prompt
- Ghibli Art, a cartoon-like scene features a young man with short brown hair, dressed in a white t-shirt, brown pants, and brown boots, standing on a cliff overlooking a valley. He is holding a map in his right hand, and a brown backpack on his left shoulder. The valley is filled with lush green trees, and the valley is bordered by a mountain range. The sky is a deep blue, dotted with white clouds, adding a pop of color to the scene.
- Prompt
- Ghibli Art, a young boy is riding a bicycle on a wet, rainy day. The boy is dressed in a bright orange shirt, gray pants, and a red backpack. His helmet is black, and he is facing the right side of the frame. The bicycle is casting a shadow on the water, and the water is reflecting the boys reflection. To the left of the boy, a field of yellow corn is growing, and to the right of the field is a house with a red roof. The sky is filled with dark gray clouds, adding a touch of color to the scene.
- Prompt
- Ghibli Art, Captured at eye-level on a vibrant day, a man in a blue shirt, and a straw hat is standing in a field of wheat. The man is holding a rifle in his right hand, while his left hand is resting on a wooden fence. In the distance, a brown barn with a brown roof is seen, nestled in the field. The barn is surrounded by trees and a metal tower. The sky is a deep blue, dotted with white clouds, adding a touch of color to the scene.
- Prompt
- Ghibli Art: A bustling village square on a sunny afternoon. A boy in a red scarf and green jacket rides a vintage bicycle through the cobblestone streets, carrying a basket full of bread loaves. To his left, a lively market is set up with colorful stalls, while to his right, a fountain with a bronze statue glistens in the sunlight. The sky is a vivid blue with cotton-like clouds, and the buildings are adorned with flowering vines and wooden shutters.
- Prompt
- Ghibli Art: A young girl with short black hair and a yellow raincoat stands under a red umbrella in the middle of a cobblestone street. Rain falls steadily, creating ripples in puddles around her feet. Behind her, a small bakery with a warm, glowing light spills onto the street, and its wooden sign sways gently in the wind. The sky is heavy with dark gray clouds, and a single beam of light breaks through, illuminating the scene.
- Prompt
- Ghibli Art: A narrow mountain path shrouded in rain and mist. A traveler in a wide-brimmed straw hat and a long green cloak leans on a wooden staff as they walk. Water cascades down the rocky slopes, forming small streams that crisscross the path. The dark clouds above roll ominously, and a single bird soars against the turbulent sky, adding a sense of movement to the stillness.
- Prompt
- Ghibli Art: A vibrant spring meadow at dawn. A young woman in a lavender dress and straw hat is painting on an easel under a large cherry blossom tree. Pink petals gently fall around her, and a curious white rabbit sits nearby, watching. The meadow is dotted with yellow and purple wildflowers, and a small brook winds its way through the scene. In the background, a quaint cottage with a stone chimney is nestled among rolling green hills
- Prompt
- Ghibli Art: A young boy with tousled black hair sits on a grassy hill under a dark, star-filled sky. He wears a light blue sweater and brown pants, with a small telescope set up in front of him. Around him, fireflies dance in the cool night air, adding a magical glow. A crescent moon hangs low on the horizon, and in the distance, the faint silhouette of a village is visible against the hills.
Model description for Flux-Ghibli-Art-LoRA
Image Processing Parameters
| Parameter | Value | Parameter | Value |
|---|---|---|---|
| LR Scheduler | constant | Noise Offset | 0.03 |
| Optimizer | AdamW | Multires Noise Discount | 0.1 |
| Network Dim | 64 | Multires Noise Iterations | 10 |
| Network Alpha | 32 | Repeat & Steps | 15 & 2400 |
| Epoch | 15 | Save Every N Epochs | 1 |
Labeling: florence2-en(natural language & English)
Total Images Used for Training : 20
Best Dimensions & Inference
| Dimensions | Aspect Ratio | Recommendation |
|---|---|---|
| 1280 x 832 | 3:2 | Best |
| 1024 x 1024 | 1:1 | Default |
Inference Range
- Recommended Inference Steps: 30–35
Setting Up
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Ghibli-Art-LoRA"
trigger_word = "Ghibli Art"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
Trigger words
You should use Ghibli Art to trigger the image generation.
Download models
Weights for this model are available in Safetensors format.
Download them in the Files & versions tab.