metadata

license: other
base_model: FLUX.1-dev
tags:
  - flux
  - flux-diffusers
  - text-to-image
  - diffusers
  - simpletuner
  - not-for-all-audiences
  - lora
  - template:sd-lora
  - lycoris
inference: true

growwithdaisy/dsycam_20241115_133438

This is a LyCORIS adapter derived from FLUX.1-dev.

The main validation prompt used during training was:

a photo of a daisy

Validation settings

CFG: 3.5
CFG Rescale: 0.0
Steps: 20
Sampler: None
Seed: 69
Resolution: 1024x1024

Note: The validation settings are not necessarily the same as the training settings.

Prompt
unconditional (blank prompt)

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo architecture photography style, dsycam, The image shows the interior of a store with a modern and minimalist design. The walls are covered in gray tiles and the floor is made of concrete. On the left side of the image, there is a wooden counter with a white sink and a wooden cabinet.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo architecture photography style, dsycam, The image shows a modern bathroom with a minimalist design. The walls are painted in a light grey color and the floor is made of dark wood. On the left side of the image, there is a large rectangular countertop with a white countertop and a gold-colored faucet.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo architecture photography style, dsycam, The image shows an empty room with a large window on the left side, allowing natural light to enter the space. The room has a concrete floor and walls, and the ceiling is made of concrete. On the right side of the room, there is a white desk with a lamp on it.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo art photography style, dsycam, The image is a black and white photograph of an empty room with a white wall and floor. In the center of the image, and the floor is made of concrete., glossy surface. The background is plain white, rectangular frame with a smooth, there is a rectangular white panel hanging on the wall. The panel appears to be made of a thin

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo art photography style, dsycam, The image shows an empty white room with six black frames hanging on the wall. The frames are arranged in a row and are of different sizes and shapes. The room has a high ceiling with white walls and flooring, and the floor is made of white tiles.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo art photography style, dsycam, The image shows an empty room with white walls and floor. The room has a high ceiling with recessed lighting and a white floor. On the left side of the room, one on the right side and one in the center. The panels are blank, there are two large white panels hanging on the wall, with no other objects or decorations visible.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo furniture photography style, dsycam, The image shows a pair of wooden chairs in an empty room with white walls and floor. The chairs are made of light-colored wood and have a simple, minimalist design. They have a curved backrest and armrests, and the legs are slightly tapered and tapered.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo furniture photography style, dsycam, The image shows a modern wooden chair and a small table in a room with white walls and floor. The chair is made of light-colored wood and has a simple design with a curved backrest and armrests. It has a light pink cushion on the left side and a wooden frame with four legs.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo furniture photography style, dsycam, The image shows two wooden chairs in a white room with a white wall in the background. The chairs are made of light-colored wood and have a modern design with a curved backrest and armrests. The seat and backrests are upholstered in a soft pink fabric, and the legs are slightly tapered and tapered.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo furniture photography style, dsycam, The image shows a wooden shelf attached to a white wall in an empty room. The shelf is made of a light-colored wood and has a rectangular shape with a flat top and a flat bottom. It appears to be made of plywood or a similar material, possibly plywood, and is attached to the wall with screws or nails.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo homewares photography style, dsycam, The image shows a small glass dropper bottle with a black dropper cap and a white box with the brand name "Zuri" written on it. The bottle is placed next to the box, which is also white and has a label on it that reads "Aroma Zuri". The background is plain white.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo homewares photography style, dsycam, The image shows a modern and minimalistic interior design of a room with a wooden chair in the center. The chair is made of light-colored wood and has a curved backrest and armrests. It is placed against a gray wall with a white shelf on the right side.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo homewares photography style, dsycam, The image is a photograph of a dropper bottle with a black cap and a white label. The label has the brand name "Art/Aroma" written in bold black letters at the top, followed by the word "Illuminate" in smaller black letters.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo homewares photography style, dsycam, The image is a 3D rendering of a tall, rectangular object with a white background. It appears to be made of a thin, white material, possibly paper or cardboard, and is standing upright on a plain white surface. The object has a vertical shape with a flat top and a flat bottom.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo interiors photography style, dsycam, The image shows a modern and minimalist bedroom with a large bed in the center. The bed has a gray headboard and a white bedspread with two white pillows on top. The headboard is upholstered in a dark grey fabric and has a tufted design.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo interiors photography style, dsycam, The image is of a modern and minimalist bathroom with a minimalist design. The bathroom has a white color scheme with black and white accents. The floor is made of marble tiles and the walls are covered in white tiles. On the left side of the image, there is a large glass shower enclosure with a glass door that leads to a walk-in shower.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo interiors photography style, dsycam, The image shows a modern and minimalist living room with a large window on the left side. The window has a sliding glass door that leads to a balcony with a view of trees and greenery outside. The room has white walls and flooring, and there is a large gray sofa in the center of the room.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo interiors photography style, dsycam, The image shows a modern living room with a large window on the left side. The window has a view of the countryside and the sky. On the right side of the room, there is a large gray sectional sofa with a black floor lamp on top. The sofa is placed in front of a fireplace with a white marble surround.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo lights photography style, dsycam, The image is a black and white photograph of a modern floor lamp. The lamp has a curved, curved shape with a white base and a black wire extending from the top to the bottom. The base of the lamp is made of a smooth, glossy material and has a small, round light bulb attached to it.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo lights photography style, dsycam, The image is a 3D rendering of a modern, minimalist table lamp. The lamp is made of a white, cylindrical material with a round base and a tall, slender stem. The base is also white and has a smooth, flat surface. The top of the lamp has a curved, oval-shaped shade that extends upwards towards the ceiling.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo lights photography style, dsycam, The image shows a white wall with a white tiled wall and a white shelf attached to it. The shelf is made up of small square tiles arranged in a grid-like pattern, with a silver metal frame on the right side. On the left side of the shelf, there is a small white wall sconce with a gold-colored metal bracket.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo lights photography style, dsycam, The image is a black and white abstract photograph of a curved surface. The surface appears to be made of a smooth, glossy material, possibly paper or fabric, and is a light grey color. The background is a solid white color, and the image is taken from a slightly angled perspective, creating a sense of depth and dimension.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo mood photography style, dsycam, The image shows a modern, minimalist white house with a large garage door on the left side. The house is located on a street with a clear blue sky in the background. The garage door is closed and has a wooden door in the center.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo mood photography style, dsycam, The image shows a modern two-story building with a unique architectural design. The building is made of concrete and has a black exterior with a triangular shape. The exterior of the building is covered with large windows and a large glass window on the second floor.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo mood photography style, dsycam, The image shows a modern bathroom sink with a white countertop and a round white vessel sink. The sink is placed on a gray countertop with a gray marble countertop. Above the sink, there is a large rectangular mirror hanging on the wall with a black frame. The mirror is made of a light grey material and has a textured surface.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo mood photography style, dsycam, The image is a black and white photograph of a modern interior space with concrete walls and flooring. The room has a high ceiling with exposed pipes and a large window on the right side, allowing natural light to enter the space. On the left side of the image, there is a long, rectangular table with a black bench in front of it.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo technology photography style, dsycam, The image shows a young man sitting on a wooden chair with his arms crossed. He is wearing a light green long-sleeved t-shirt and a pair of sunglasses. His hair is styled in a short, slicked-back cut and he is looking off to the side with a serious expression on his face.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo technology photography style, dsycam, The image is a 3D rendering of a modern, minimalist device with a white color scheme. It appears to be a small, rectangular box-like structure with a rectangular base and a rectangular top. The top of the box is covered in small, square-shaped panels with a grid-like pattern.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo technology photography style, dsycam, The image shows a pair of black-framed eyeglasses resting on a white circular surface. The glasses have a sleek and modern design with a thin metal frame and a black bridge. The arms of the glasses are curved and have a simple, minimalist look. The lenses are round and appear to be made of clear glass.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo technology photography style, dsycam, The image is a close-up portrait of a young African-American woman wearing a pair of black-framed glasses. She is facing the camera with a serious expression on her face. Her hair is styled in a sleek updo and she is wearing a beige top.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo wearables photography style, dsycam, The image is a close-up of a wristwatch with a square-shaped face. The watch has a black strap with a silver buckle on the right side. The face of the watch is white with black numbers and hands, and there is a small black hour hand at the 3 o'clock position.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo wearables photography style, dsycam, The image is a close-up of a wristwatch with a black strap. The watch has a unique design with a hexagonal shape and a silver-colored dial. The dial has a circular shape with a spiral design in the center, which appears to be a mechanical movement.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo wearables photography style, dsycam, The image shows an aerial view of a large swimming pool on a rocky cliff overlooking the ocean. The pool is rectangular in shape and has a blue-green color. There are several people in the pool, some of whom are swimming and some are sitting on the beach. The water is crystal clear and the rocks around the pool are jagged and rocky.

Negative Prompt
blurry, cropped, ugly

Prompt
mnmlssmo wearables photography style, dsycam, The image is a digital illustration of a wristwatch with a black strap. The watch face is square in shape and has a white background with black numbers and hands. The hands of the watch are black and the numbers are in a modern, minimalist design.

Negative Prompt
blurry, cropped, ugly

Prompt
a photo of a daisy

Negative Prompt
blurry, cropped, ugly

The text encoder was not trained. You may reuse the base model text encoder for inference.

Training settings

Training epochs: 0
Training steps: 500
Learning rate: 0.0001
Max grad norm: 2.0
Effective batch size: 16
- Micro-batch size: 2
- Gradient accumulation steps: 1
- Number of GPUs: 8
Prediction type: flow-matching (extra parameters=['shift=3', 'flux_guidance_value=1.0'])
Rescaled betas zero SNR: False
Optimizer: optimi-stableadamwweight_decay=1e-3
Precision: Pure BF16
Quantised: No
Xformers: Not used
LyCORIS Config:

{
    "algo": "lokr",
    "multiplier": 1,
    "linear_dim": 1000000,
    "linear_alpha": 1,
    "factor": 12,
    "init_lokr_norm": 0.001,
    "apply_preset": {
        "target_module": [
            "FluxTransformerBlock",
            "FluxSingleTransformerBlock"
        ],
        "module_algo_map": {
            "Attention": {
                "factor": 12
            },
            "FeedForward": {
                "factor": 6
            }
        }
    }
}

Datasets

mnmlsmo_architecture_photography_style-512

Repeats: 0
Total number of images: ~10456
Total number of aspect buckets: 7
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_architecture_photography_style-768

Repeats: 0
Total number of images: ~9000
Total number of aspect buckets: 10
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_architecture_photography_style-1024

Repeats: 2
Total number of images: ~3960
Total number of aspect buckets: 1
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_art_photography_style-512

Repeats: 0
Total number of images: ~448
Total number of aspect buckets: 6
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_art_photography_style-768

Repeats: 0
Total number of images: ~416
Total number of aspect buckets: 7
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_art_photography_style-1024

Repeats: 1
Total number of images: ~232
Total number of aspect buckets: 9
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_furniture_photography_style-512

Repeats: 0
Total number of images: ~3888
Total number of aspect buckets: 13
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_furniture_photography_style-768

Repeats: 0
Total number of images: ~3352
Total number of aspect buckets: 13
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_furniture_photography_style-1024

Repeats: 1
Total number of images: ~1728
Total number of aspect buckets: 4
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_homewares_photography_style-512

Repeats: 0
Total number of images: ~1096
Total number of aspect buckets: 6
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_homewares_photography_style-768

Repeats: 0
Total number of images: ~1072
Total number of aspect buckets: 3
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_homewares_photography_style-1024

Repeats: 1
Total number of images: ~520
Total number of aspect buckets: 2
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_interiors_photography_style-512

Repeats: 0
Total number of images: ~1336
Total number of aspect buckets: 4
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_interiors_photography_style-768

Repeats: 0
Total number of images: ~1312
Total number of aspect buckets: 5
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_interiors_photography_style-1024

Repeats: 1
Total number of images: ~800
Total number of aspect buckets: 1
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_lighting_photography_style-512

Repeats: 0
Total number of images: ~504
Total number of aspect buckets: 5
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_lighting_photography_style-768

Repeats: 0
Total number of images: ~504
Total number of aspect buckets: 5
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_lighting_photography_style-1024

Repeats: 0
Total number of images: ~320
Total number of aspect buckets: 4
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_moods_photography_style-512

Repeats: 0
Total number of images: ~680
Total number of aspect buckets: 3
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_moods_photography_style-768

Repeats: 0
Total number of images: ~680
Total number of aspect buckets: 3
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_moods_photography_style-1024

Repeats: 1
Total number of images: ~352
Total number of aspect buckets: 2
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_technology_photography_style-512

Repeats: 0
Total number of images: ~680
Total number of aspect buckets: 4
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_technology_photography_style-768

Repeats: 0
Total number of images: ~680
Total number of aspect buckets: 4
Resolution: 0.589824 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

mnmlsmo_technology_photography_style-1024

Repeats: 1
Total number of images: ~376
Total number of aspect buckets: 3
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None
Used for regularisation data: No

Inference

import torch
from diffusers import DiffusionPipeline
from lycoris import create_lycoris_from_weights


def download_adapter(repo_id: str):
    import os
    from huggingface_hub import hf_hub_download
    adapter_filename = "pytorch_lora_weights.safetensors"
    cache_dir = os.environ.get('HF_PATH', os.path.expanduser('~/.cache/huggingface/hub/models'))
    cleaned_adapter_path = repo_id.replace("/", "_").replace("\\", "_").replace(":", "_")
    path_to_adapter = os.path.join(cache_dir, cleaned_adapter_path)
    path_to_adapter_file = os.path.join(path_to_adapter, adapter_filename)
    os.makedirs(path_to_adapter, exist_ok=True)
    hf_hub_download(
        repo_id=repo_id, filename=adapter_filename, local_dir=path_to_adapter
    )

    return path_to_adapter_file
    
model_id = 'FLUX.1-dev'
adapter_repo_id = 'playerzer0x/growwithdaisy/dsycam_20241115_133438'
adapter_filename = 'pytorch_lora_weights.safetensors'
adapter_file_path = download_adapter(repo_id=adapter_repo_id)
pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16) # loading directly in bf16
lora_scale = 1.0
wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_file_path, pipeline.transformer)
wrapper.merge_to()

prompt = "a photo of a daisy"


## Optional: quantise the model to save on vram.
## Note: The model was not quantised during training, so it is not necessary to quantise it during inference time.
#from optimum.quanto import quantize, freeze, qint8
#quantize(pipeline.transformer, weights=qint8)
#freeze(pipeline.transformer)
    
pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') # the pipeline is already in its target precision level
image = pipeline(
    prompt=prompt,
    num_inference_steps=20,
    generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
    width=1024,
    height=1024,
    guidance_scale=3.5,
).images[0]
image.save("output.png", format="PNG")