briaai/FIBO-VLM-prompt-to-JSON

BriaFibo Gemini Prompt to JSON

This is a modular pipeline block that converts a prompt to a JSON object using the FIBO-VLM model.

Usage

from diffusers.modular_pipelines import ModularPipeline

pipeline = ModularPipeline.from_pretrained("briaai/FIBO-VLM-prompt-to-JSON", trust_remote_code=True)
# Generate - short text to JSON
output = pipeline(prompt="A beautiful sunset over a calm ocean")
print(output)

# Refine - JSON+instruction to JSON
output = pipeline(
    json_prompt=your_json_prompt, prompt="make the owl brown"
)

# Inspire - Image+instruction to JSON
output = pipeline(
    image=your_image, prompt="your prompt"
)

# Inspirt - Image to JSON
pipeline(
    image=your_image
)

Inputs

• prompt: A string prompt to convert to a JSON object.

Outputs

• json_prompt: A JSON object representing the prompt.