File size: 1,348 Bytes
ee2441e
64dedd7
 
 
 
 
 
 
ee2441e
64dedd7
 
 
6bae04c
64dedd7
 
 
 
 
 
 
6bae04c
 
 
 
 
 
 
 
 
64dedd7
 
 
 
 
 
6bae04c
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
license: openrail++
language:
  - en
tags:
  - stable-diffusion
  - tensorrt
  - text-to-image
---

# Stable Diffusion XL 1.0 TensorRT

### Introduction
This repository contains Stable Diffusion XL 1.0 ONNX models compatible with TensorRT.

Source models:
- [SDXL base 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0)
- [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0)


### Benchmark

Timings at 1024x1024
|      | CLIP    | UNet 40 steps | VAE decode | Pipline     | Throughput   |
|------|---------|---------------|------------|-------------|--------------|
| A10  | 8.98 ms | 12576.53 ms   | 0.00 ms    | 12588.26 ms | 0.08 image/s |
| A100 | 5.99 ms | 3358.87 ms    | 0.00 ms    | 3367.04 ms  | 0.30 image/s |
| H100 | 4.70 ms | 1772.29 ms    | 0.00 ms    | 1779.01 ms  | 0.56 image/s |

### Model Description

- **Developed by:** Stability AI
- **Model type:** Diffusion-based text-to-image generative model
- **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md)
- **Model Description:** This is a conversion of the [Stable Diffusion XL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference