Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,27 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
base_model: fal/AuraFlow-v0.3
|
4 |
+
base_model_relation: quantized
|
5 |
+
---
|
6 |
+
|
7 |
+
|
8 |
+
FP8 quantized version of [AuraFlow v0.3](fal/AuraFlow-v0.3)
|
9 |
+
|
10 |
+
## Quantization
|
11 |
+
|
12 |
+
```py
|
13 |
+
import torch
|
14 |
+
from huggingface_hub import cached_download
|
15 |
+
from safetensors.torch import load_file, save_file
|
16 |
+
|
17 |
+
ckpt_path = cached_download(
|
18 |
+
"https://huggingface.co/fal/AuraFlow-v0.3/resolve/main/aura_flow_0.3.safetensors",
|
19 |
+
)
|
20 |
+
|
21 |
+
state_dict = load_file(ckpt_path)
|
22 |
+
|
23 |
+
for key, value in state_dict.items():
|
24 |
+
state_dict[key] = value.to(torch.float8_e4m3fn)
|
25 |
+
|
26 |
+
save_file(state_dict, "./aura_flow_0.3.float8_e4m3fn.safetensors")
|
27 |
+
```
|