Lewdiculous commited on
Commit
5d45a80
1 Parent(s): 5f6b68d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -4,8 +4,12 @@ tags:
4
  - merge
5
  - roleplay
6
  ---
7
- This repository will host GGUF-IQ-Imatrix quantizations for [Virt-io/FuseChat-Kunoichi-10.7B](https://huggingface.co/Virt-io/FuseChat-Kunoichi-10.7B).
8
 
9
- **Quants and upload ETA:**
10
-
11
- Evening.
 
 
 
 
 
4
  - merge
5
  - roleplay
6
  ---
7
+ This repository hosts GGUF-IQ-Imatrix quantizations for [Virt-io/FuseChat-Kunoichi-10.7B](https://huggingface.co/Virt-io/FuseChat-Kunoichi-10.7B).
8
 
9
+ Uploading quants...
10
+ ```python
11
+ quantization_options = [
12
+ "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M",
13
+ "Q5_K_S", "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XS", "IQ3_XXS"
14
+ ]
15
+ ```