shaowenchen
/

longchat-13b-16k-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

shaowenchen commited on Sep 12, 2023

Commit

da3b8cb

•

1 Parent(s): 708ac0c

minor

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -51,9 +51,9 @@ and you can view http://localhost:8000/docs to see the swagger UI.
 | Name                                     | Quant method | Compressed Size |
 | ---------------------------------------- | ------------ | --------------- |
-| `shaowenchen/longchat-13b-16k-gguf:Q2_K` | Q2_K         | 2.88 GB         |
-| `shaowenchen/longchat-13b-16k-gguf:Q3_K` | Q3_K         | 3.3 GB          |
-| `shaowenchen/longchat-13b-16k-gguf:Q4_K` | Q4_K         | 4 GB            |
 Usage:

 | Name                                     | Quant method | Compressed Size |
 | ---------------------------------------- | ------------ | --------------- |
+| `shaowenchen/longchat-13b-16k-gguf:Q2_K` | Q2_K         | 7.47 GB         |
+| `shaowenchen/longchat-13b-16k-gguf:Q3_K` | Q3_K         | 6.11 GB         |
+| `shaowenchen/longchat-13b-16k-gguf:Q4_K` | Q4_K         | 5.29 GB            |
 Usage: