Hugging Face's logo

nintwentydo
/
Razorback-12B-v0.2-exl2-8.0bpw

Image-Text-to-Text
Transformers
llava
mergekit
Merge
multimodal
mistral
pixtral
conversational
Inference Endpoints
8-bit precision
exl2
Model card Files Community
nintwentydo commited on
Commit
83cf8b8
·
verified ·
1 Parent(s): 22ae0f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -52,4 +52,14 @@ Use the included chat template (Mistral). No chatml support yet.
52
  ## Credits
53
  - Mistral for [mistralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)
54
  - Unsloth for [unsloth/Pixtral-12B-2409](https://huggingface.co/unsloth/Pixtral-12B-2409) transformers conversion
55
- - TheDrummer for [TheDrummer/UnslopNemo-12B-v3](https://huggingface.co/TheDrummer/UnslopNemo-12B-v3)
 
 
 
 
 
 
 
 
 
 
 
52
  ## Credits
53
  - Mistral for [mistralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)
54
  - Unsloth for [unsloth/Pixtral-12B-2409](https://huggingface.co/unsloth/Pixtral-12B-2409) transformers conversion
55
+ - TheDrummer for [TheDrummer/UnslopNemo-12B-v3](https://huggingface.co/TheDrummer/UnslopNemo-12B-v3)
56
+
57
+
58
+ ## Available Sizes
59
+ | Repo | Bits | Head Bits | Size |
60
+ | ----------- | ------ | ------ | ------ |
61
+ | [nintwentydo/Razorback-12B-v0.2-exl2-4.0bpw](https://huggingface.co/nintwentydo/Razorback-12B-v0.2-exl2-4.0bpw) | 4.0 | 6.0 | 8.19 GB |
62
+ | [nintwentydo/Razorback-12B-v0.2-exl2-5.0bpw](https://huggingface.co/nintwentydo/Razorback-12B-v0.2-exl2-5.0bpw) | 5.0 | 6.0 | 9.54 GB |
63
+ | [nintwentydo/Razorback-12B-v0.2-exl2-6.0bpw](https://huggingface.co/nintwentydo/Razorback-12B-v0.2-exl2-6.0bpw) | 6.0 | 8.0 | 11.1 GB |
64
+ | [nintwentydo/Razorback-12B-v0.2-exl2-8.0bpw](https://huggingface.co/nintwentydo/Razorback-12B-v0.2-exl2-8.0bpw) | 8.0 | 8.0 | 13.7 GB |
65
+