Hugging Face's logo

OwenArli
/
ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-4bpw-exl2

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
exl2
Model card Files Community
Awan LLM commited on
Commit
2d96571
•
1 Parent(s): ca25125

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -49,15 +49,17 @@ Instruct format:
49
 
50
  Quants:
51
 
52
- GGUF: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-GGUF
 
 
53
 
54
  FP16: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin
55
 
56
  Exllamav2:
57
 
58
- 4bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-exl2-h8-4bpw-exl2
59
 
60
- 8bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-exl2-h8-8bpw-exl2
61
 
62
 
63
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 
49
 
50
  Quants:
51
 
52
+ AWQ: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-AWQ
53
+
54
+ GGUF: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF
55
 
56
  FP16: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin
57
 
58
  Exllamav2:
59
 
60
+ 4bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-4bpw-exl2
61
 
62
+ 8bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-8bpw-exl2
63
 
64
 
65
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)