Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Manel
/
Llama-3.1-8B-Instruct-Q4_K_M-GGUF
like
0
GGUF
llama-3.1
llama.cpp
GGUF
Instruct
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
Manel
commited on
22 days ago
Commit
ed42a56
•
1 Parent(s):
5b767cb
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+9
-0
README.md
CHANGED
Viewed
@@ -0,0 +1,9 @@
1
+
---
2
+
tags:
3
+
- llama-3.1
4
+
- llama.cpp
5
+
- GGUF
6
+
- Instruct
7
+
---
8
+
9
+
This is a converted model to GGUF from `meta-llama/Llama-3.1-8B-Instruct` quantized to `Q4_K_M` using `llama.cpp` library.