GGUF LLaMa-3.1-8B-Instruct-Based OQ8_0.EF32 IQuants - a Joseph717171 Collection

Joseph717171 's Collections

GGUF Llama-3.2-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0 IQuants

GGUF LLaMa-3.1-8B-Instruct-Based OQ8_0.EF32 IQuants

GGUF Mistral-Nemo-2407-Instruct OQ8_0.EF32 IQuants

GGUF LLaMa-3.1-8B-Instruct-Based OQ8_0.EF32 IQuants

updated 28 days ago

Custom GGUF quants of Llama-3.1-8B-Instruct fine-tunes, where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. 🧠🔥🚀

Joseph717171/Hermes-3-Llama-3.1-8B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Updated about 21 hours ago • 266 • 1
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Updated about 18 hours ago • 577 • 2
Joseph717171/Hermes-3-Llama-3.1-8B_TIES_with_base_Embeds_Initialized_dtypeF32-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Updated 28 days ago • 407 • 1