---
language:
  - en
  - de
  - fr
  - it
  - pt
  - hi
  - es
  - th
license: llama3.1
pipeline_tag: text-generation
tags:
  - facebook
  - meta
  - pytorch
  - llama
  - llama-3
  - gguf
  - imatrix
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
---

# Quant Infos

- needs https://github.com/ggerganov/llama.cpp/pull/8676
- just testing for now....