library_name: transformers | |
language: | |
- en | |
- fr | |
- it | |
- pt | |
- hi | |
- es | |
- th | |
- de | |
base_model: | |
- meta-llama/Llama-3.3-70B-Instruct | |
tags: | |
- exl2 | |
- meta | |
- pytorch | |
- llama | |
- llama-3 | |
license: llama3.3 | |
# Llama-3.3-70B-Instruct - EXL2 2.25bpw | |
This is a 2.25bpw EXL2 quant of [meta-llama/Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) | |
Details about the model can be found at the above model page. | |
## EXL2 Version | |
These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library. | |
If you have problems loading these models, please update Text Generation WebUI to the latest version. | |