| library_name: transformers | |
| license: llama3 | |
| base_model: Sao10K/L3.3-70B-Euryale-v2.3 | |
| tags: | |
| - generated_from_trainer | |
| - exl2 | |
| model-index: | |
| - name: L3.3-70B-Euryale-v2.3 | |
| results: [] | |
|  | |
| # L3.3-70B-Euryale-v2.3 - EXL2 5.0bpw | |
| This is a 5.0bpw EXL2 quant of [Sao10K/L3.3-70B-Euryale-v2.3](https://huggingface.co/Sao10K/L3.3-70B-Euryale-v2.3) | |
| Details about the model can be found at the above model page. | |
| ## EXL2 Version | |
| These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library. | |
| If you have problems loading these models, please update Text Generation WebUI to the latest version. | |
| ## Perplexity Scoring | |
| Below are the perplexity scores for the EXL2 models. A lower score is better. | |
| | Quant Level | Perplexity Score | | |
| |-------------|------------------| | |
| | 5.0 | 4.5368 | | |
| | 4.5 | 4.6206 | | |
| | 4.0 | 4.7320 | | |
| | 3.5 | 5.1870 | | |
| | 3.0 | 7.1086 | | |
| | 2.75 | 9.4222 | | |
| | 2.5 | 7.0747 | | |
| | 2.25 | 8.6501 | | |