File size: 477 Bytes
0bb08a5
a88feab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0bb08a5
a88feab
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---

license: other
license_name: eva-llama3.3
language:
- en
- fr
- it
- pt
- hi
- es
- th
- de
base_model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---


4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [EVA-LLaMA-3.33-70B-v0.0](https://huggingface.co/EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0) for inference with the [Private LLM](https://privatellm.app/) app.