Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-Chat-v1.0-W8A8-e2e

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
compressed-tensors
Model card Files Community
TinyLlama-1.1B-Chat-v1.0-W8A8-e2e
File size: 129 Bytes 
c8fd9bd
 
 
 
 
 
 
1
2
3
4
5
6
7
 
DEFAULT_stage:
  DEFAULT_modifiers:
    QuantizationModifier:
      ignore: [lm_head]
      targets: [Linear]
      scheme: W8A8