nm-testing
/

llama-3-instruct-w8a8-dyn-per-token-test

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

llama-3-instruct-w8a8-dyn-per-token-test

Commit History

Updated compression_config to quantization_config

6e57011
verified

mgoin commited on Oct 9

Upload folder using huggingface_hub

12a7b92
verified

robertgshaw2 commited on Jun 22

initial commit

5b8b762
verified

robertgshaw2 commited on Jun 22