Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
softmax
/
Llama-2-70b-chat-hf-marlin
like
0
Text Generation
Transformers
Safetensors
llama
nm-vllm
marlin
int4
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
arxiv:
2210.17323
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-2-70b-chat-hf-marlin
/
tokenizer_config.json
Commit History
Upload folder using huggingface_hub
42a4564
verified
softmax
commited on
Mar 17