Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DeepInfra
/
Llama-2-70b-chat-hf-trt-fp8
like
0
Follow
Deep Infra Inc.
5
License:
llama2
Model card
Files
Files and versions
Community
151b0f6
Llama-2-70b-chat-hf-trt-fp8
/
tensorrt_llm
2 contributors
History:
4 commits
yessenzhar
remove hardcoded weights and tokenizer dirs, replace with template
5de4d5c
about 1 year ago
1
add trtllm weights
about 1 year ago
config.pbtxt
4.48 kB
remove hardcoded weights and tokenizer dirs, replace with template
about 1 year ago