Compressa-Qwen2.5-14B-Instruct / compressa-config.json
gmorgachev's picture
Upload folder using huggingface_hub
83836ef verified
raw
history blame contribute delete
219 Bytes
{
"model_name": "Compressa-Qwen2.5-14B-Instruct",
"torch_dtype": "torch.float16",
"device_map": "auto",
"trust_remote_code": false,
"backends": ["lmdeploy", "vllm"],
"config_class": "HFConfig"
}