LiyuanLucasLiu
/

Qwen2.5-32B-quantized.w8a8

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Qwen2.5-32B-quantized.w8a8

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

LiyuanLucasLiu's picture

Upload flashrl_config.bf16.yaml with huggingface_hub

9079e31 verified about 1 month ago

.gitattributes

1.57 kB

Upload folder using huggingface_hub 3 months ago
added_tokens.json

605 Bytes

Upload folder using huggingface_hub 3 months ago
config.json

1.78 kB

Upload folder using huggingface_hub 3 months ago
flashrl_config.bf16.yaml

91 Bytes

Upload flashrl_config.bf16.yaml with huggingface_hub about 1 month ago
flashrl_config.yaml

205 Bytes

Upload flashrl_config.yaml with huggingface_hub about 1 month ago
generation_config.json

117 Bytes

Upload folder using huggingface_hub 3 months ago
merges.txt

1.67 MB

Upload folder using huggingface_hub 3 months ago
model-00001-of-00007.safetensors

5 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00002-of-00007.safetensors

4.91 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00003-of-00007.safetensors

4.88 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00004-of-00007.safetensors

4.88 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00005-of-00007.safetensors

4.88 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00006-of-00007.safetensors

4.88 GB
LFS

Upload folder using huggingface_hub 3 months ago
model-00007-of-00007.safetensors

4.91 GB
LFS

Upload folder using huggingface_hub 3 months ago
model.safetensors.index.json

102 kB

Upload folder using huggingface_hub 3 months ago
profile.pt
Detected Pickle imports (8)
- "torch._utils._rebuild_parameter",
- "torch.HalfStorage",
- "torch.CharStorage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.int8",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16"
How to fix it?
68.1 MB
LFS

Upload profile.pt with huggingface_hub about 1 month ago
recipe.yaml

724 Bytes

Upload folder using huggingface_hub 3 months ago
special_tokens_map.json

616 Bytes

Upload folder using huggingface_hub 3 months ago
tokenizer.json

11.4 MB
LFS

Upload folder using huggingface_hub 3 months ago
tokenizer_config.json

7.26 kB

Upload folder using huggingface_hub 3 months ago
vocab.json

2.78 MB

Upload folder using huggingface_hub 3 months ago