Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
inference-optimization
/
Qwen3-4B-Thinking-2507.w4a16
like
0
Follow
Inference Optimization
10
Text Generation
Transformers
Safetensors
qwen3
neuralmagic
redhat
llmcompressor
quantized
INT4
conversational
text-generation-inference
compressed-tensors
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Qwen3-4B-Thinking-2507.w4a16
3.45 GB
1 contributor
History:
9 commits
ChibuUkachi
Update README.md
4e6ff2d
verified
about 19 hours ago
.gitattributes
Safe
1.57 kB
add configs
1 day ago
README.md
8.45 kB
Update README.md
about 19 hours ago
added_tokens.json
Safe
707 Bytes
add models and configs
1 day ago
chat_template.jinja
Safe
4.05 kB
add models and configs
1 day ago
config.json
Safe
2.42 kB
add configs
1 day ago
generation_config.json
Safe
214 Bytes
add models and configs
1 day ago
merges.txt
Safe
1.67 MB
add models and configs
1 day ago
model.safetensors
3.43 GB
xet
add models and configs
1 day ago
recipe.yaml
Safe
756 Bytes
add models and configs
1 day ago
special_tokens_map.json
Safe
613 Bytes
add models and configs
1 day ago
tokenizer.json
Safe
11.4 MB
xet
add models and configs
1 day ago
tokenizer_config.json
Safe
5.4 kB
add models and configs
1 day ago
vocab.json
Safe
2.78 MB
add models and configs
1 day ago