Qwen2.5-Coder
Collection
Gaia compatible quants for Qwen2.5-Coder models.
•
4 items
•
Updated
Qwen2.5-Coder-32B-Instruct-GGUF
Original Model
Qwen/Qwen2.5-Coder-32B-Instruct
Run with Gaianet
Prompt template
prompt template: chatml
Context size
chat_ctx_size: 128000
Run with GaiaNet
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4033
- Downloads last month
- 517
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Base model
Qwen/Qwen2.5-32B
Finetuned
Qwen/Qwen2.5-Coder-32B
Finetuned
Qwen/Qwen2.5-Coder-32B-Instruct