Qwen2.5-7B-Instruct-1M-GGUF

Original Model

Qwen/Qwen2.5-7B-Instruct-1M

Run with Gaianet

Prompt template

prompt template: chatml

Context size

chat_ctx_size: 1010000 (generation 8192 tokens)

Run with GaiaNet

• Quick start: https://docs.gaianet.ai/node-guide/quick-start

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b4466