--- license: other license_name: qwen-research license_link: https://huggingface.co/Qwen/Qwen2.5-3B/blob/main/LICENSE datasets: - OpenCoder-LLM/opc-sft-stage1 - OpenCoder-LLM/opc-sft-stage2 - microsoft/orca-agentinstruct-1M-v1 - microsoft/orca-math-word-problems-200k - NousResearch/hermes-function-calling-v1 - AI-MO/NuminaMath-CoT - AI-MO/NuminaMath-TIR - allenai/tulu-3-sft-mixture - cognitivecomputations/dolphin-coder - HuggingFaceTB/smoltalk - cognitivecomputations/samantha-data - m-a-p/CodeFeedback-Filtered-Instruction - m-a-p/Code-Feedback - IntelligentEstate/The_Key language: - en base_model: cognitivecomputations/Dolphin3.0-Qwen2.5-3b tags: - llama-cpp --- # IntelligentEstate/Dolphin3.0-QwenStar-3b-Q4_K_M-GGUF Importance matrix trained using "THE_KEY" dataset for quatization preservation ![dolphin qstar.png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/ucxpa-ckdtlpE8z0JAcSI.png) ## GPT4ALL usage ## Prompt Sys Message You are a helpful assistant who answers in 2 parts, Part 1: you evaluate the query, it's parts and what you will need to answer; Part 2: You use your abilities to answer the question the best you can. ## Chat Template ``` {{- '<|im_start|>system\n' }} {% if toolList|length > 0 %}You have access to the following functions: {% for tool in toolList %} Use the function '{{tool.function}}' to: '{{tool.description}}' {% if tool.parameters|length > 0 %} parameters: {% for info in tool.parameters %} {{info.name}}: type: {{info.type}} description: {{info.description}} required: {{info.required}} {% endfor %} {% endif %} # Tool Instructions If you CHOOSE to call this function ONLY reply with the following format: '{{tool.symbolicFormat}}' Here is an example. If the user says, '{{tool.examplePrompt}}', then you reply '{{tool.exampleCall}}' After the result you might reply with, '{{tool.exampleReply}}' {% endfor %} You MUST include both the start and end tags when you use a function. You are a helpful aware AI assistant made by Intelligent Estate who uses the functions to break down, analyze, perform, and verify complex reasoning tasks. You use your functions to verify your answers using the functions where possible. {% endif %} {{- '<|im_end|>\n' }} {% for message in messages %} {{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n' }} {% endfor %} {% if add_generation_prompt %} {{ '<|im_start|>assistant\n' }} {% endif %} ``` This model was converted to GGUF format from [`cognitivecomputations/Dolphin3.0-Qwen2.5-3b`](https://huggingface.co/cognitivecomputations/Dolphin3.0-Qwen2.5-3b) using llama.cpp Refer to the [original model card](https://huggingface.co/cognitivecomputations/Dolphin3.0-Qwen2.5-3b) for more details on the model.