IntelligentEstate
/

OLM_Warding-JMeloy-Mittens-7B_Qwn-IQ4_NL.GGUF

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

fuzzy-mittenz commited on 7 days ago

Commit

555ccf5

•

1 Parent(s): dbd8cef

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +3 -7

README.md CHANGED Viewed

@@ -1,8 +1,6 @@
 ---
 license: apache-2.0
-base_model:
-- jeffmeloy/Qwen2.5-7B-olm-v1.0
-- Qwen/Qwen2.5-7B-Instruct
 pipeline_tag: text-generation
 language:
 - en
@@ -11,11 +9,9 @@ tags:
 - text-generation-inference
 - llama-cpp
 - gguf-my-repo
-datasets:
-- IntelligentEstate/The_Key
 ---
-# fuzzy-mittenz/Qwen2.5-7B-olm-v1.0-IQ4_NL-GGUF   TEST QAT TRAINING 2
 This model was converted to GGUF format from [`jeffmeloy/Qwen2.5-7B-olm-v1.0`](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0) for more details on the model.
@@ -57,4 +53,4 @@ Step 3: Run inference through the main binary.
 or
 ```
 ./llama-server --hf-repo fuzzy-mittenz/Qwen2.5-7B-olm-v1.0-IQ4_NL-GGUF --hf-file qwen2.5-7b-olm-v1.0-iq4_nl-imat.gguf -c 2048
-```

 ---
 license: apache-2.0
+base_model: jeffmeloy/Qwen2.5-7B-olm-v1.0
 pipeline_tag: text-generation
 language:
 - en
 - text-generation-inference
 - llama-cpp
 - gguf-my-repo
 ---
+# fuzzy-mittenz/Qwen2.5-7B-olm-v1.0-IQ4_NL-GGUF
 This model was converted to GGUF format from [`jeffmeloy/Qwen2.5-7B-olm-v1.0`](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0) for more details on the model.
 or
 ```
 ./llama-server --hf-repo fuzzy-mittenz/Qwen2.5-7B-olm-v1.0-IQ4_NL-GGUF --hf-file qwen2.5-7b-olm-v1.0-iq4_nl-imat.gguf -c 2048
+```