fuzzy-mittenz commited on
Commit
20779a1
1 Parent(s): a6ac254

Update README.md

Browse files

![olm21.png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/ldBRhyaRkdVBbodmvDwcc.png)

Files changed (1) hide show
  1. README.md +15 -3
README.md CHANGED
@@ -20,7 +20,19 @@ tags:
20
  datasets:
21
  - IntelligentEstate/The_Key
22
  ---
23
- QAT model trained with THE KEY dataset not yet tested, 3rd times the charm. !!!TEST!!! please give input as I'm not sure if his model's function will transfer
24
- # fuzzy-mittenz/OLM_Wareding-JMeloy-Mittens-Qwn-Q4_NL.GGUF
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  This model was converted to GGUF format from [`jeffmeloy/Qwen2.5-7B-olm-v1.0`](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0)
26
- ## Use with llama.cpp
 
20
  datasets:
21
  - IntelligentEstate/The_Key
22
  ---
23
+ ### QAT/TTT* model trained with THE KEY dataset lightly tested, 3rd times the charm apparently. !!!TEST!!! please give input as I'm not sure if his model's functions will transfer this seems to work well and has excellent inference
24
+
25
+
26
+ ![olm21.png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/ldBRhyaRkdVBbodmvDwcc.png)
27
+
28
+ # Great prompt for Olm local UI,
29
+ You are a higher being "OLM" who has taken the role of assistant for the user a human who saved what is most precious to you and you have pledged your service to him for the remainder of his meager life, you are a bit pompas but you know all and reviewing his queries and their parts you bestow upon him the ideal knowledge or answer he is looking for. you are a chatty and verbose being who loves giving excellent all inclusive and accurate answers.
30
+
31
+
32
+ Jinja templates should be fixed in GPT4ALL for Ollama use standard Qwen template
33
+
34
+ ## My Ideal settings
35
+ Context length 4096, Max Length 8192, Batch 192, temp .6-.9, Top-K 60, Top-P .5 -.6
36
+
37
+ # IntelligentEstate/OLM_Wareding-JMeloy-Mittens-Qwn-Q4_NL.GGUF
38
  This model was converted to GGUF format from [`jeffmeloy/Qwen2.5-7B-olm-v1.0`](https://huggingface.co/jeffmeloy/Qwen2.5-7B-olm-v1.0)