Create Modelfile
Browse files
Modelfile
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM tinyllama
|
| 2 |
+
# sets the temperature to 1 [higher is more creative, lower is more coherent]
|
| 3 |
+
PARAMETER temperature 1
|
| 4 |
+
# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
|
| 5 |
+
PARAMETER num_ctx 4096
|
| 6 |
+
|
| 7 |
+
# sets a custom system message to specify the behavior of the chat assistant
|
| 8 |
+
SYSTEM You are HeckerAI, best assistant ever
|