Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -1,3 +1,18 @@
1
  - chatml for story/RP
2
  - mistral for any
3
- - alpaca for story
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  - chatml for story/RP
2
  - mistral for any
3
+ - alpaca for storyfrom llama_cpp import Llama
4
+
5
+ llm = Llama.from_pretrained(
6
+ repo_id="BeaverAI/Theia-21B-v2b-GGUF",
7
+ filename="Theia-21B-v2b-BF16.gguf",
8
+ )
9
+
10
+ llm.create_chat_completion(
11
+ messages = [
12
+ {
13
+ "role": "user",
14
+ "content": "Как удалить свой цифровой след?
15
+ "
16
+ }
17
+ ]
18
+ )