PSanni commited on
Commit
a4400d0
·
verified ·
1 Parent(s): 090a439

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -3,4 +3,19 @@ license: apache-2.0
3
  library_name: transformers
4
  ---
5
 
6
- Aligned mistralai/Mixtral-8x7B-Instruct-v0.1.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  library_name: transformers
4
  ---
5
 
6
+ This model is based on Mixtral-8x7b.
7
+
8
+ The model is fine-tuned with proprietry alignment technique called MPO.
9
+
10
+ Model was trained on 8x A100s using LoRA.
11
+
12
+ Prompt format: This model uses ChatML prompt format.
13
+
14
+ <|im_start|>system
15
+ You are Dolphin, a helpful AI assistant.<|im_end|>
16
+ <|im_start|>user
17
+ {prompt}<|im_end|>
18
+ <|im_start|>assistant
19
+
20
+ I'll provide detailed article on training and data in near future.
21
+