Adarsh Shirawalmath commited on
Commit
b88f515
1 Parent(s): eb41f76

Update mistral/README.md (#647)

Browse files
Files changed (1) hide show
  1. examples/mistral/README.md +12 -0
examples/mistral/README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ **Mistral 7B** is a language model with a total of 7.3 billion parameters, showcasing a notable performance across a variety of benchmarks.
2
+
3
+ Fine Tune:
4
+ ```shell
5
+ accelerate launch -m axolotl.cli.train examples/mistral/config.yml
6
+
7
+ ```
8
+
9
+ If you run into CUDA OOM, use deepspeed with config zero2.json:
10
+ ```shell
11
+ accelerate launch -m axolotl.cli.train examples/mistral/config.yml --deepspeed deepspeed/zero2.json
12
+ ```