update docs [skip ci] (#1176)
Browse files
README.md
CHANGED
@@ -1,6 +1,3 @@
|
|
1 |
-
## What's New
|
2 |
-
- Added `Mistral-7b-example`: A comprehensive example for fine-tuning Mistral-7b model. [Check it out here](https://github.com/Tilemachoc/axolotl/tree/mistral-7b-example/examples/mistral/Mistral-7b-example).
|
3 |
-
|
4 |
# Axolotl
|
5 |
|
6 |
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
@@ -108,6 +105,9 @@ pip3 install -e '.[flash-attn,deepspeed]'
|
|
108 |
|
109 |
### Usage
|
110 |
```bash
|
|
|
|
|
|
|
111 |
# finetune lora
|
112 |
accelerate launch -m axolotl.cli.train examples/openllama-3b/lora.yml
|
113 |
|
|
|
|
|
|
|
|
|
1 |
# Axolotl
|
2 |
|
3 |
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
|
|
105 |
|
106 |
### Usage
|
107 |
```bash
|
108 |
+
# preprocess datasets - optional but recommended
|
109 |
+
CUDA_VISIBLE_DEVICES="" python -m axolotl.cli.preprocess examples/openllama-3b/lora.yml
|
110 |
+
|
111 |
# finetune lora
|
112 |
accelerate launch -m axolotl.cli.train examples/openllama-3b/lora.yml
|
113 |
|