document that packaging needs to be installed before flash-attn (#559)
Browse files
README.md
CHANGED
@@ -71,6 +71,7 @@ Get started with Axolotl in just a few steps! This quickstart guide will walk yo
|
|
71 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
72 |
cd axolotl
|
73 |
|
|
|
74 |
pip3 install -e .[flash-attn]
|
75 |
pip3 install -U git+https://github.com/huggingface/peft.git
|
76 |
|
@@ -105,6 +106,7 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
|
|
105 |
|
106 |
3. Install axolotl along with python dependencies
|
107 |
```bash
|
|
|
108 |
pip3 install -e .[flash-attn]
|
109 |
```
|
110 |
|
@@ -140,7 +142,8 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
|
|
140 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
141 |
cd axolotl
|
142 |
|
143 |
-
pip3 install
|
|
|
144 |
pip3 install protobuf==3.20.3
|
145 |
pip3 install -U --ignore-installed requests Pillow psutil scipy
|
146 |
```
|
|
|
71 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
72 |
cd axolotl
|
73 |
|
74 |
+
pip3 install packaging
|
75 |
pip3 install -e .[flash-attn]
|
76 |
pip3 install -U git+https://github.com/huggingface/peft.git
|
77 |
|
|
|
106 |
|
107 |
3. Install axolotl along with python dependencies
|
108 |
```bash
|
109 |
+
pip3 install packaging
|
110 |
pip3 install -e .[flash-attn]
|
111 |
```
|
112 |
|
|
|
142 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
143 |
cd axolotl
|
144 |
|
145 |
+
pip3 install packaging
|
146 |
+
pip3 install -e .[flash-attn]
|
147 |
pip3 install protobuf==3.20.3
|
148 |
pip3 install -U --ignore-installed requests Pillow psutil scipy
|
149 |
```
|