Fix: Cannot tokenize with bf16 and on cpu (#766)
Browse files
README.md
CHANGED
@@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml
|
|
819 |
|
820 |
You can optionally pre-tokenize dataset with the following before finetuning:
|
821 |
```bash
|
822 |
-
CUDA_VISIBLE_DEVICES=
|
823 |
```
|
824 |
|
825 |
##### Config
|
|
|
819 |
|
820 |
You can optionally pre-tokenize dataset with the following before finetuning:
|
821 |
```bash
|
822 |
+
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
|
823 |
```
|
824 |
|
825 |
##### Config
|