Improve Inference instruction
Browse files
README.md
CHANGED
@@ -317,12 +317,16 @@ accelerate launch scripts/finetune.py configs/your_config.yml
|
|
317 |
|
318 |
### Inference
|
319 |
|
320 |
-
|
321 |
|
322 |
-
|
323 |
-
```bash
|
324 |
-
--lora_model_dir ./completed-model
|
325 |
-
```
|
|
|
|
|
|
|
|
|
326 |
|
327 |
### Merge LORA to base
|
328 |
|
|
|
317 |
|
318 |
### Inference
|
319 |
|
320 |
+
Pass the appropriate flag to the train command:
|
321 |
|
322 |
+
- Pretrained LORA:
|
323 |
+
```bash
|
324 |
+
--inference --lora_model_dir ./completed-model
|
325 |
+
```
|
326 |
+
- Full weights finetune:
|
327 |
+
```bash
|
328 |
+
--inference --base_model ./completed-model
|
329 |
+
```
|
330 |
|
331 |
### Merge LORA to base
|
332 |
|