Update README.md (#1012)
Browse files
README.md
CHANGED
@@ -990,9 +990,12 @@ tokens: # these are delimiters
|
|
990 |
|
991 |
When you include these tokens in your axolotl config, axolotl adds these tokens to the tokenizer's vocabulary.
|
992 |
|
993 |
-
### Inference
|
994 |
|
995 |
-
|
|
|
|
|
|
|
996 |
|
997 |
- Pretrained LORA:
|
998 |
```bash
|
|
|
990 |
|
991 |
When you include these tokens in your axolotl config, axolotl adds these tokens to the tokenizer's vocabulary.
|
992 |
|
993 |
+
### Inference Playground
|
994 |
|
995 |
+
Axolotl allows you to load your model in an interactive terminal playground for quick experimentation.
|
996 |
+
The config file is the same config file used for training.
|
997 |
+
|
998 |
+
Pass the appropriate flag to the inference command, depending upon what kind of model was trained:
|
999 |
|
1000 |
- Pretrained LORA:
|
1001 |
```bash
|