|
--- |
|
license: cc-by-2.0 |
|
--- |
|
|
|
### Features |
|
- Just like GPT this model generates text based on an input prompt. |
|
- This project uses Reinforcement Learning (RL) for training and inference. |
|
- All models can be found on hugging face. |
|
|
|
--- |
|
|
|
### Training |
|
|
|
- First step is to run ``generate_vocab.py`` on whatever text data you would like to train on for example ``python3 generate_vocab.py -i train.txt`` |
|
- Next step is to run ``train.py`` |
|
- Now all you have to do is wait! |
|
--- |
|
### Inference |
|
|
|
- not fully complete but inferect can be removed from ``train.py`` and put into its own script. |
|
|
|
### Logging |
|
- Output plot graphs will be avalible in the next version. |
