Differentiable's picture
Update README.md
34c0cfa
---
license: gpl
language:
- en
datasets:
- Differentiable/processed_chats
tags:
- twitch
---
# Description
This is my first attempt to simulate the Filian's Twitch stream chat based on scraped data. The model is a fine-tuning of GPT-Neo for 125M parameters. The model was able to be trained within 30 minutes on a GTX 1650 with Pytorch's memory pinning feature to share the local RAM with the GPU.
# Usage
Make sure to include the prefix "STREAMER: " at the end of the prompt or anywhere the response of the streamer is supposed to go. "Chat messages" are prepend with the "CHAT: " keyword.
In case the Hosted Inference API (text box on the side) gets too little text, just keep pressing "Compute" until the sentence ends.
## Prompt examples
```
CHAT: You're cringe
CHAT: KEKW
STREAMER:
```
```
CHAT: Are you a Filipino boy?
STREAMER:
```
```
CHAT: Hello
CHAT: KEKW Filian is cringe
STREAMER:
```
Using the keyword "STREAM TITLE" will attempt to replicate the name of a stream:
```
STREAM TITLE:
```
You can also induce the streamer to say something by adding a few words of your own at the beginning:
```
STREAM: Today we will
```