Hugging Face's logo

ethzanalytics
/
gpt-j-8bit-daily_dialogues

Text Generation
Transformers
PyTorch
gptj
8bit
8-bit precision
quantization
compression
chatbot
dialogue
conversation
Model card Files Community
gpt-j-8bit-daily_dialogues / README.md
pszemraj's picture
pszemraj
Update README.md
e323036
preview code
|
raw
history blame
1.46 kB
metadata
tags:
  - text-generation
  - 8bit
  - 8-bit
  - quantization
  - compression
  - chatbot
  - dialogue
  - conversation
datasets:
  - daily_dialog
inference: false
license: apache-2.0

ethzanalytics/gpt-j-8bit-daily_dialogues

Open In Colab

This version of hivemind/gpt-j-6B-8bit is fine-tuned on a parsed version of the daily dialogues dataset for an epoch. It can be used as a chatbot.

It is designed to be used with ai-msgbot to take advantage of prompt engineering in fine-tuning.

Usage

NOTE: this needs to be loaded via the special patching technique outlined in the hivemind model card (as with all 8bit models)

Examples of how to load the model correctly are already in place in the notebook linked above. A .py of said notebook was uploaded to the repo for reference - link here

Training

For details, please see this wandb report for both the daily-dialogues version and the WoW version.