datasets
loralib
sentencepiece
git+https://github.com/zphang/transformers@c3dc391
accelerate
bitsandbytes
git+https://github.com/huggingface/peft.git
gradio
fastapi
uvicorn