fastapi
uvicorn
transformers
torch
jax
jaxlib
git+https://github.com/huggingface/transformers.git
accelerate
sentencepiece 
xformers
trl<0.9.0
peft
bitsandbytes
requests==2.27.*
uvicorn[standard]==0.17.*