torch
transformers>=4.39.1
huggingface_hub
bitsandbytes
accelerate
tokenizers
pydantic
fastapi
uvicorn