gradio_modal
python-dotenv
transformers
accelerate
ibm_watsonx_ai
vllm