Elfsong/Arena at main

12.1 kB

3 contributors

feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes.

04ffcc8 5 days ago

.gitattributes

1.52 kB

Duplicate from gradio-templates/chatbot 2 months ago
.gitignore

31 Bytes

feat: Expand GPU mapping for model launching and enhance logging output with emojis for better visibility. 20 days ago
README.md

437 Bytes

initial commit 2 months ago
app.py

5.76 kB

refactor: Simplify model configuration by replacing dynamic GPU mapping with a static dictionary, and enhance bot response function to include a seed value for reproducibility in responses. 5 days ago
launch_models.py

2.46 kB

feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes. 5 days ago
model_launch.sh

1.83 kB

feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes. 5 days ago
requirements.txt

77 Bytes

chore: Update GPU mapping for model launches by commenting out unused configurations and adjust GPU memory utilization to 0.3. Add additional dependencies to requirements.txt for enhanced functionality. 20 days ago