Spaces:
Running
on
Zero
Running
on
Zero
MODEL_PATH='ibm-granite/granite-guardian-3.1-8b' | |
INFERENCE_ENGINE='VLLM' # one of [WATSONX, MOCK, TORCH] | |
WATSONX_API_KEY='' | |
WATSONX_PROJECT_ID='' | |