Spaces:
Running
Error with mixtral 22b
when i say anything to mixtral 22b i get this error:
HfHubHTTPError: (Request ID: Y-HiBvy22sGmTgph2YCUZ) 403 Forbidden: None. Cannot access content at: https://api-inference.huggingface.co/models/mistral-community/Mixtral-8x22B-v0.1. If you are trying to create or update content,make sure you have a token with the write role. The model mistral-community/Mixtral-8x22B-v0.1 is too large to be loaded automatically (281GB > 10GB). Please use Spaces (https://huggingface.co/spaces) or Inference Endpoints (https://huggingface.co/inference-endpoints).
Traceback:
File "/usr/local/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 542, in _run_script
exec(code, module.dict)
File "/home/user/app/app.py", line 136, in
output = client.text_generation(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/inference/_client.py", line 1841, in text_generation
raise_text_generation_error(e)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/inference/_common.py", line 470, in raise_text_generation_error
raise http_error
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/inference/_client.py", line 1817, in text_generation
bytes_output = self.post(json=payload, model=model, task="text-generation", stream=stream) # type: ignore
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/inference/_client.py", line 267, in post
hf_raise_for_status(response)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 367, in hf_raise_for_status
raise HfHubHTTPError(message, response=response) from e
also, you may wanna make the Api Key variable in your Hugging Face Space to a Secret so others dont see it