Spaces:

NyxKrage

/

LLM-Model-VRAM-Calculator

like 302

Running

x2

SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data

Did mistralai gate their models recently? The program works for other models, just not mistralai's or meta-llama's repos, which are gated. Maybe the way you can access gated repos' configs changed?

Edit: yes, trying to access a gated json, like
https://huggingface.co/meta-llama/Meta-Llama-3-8B/raw/main/config.json
returns:
Access to model meta-llama/Meta-Llama-3-8B is restricted and you are not in the authorized list. Visit https://huggingface.co/meta-llama/Meta-Llama-3-8B to ask for access.
IDK if there is a trivial way to get around this. Manually, I would just find some exl2 quant because these tend to copy-paste the config.json from the original repo.

SyntaxError: The string did not match the expected pattern.

Def broken for me. Too bad, because this seems awesome.

The problem seems to be if the model name has a dot "."
Use model names without dots with a similar amount of params