codelion

/

optillm-bert-uncased

like 4

I am trying to download this model directly just to play around with it before using the entire optillm repo.
I tried

model_id = 'codelion/optillm-bert-uncased'
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.bfloat16, cache_dir = model_path , use_auth_token=True)

But I get an error:

 File "E:\venvs\Reasoning\Lib\site-packages\transformers\modeling_utils.py", line 3997, in from_pretrained
    if metadata.get("format") == "pt":
       ^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

What am I doing wrong?