i could load the model but not create an inference
#7
by
rijotomjackson
- opened
anaconda3\Lib\site-packages\transformers\models\llama\modeling_llama.py", line 275, in apply_rotary_pos_emb
q_embed = (q * cos) + (rotate_half(q) * sin)
~~^~~~~
RuntimeError: The size of tensor a (96) must match the size of tensor b (128) at non-singleton dimension 3