Hugging Face's logo

MBZUAI
/
MobiLlama-05B

Text Generation
Transformers
PyTorch
English
llama
nlp
code
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
7

num_key_value_heads bug?

#4
by cckm - opened
Discussion
cckm

num_key_value_heads seems to be unreferenced in https://huggingface.co/MBZUAI/MobiLlama-05B/blob/main/modelling_mobillama.py?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment