akjindal53244

/

Llama-3.1-Storm-8B-GGUF

like 41

Hi,

I'm trying to import this model in Ollama using the following ModelFile:

FROM ./Llama-3.1-Storm-8B.Q8_0.gguf

TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>

{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>

{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>

{{ .Response }}<|eot_id|>"""

PARAMETER num_ctx 16000
PARAMETER stop "<|eot_id|>"
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER top_k 1

But this results in this error when I try ollama run llama3.1-storm:

Error: llama runner process has terminated: signal: abort trap error:done_getting_tensors: 
wrong number of tensors; expected 292, got 291

Do you know how to overcome that?

Thanks