Does this model support FIM?

#1
by mike-ravkine - opened

Hey guys! I was creeping your special_tokens.json like a degenerate and noticed some FIM tokens. I was excited to try them out but my test prompt makes the example app go way off the rails with nonsense output:

>>PREFIX<<It was the best of times, it was the worst of times>>SUFFIX<<it was the epoch of belief, it was the epoch of incredulity>>MIDDLE<<

Is my expectation of this models capability incorrect, or am I doing something wrong?

Thanks!

Hugging Face H4 org

Hi @mike-ravkine the deployed model is a fine-tuned variant of the base model so you might get better results prompting falcon-40b directly. Perhaps @slippylolo can also chime in?

Sign up or log in to comment