Spaces:
Running
Running
Does this model support FIM?
#1
by
mike-ravkine
- opened
Hey guys! I was creeping your special_tokens.json like a degenerate and noticed some FIM tokens. I was excited to try them out but my test prompt makes the example app go way off the rails with nonsense output:
>>PREFIX<<It was the best of times, it was the worst of times>>SUFFIX<<it was the epoch of belief, it was the epoch of incredulity>>MIDDLE<<
Is my expectation of this models capability incorrect, or am I doing something wrong?
Thanks!
Hi
@mike-ravkine
the deployed model is a fine-tuned variant of the base model so you might get better results prompting falcon-40b
directly. Perhaps
@slippylolo
can also chime in?