how to use with llamacpp
Hi, how to use this gguf version with llamacpp? when I tried it with llama-cli, it doesn't give any output.
Well, I only tested it with Wllama (in which it works, although the result is not the expected). But on llama.cpp this command should output something:./llama-cli -m models/t5-base-grammar-correction.gguf -p 'grammar: This sentences has has bads grammar.'
Out of curiosity, this is the output when running that prompt on Wllama with temperature: 0:
This sentences has bads grammar. This sentences has bads grammar. This sentences has bads grammar. This sentences has bads grammar. This sentences has bads grammar. This sentences has bads grammar.. This sentences has bads grammar.. This sentences has bads grammar.. This sentences has bads grammar.. This sentences has bads grammar.. grammar.. this sentences has bads grammar.. grammar.. this sentences has bads grammar.. grammar.. grammar.. grammar.. grammar.. grammar.. grammar