Docker image llama.cpp

by ThaiAn - opened Aug 19

Aug 19

I'm using this llama.cpp docker image "ghcr.io/ggerganov/llama.cpp:server", but i can't infer model. Do you have format prompt?

ThaiAn changed discussion title from Docker infer to Docker image llama.cpp Aug 19

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment