File size: 313 Bytes
a653b79 |
1 2 3 4 5 6 7 8 9 10 11 |
1) wget the model
2) save hostip: ip route | grep 'default' | awk '{print $9}' >hostip
3a) calls llama-server in container
3b) calls sed + llama-server in container
opodman run -d --net=host -v ~/funstreams:/models localhost/bookworm:server ./models/llama-server-static -m /models/qwen2-500.gguf
|