Is vLLM support planned?

#10
by RonanMcGovern - opened

Would be great.

Nice work on this model.

vLLM has supported it in 0.6.4.

Excellent, many thanks

RonanMcGovern changed discussion status to closed

Sign up or log in to comment