support tokenised prompt (online vllm)

#17

by Payoto - opened Oct 3

←

Payoto

Oct 3

•

Online vLLM inference passes an already pre-processed text prompt to the multimodal preprocessor.

Payoto

Oct 3

This comment has been hidden

Payoto changed pull request status to open Oct 3

Payoto changed pull request status to closed Oct 11

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment