video understanding

#1
by hihi1 - opened

can this model be used for video understanding?if so,how to do it?like github
Otter/pipeline/demos/interactive/otter_video.py,
replace ‘luodian/OTTER-9B-DenseCaption’ with ‘luodian/OTTER-Image-MPT7B’?

Owner

hihi this is only for images, and video version is here: https://huggingface.co/luodian/OTTER-Video-LLaMA7B-DenseCaption

Sign up or log in to comment