jina-reranker-v1-tiny-en-ov

jina-reranker-v1-tiny-en-ov is an OpenVino packaging of Jinaai/jina-reranker-v1-tiny-en, providing a very small, very fast inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

jina-reranker-v1-tiny-en-ov is a tiny specialized semantic reranker that ranks the similarity between a query and a text passage.

Model Description

• Developed by: jinaai
• Quantized by: llmware
• Model type: jina-reranker-v1-tiny-en
• Parameters: 65 million
• Model Parent: jinaai/jina-reranker-v1-tiny-en
• Language(s) (NLP): English
• License: Apache 2.0
• Uses: Semantic similarity classification and ranking
• RAG Benchmark Accuracy Score: NA
• Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website