Update README.md
Browse files
README.md
CHANGED
@@ -16,16 +16,17 @@ language:
|
|
16 |
|
17 |
# Mantis: Interleaved Multi-Image Instruction Tuning
|
18 |
|
19 |
-
**Mantis** is a multimodal conversational AI model that can chat with users about images and text. It's optimized for multi-image reasoning, where interleaved text and images can be used
|
20 |
|
21 |
Mantis is trained on the newly curated dataset **Mantis-Instruct**, a large-scale multi-image QA dataset that covers various multi-image reasoning tasks.
|
22 |
|
23 |
-
Mantis
|
24 |
-
|
25 |
-
[Paper](https://arxiv.org/abs/2405.01483) |[Demo](https://huggingface.co/spaces/TIGER-Lab/Mantis) | [Github](https://github.com/TIGER-AI-Lab/Mantis) | [Models](https://huggingface.co/collections/TIGER-Lab/mantis-6619b0834594c878cdb1d6e4) |
|
26 |
|
27 |
![Mantis](https://raw.githubusercontent.com/TIGER-AI-Lab/Mantis/main/docs/assets/images/overall_barchart.jpeg)
|
28 |
|
|
|
|
|
|
|
29 |
## Inference
|
30 |
|
31 |
You can install Mantis's GitHub codes as a Python package
|
|
|
16 |
|
17 |
# Mantis: Interleaved Multi-Image Instruction Tuning
|
18 |
|
19 |
+
**Mantis** is a multimodal conversational AI model that can chat with users about images and text. It's optimized for multi-image reasoning, where interleaved text and images can be used to generate responses.
|
20 |
|
21 |
Mantis is trained on the newly curated dataset **Mantis-Instruct**, a large-scale multi-image QA dataset that covers various multi-image reasoning tasks.
|
22 |
|
23 |
+
|[Demo](https://huggingface.co/spaces/TIGER-Lab/Mantis) | [Github](https://github.com/TIGER-AI-Lab/Mantis) | [Models](https://huggingface.co/collections/TIGER-Lab/mantis-6619b0834594c878cdb1d6e4) |
|
|
|
|
|
24 |
|
25 |
![Mantis](https://raw.githubusercontent.com/TIGER-AI-Lab/Mantis/main/docs/assets/images/overall_barchart.jpeg)
|
26 |
|
27 |
+
**Note that this is an older version of Mantis**, please refer to our newest version at [mantis-Siglip-llama3](https://huggingface.co/TIGER-Lab/Mantis-8B-siglip-llama3). The newer version improves significantly over both multi-image and single-image tasks.
|
28 |
+
|
29 |
+
|
30 |
## Inference
|
31 |
|
32 |
You can install Mantis's GitHub codes as a Python package
|