File size: 1,495 Bytes
2b87dd0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 |
---
license: cc-by-4.0
---
# Model Card for LoTLIP ViT-B/32
## Model Details
### Model Description
LoTLIP ViT-B/32 model pre-trained on 100M scale dataset.
### Direct Use
Zero-shot long text-image retrieval, short text-image retrieval, and image classification, among others.
## How to Get Started with the Model
Use the [code](https://github.com/wuw2019/LoTLIP) to get started with the model.
## Training Details
### Training Data
The models are trained with 100M scale dataset which contains long text-image pairs.
## Evaluation
Please refer to https://github.com/wuw2019/LoTLIP.
### Testing Details
#### Testing Data
The testing is performed with [DCI](https://github.com/facebookresearch/DCI), [IIW](https://github.com/google/imageinwords/) and [ShareGPT4V](https://sharegpt4v.github.io/) for long text-image retrieval and ImageNet1k for classification.
### Results
| Model |Pre-training Data Scale | DCI I2T | DCI T2I| IIW I2T |IIW T2I| SV-10k I2T | SV-10k T2I |
| :----: | :----: | :----: | :----: | :----: | :----: | :----: | :----: |
| LoTLIP-ViT-B-32 | 100M | 59.90 | 56.36 | 93.14| 91.83 | 83.76 | 78.97|
## Citation
BibTeX:
```bibtex
@inproceedings{LoTLIP,
title={LoTLIP: Improving Language-Image Pre-training for Long Text Understanding},
author={Wu, Wei and Zheng, Kecheng and Ma, Shuailei and Lu, Fan and Guo, Yuxin and Zhang, Yifei and Chen, Wei and Guo, Qingpei and Shen, Yujun and Zheng-Jun, Zha},
booktitle={arXiv},
year={2024}
}
``` |