Update README.md

README.md

@@ -5,39 +5,36 @@ pipeline_tag: image-text-to-text
 
 <br>
 
-# LLaVA Model Card
+# LLaVA-UHD v2 Model Card
 
 ## Model details
 
 **Model type:**
-LLaVA is an open-source chatbot trained by fine-tuning LLaMA/Vicuna on GPT-generated multimodal instruction-following data.
-It is an auto-regressive language model, based on the transformer architecture.
+LLaVA-UHD v2, an advanced MLLM centered around a Hierarchical window transformer that enables capturing diverse visual granularity 
+by constructing and integrating a high resolution feature pyramid.
 
 **Model date:**
-LLaVA-v1.5-7B was trained in September 2023.
+LLaVA-UHD v2 was trained in November 2024.
 
 **Paper or resources for more information:**
-https://llava-vl.github.io/
+https://github.com/thunlp/LLaVA-UHD
 
 ## License
 Llama 2 is licensed under the LLAMA 2 Community License, 
 Copyright (c) Meta Platforms, Inc. All Rights Reserved.
 
 **Where to send questions or comments about the model:**
-https://github.com/haotian-liu/LLaVA/issues
+https://github.com/thunlp/LLaVA-UHD/issues
 
 ## Intended use
 **Primary intended uses:**
-The primary use of LLaVA is research on large multimodal models and chatbots.
+The primary use of LLaVA-UHD v2 is research on large multimodal models and chatbots.
 
 **Primary intended users:**
 The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence.
 
 ## Training dataset
 - 558K filtered image-text pairs from LAION/CC/SBU, captioned by BLIP.
-- 158K GPT-generated multimodal instruction-following data.
-- 450K academic-task-oriented VQA data mixture.
-- 40K ShareGPT data.
-
-## Evaluation dataset
-A collection of 12 benchmarks, including 5 academic VQA benchmarks and 7 recent benchmarks specifically proposed for instruction-following LMMs.
+- JBU Pretrain: MS-COCO stuff 2017
+- Pretrain: LLaVA-Pretrain 558K (filtered image-text pairs from LAION/CC/SBU, captioned by BLIP.)
+- SFT: 858k-mixed dataset in https://huggingface.co/datasets/YipengZhang/LLaVA-UHD-v2-SFT-Data