Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,7 @@ widget:
|
|
| 19 |
---
|
| 20 |
## Model Summary
|
| 21 |
|
|
|
|
| 22 |
Phi-3 Vision is a lightweight, state-of-the-art open multimodal model built upon datasets which include - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data both on text and vision. The model belongs to the Phi-3 model family, and the multimodal version comes with 128K context length (in tokens) it can support. The model underwent a rigorous enhancement process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures.
|
| 23 |
|
| 24 |
Resources and Technical Documentation:
|
|
|
|
| 19 |
---
|
| 20 |
## Model Summary
|
| 21 |
|
| 22 |
+
### Phi-3 Vision model without `flash attention`
|
| 23 |
Phi-3 Vision is a lightweight, state-of-the-art open multimodal model built upon datasets which include - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data both on text and vision. The model belongs to the Phi-3 model family, and the multimodal version comes with 128K context length (in tokens) it can support. The model underwent a rigorous enhancement process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures.
|
| 24 |
|
| 25 |
Resources and Technical Documentation:
|