README.md

---
license: other
---
# Model Card for llava-polyglot-ko-1.3b-hf

## Model Description

` llava-polyglot-ko-1.3b-hf ` is a model based on polyglot-ko-13b.
We use llava for the vision question answering.
You can see [‘demo.py’]( https://github.com/LearnItAnyway/llava_gpt_neox/blob/main/demo.py) and [‘llava_gpt_neox.py’]( https://github.com/LearnItAnyway/llava_gpt_neox/blob/main/llava_gpt_neox.py).
Currently, the model has been trained on small vision question answer dataset (approx, 10k) with 1.3b (small) model.

## TODO
- Multi-turn chat based on the image
- Larger LLM
- More pretraining on for the vision-text adapter

## References
- [`LLaVA`](https://github.com/haotian-liu/LLaVA)
- [`polyglot korean`](https://huggingface.co/EleutherAI/polyglot-ko-1.3b)