README.md

---
license: apache-2.0
---

# TokenFlow🚀: Unified Image Tokenizer for Multimodal Understanding and Generation

<div align="center">
  
[![github repo](https://img.shields.io/badge/Github_repo-TokenFlow-green?logo=github)](https://github.com/ByteFlow-AI/TokenFlow)

</div>

## 🌿 Introduction

We present TokenFlow, a unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation. 
TokenFlow introduce an innovative dual-codebook architecture that decouples semantic and pixel-level feature learning while maintaining their alignment through a shared mapping mechanism. 

TokenFlow excels in both multimodal understanding and image generation. For multimodal understanding, we surpass the flagship models such as LLaVA-1.5 and EMU3 by a large margin. For text-to-image generation, we also achieve comparable performance to SDXL in 256×256 resolution.


## ⚙️ Getting Started
This repo contains the model for text-to-image in TokenFlow.
See [GETTING_STARTED.md](https://github.com/ByteFlow-AI/TokenFlow/blob/main/GETTING_STARTED.md) for detailed instructions of ***training*** and ***evaluation*** of TokenFlow multimodal understanding.