--- license: gemma base_model: google/gemma-2-9b-it base_model_relation: quantized library_name: mlc-llm pipeline_tag: text-generation --- 4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it).