Granther
/

Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Gemma-2-9B-Instruct-4Bit-GPTQ / gemma_2_gptq_inference.ipynb

Granther's picture

Upload gemma_2_gptq_inference.ipynb with huggingface_hub

da79090 verified 5 months ago

13.7 kB

Rendering notebook...