static quants of https://huggingface.co/ibm-granite/granite-3.0-2b-instruct