llama-3.2-1B model with quantization

#158
by marioja - opened

Good day i've researched this all over the place and I haven't found out anywhere that had the information. Do you have the model identifier for the llama-3.2 1 billion model with quantization. I do not see it anywhere on the hugging face? Do you have sample code on how to load in either to infer or to train it further?

Thank you very much.

Sign up or log in to comment