Add Q2 and Q3 models

Signed-off-by: Ubuntu <azureuser@sam-llm.mqpvdn0h4u4exiwh1ipb10qz5f.bx.internal.cloudapp.net>

Files changed (3) hide show

CodeLlama-70b-Instruct-hf-Q2_K.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:c0de0e868e6a10f9518858736465c6000d8f77bca217a4b53d4435384c34b3cf
+size 25462588416

CodeLlama-70b-Instruct-hf-Q3_K_L.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:8fc23759ad772526996dad279f1ff6d7e29291a72190a973c81bcaa373a1fad9
+size 36148000768

CodeLlama-70b-Instruct-hf-Q3_K_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:aeb1cb38bcd19613576164db9116e8bb63bbdfeb07b8ec426d156e466f4e3e94
+size 32493125632