TheBlokeAI
/

jackfram_llama-68m-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Sep 21, 2023

Commit

b415e46

•

1 Parent(s): 295f0ce

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,3 +1,3 @@
-A 4-bit, 128g, act_order=True GPTQ quantisation of JackFram/llama-68m, a 68 million parameter Llama model; created on request for software testing.
 Not for normal usage!


1	+ A 4-bit, 128g, act_order=True GPTQ quantisation of JackFram/llama-68m, a 68 million parameter Llama1 model; created on request for software testing.
2
3	Not for normal usage!