Update README.md
Browse files
README.md
CHANGED
@@ -18,8 +18,8 @@ This repo is the result of quantising to 4bit and 5bit GGML for CPU inference us
|
|
18 |
|
19 |
## Repositories available
|
20 |
|
21 |
-
* [
|
22 |
-
* [
|
23 |
* [OpenAccess AI Collective's original float16 HF format repo for GPU inference and further conversions](https://huggingface.co/openaccess-ai-collective/wizard-mega-13b).
|
24 |
|
25 |
## THE FILES IN MAIN BRANCH REQUIRES LATEST LLAMA.CPP (May 12th 2023 - commit b9fd7ee)!
|
|
|
18 |
|
19 |
## Repositories available
|
20 |
|
21 |
+
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GPTQ).
|
22 |
+
* [4-bit, 5-bit 8-bit GGML models for llama.cpp CPU (+CUDA) inference](https://huggingface.co/TheBloke/wizard-mega-13B-GGML).
|
23 |
* [OpenAccess AI Collective's original float16 HF format repo for GPU inference and further conversions](https://huggingface.co/openaccess-ai-collective/wizard-mega-13b).
|
24 |
|
25 |
## THE FILES IN MAIN BRANCH REQUIRES LATEST LLAMA.CPP (May 12th 2023 - commit b9fd7ee)!
|