Text Generation
Transformers
English
llm-rs
ggml
Inference Endpoints
LLukas22 commited on
Commit
e6a2308
1 Parent(s): eb2c96b

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -35,14 +35,17 @@ The training was done on 3,072 V100 GPUs provided as part of the INCITE 2023 pro
35
  | [RedPajama-INCITE-7B-Base-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | F16 | GGML | V3 |
36
  | [RedPajama-INCITE-7B-Base-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q4_0 | GGML | V3 |
37
  | [RedPajama-INCITE-7B-Base-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q4_0 | GGJT | V3 |
 
38
  | [RedPajama-INCITE-7B-Base-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q5_1 | GGJT | V3 |
39
  | [RedPajama-INCITE-7B-Chat-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | F16 | GGML | V3 |
40
  | [RedPajama-INCITE-7B-Chat-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q4_0 | GGML | V3 |
41
  | [RedPajama-INCITE-7B-Chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q4_0 | GGJT | V3 |
 
42
  | [RedPajama-INCITE-7B-Chat-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q5_1 | GGJT | V3 |
43
  | [RedPajama-INCITE-7B-Instruct-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | F16 | GGML | V3 |
44
  | [RedPajama-INCITE-7B-Instruct-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q4_0 | GGML | V3 |
45
  | [RedPajama-INCITE-7B-Instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q4_0 | GGJT | V3 |
 
46
  | [RedPajama-INCITE-7B-Instruct-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q5_1 | GGJT | V3 |
47
 
48
  ## Usage
 
35
  | [RedPajama-INCITE-7B-Base-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | F16 | GGML | V3 |
36
  | [RedPajama-INCITE-7B-Base-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q4_0 | GGML | V3 |
37
  | [RedPajama-INCITE-7B-Base-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q4_0 | GGJT | V3 |
38
+ | [RedPajama-INCITE-7B-Base-q5_1.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q5_1.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q5_1 | GGML | V3 |
39
  | [RedPajama-INCITE-7B-Base-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Base-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) | Q5_1 | GGJT | V3 |
40
  | [RedPajama-INCITE-7B-Chat-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | F16 | GGML | V3 |
41
  | [RedPajama-INCITE-7B-Chat-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q4_0 | GGML | V3 |
42
  | [RedPajama-INCITE-7B-Chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q4_0 | GGJT | V3 |
43
+ | [RedPajama-INCITE-7B-Chat-q5_1.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q5_1.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q5_1 | GGML | V3 |
44
  | [RedPajama-INCITE-7B-Chat-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Chat-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) | Q5_1 | GGJT | V3 |
45
  | [RedPajama-INCITE-7B-Instruct-f16.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-f16.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | F16 | GGML | V3 |
46
  | [RedPajama-INCITE-7B-Instruct-q4_0.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q4_0.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q4_0 | GGML | V3 |
47
  | [RedPajama-INCITE-7B-Instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q4_0-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q4_0 | GGJT | V3 |
48
+ | [RedPajama-INCITE-7B-Instruct-q5_1.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q5_1.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q5_1 | GGML | V3 |
49
  | [RedPajama-INCITE-7B-Instruct-q5_1-ggjt.bin](https://huggingface.co/rustformers/redpajama-7b-ggml/blob/main/RedPajama-INCITE-7B-Instruct-q5_1-ggjt.bin) | [togethercomputer/RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct) | Q5_1 | GGJT | V3 |
50
 
51
  ## Usage