Text Generation
Transformers
English
gpt_neox
red_pajama
Inference Endpoints
keldenl commited on
Commit
2d7ead9
1 Parent(s): f227e44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -7,4 +7,34 @@ datasets:
7
  - OpenAssistant/oasst1
8
  - databricks/databricks-dolly-15k
9
  pipeline_tag: text-generation
10
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  - OpenAssistant/oasst1
8
  - databricks/databricks-dolly-15k
9
  pipeline_tag: text-generation
10
+ ---
11
+
12
+ **Original Model Link: https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1**
13
+
14
+ This will NOT work with llama.cpp as of 5/8/2023. This will ONLY work with the GGML fork in https://github.com/ggerganov/ggml/pull/134, and soon https://github.com/keldenl/gpt-llama.cpp (which uses llama.cpp or ggml).
15
+
16
+ # RedPajama-INCITE-Chat-3B-v1
17
+
18
+ RedPajama-INCITE-Chat-3B-v1 was developed by Together and leaders from the open-source AI community including Ontocord.ai, ETH DS3Lab, AAI CERC, Université de Montréal, MILA - Québec AI Institute, Stanford Center for Research on Foundation Models (CRFM), Stanford Hazy Research research group and LAION.
19
+
20
+ It is fine-tuned on OASST1 and Dolly2 to enhance chatting ability.
21
+
22
+ ## Model Details
23
+ - **Developed by**: Together Computer.
24
+ - **Model type**: Language Model
25
+ - **Language(s)**: English
26
+ - **License**: Apache 2.0
27
+ - **Model Description**: A 2.8B parameter pretrained language model.
28
+
29
+ ## Prompt Template
30
+ To prompt the chat model, use the following format:
31
+ ```
32
+ <human>: [Instruction]
33
+ <bot>:
34
+ ```
35
+
36
+ ## Which model to download?
37
+ * The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
38
+ * The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.
39
+ * The q5_0 file is using brand new 5bit method released 26th April. This is the 5bit equivalent of q4_0.
40
+ * The q5_1 file is using brand new 5bit method released 26th April. This is the 5bit equivalent of q4_1.