GGUF
Composer
MosaicML
llm-foundry
filipealmeida commited on
Commit
f7803b5
1 Parent(s): 3e075fe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -10,11 +10,16 @@ inference: false
10
  ---
11
 
12
  # MPT-7B-Instruct
 
13
 
14
  This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
15
 
16
  Right now it only works with that branch, but hopefully this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
17
 
 
 
 
 
18
  MPT-7B-Instruct is a model for short-form instruction following.
19
  It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
20
  * License: _CC-By-SA-3.0_
 
10
  ---
11
 
12
  # MPT-7B-Instruct
13
+ <span style="color:red">This is not working yet with the official version of llama.cpp</span>
14
 
15
  This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
16
 
17
  Right now it only works with that branch, but hopefully this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
18
 
19
+ I needed this for some prototyping so I'll also maintain a fork of the python bindings while this isn't all merged in here: [llama-cpp-python-mpt](https://github.com/filipe-m-almeida/llama-cpp-python-mpt)
20
+
21
+ -----
22
+
23
  MPT-7B-Instruct is a model for short-form instruction following.
24
  It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
25
  * License: _CC-By-SA-3.0_