Update README.md
Browse files
README.md
CHANGED
@@ -4,6 +4,14 @@ inference: false
|
|
4 |
|
5 |
# longchat-13b-16k Model Card
|
6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
## Model details
|
8 |
|
9 |
**Model type:**
|
|
|
4 |
|
5 |
# longchat-13b-16k Model Card
|
6 |
|
7 |
+
## Usage
|
8 |
+
Please use load_model from FastChat or LongChat repo to load the model (or chatting API from FastChat). There is a monkey patch needed to use the model.
|
9 |
+
Usage referece:
|
10 |
+
(LongChat) python3 eval.py --model-name-or-path lmsys/longchat-13b-16k --task topics
|
11 |
+
(FastChat) python3 -m fastchat.serve.cli --model-path lmsys/longchat-13b-16k
|
12 |
+
Under the hood, the monkey patch is added in:
|
13 |
+
https://github.com/lm-sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model_adapter.py#L429
|
14 |
+
|
15 |
## Model details
|
16 |
|
17 |
**Model type:**
|