DachengLi commited on
Commit
d98f55f
1 Parent(s): 03f50f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -4,6 +4,14 @@ inference: false
4
 
5
  # longchat-13b-16k Model Card
6
 
 
 
 
 
 
 
 
 
7
  ## Model details
8
 
9
  **Model type:**
 
4
 
5
  # longchat-13b-16k Model Card
6
 
7
+ ## Usage
8
+ Please use load_model from FastChat or LongChat repo to load the model (or chatting API from FastChat). There is a monkey patch needed to use the model.
9
+ Usage referece:
10
+ (LongChat) python3 eval.py --model-name-or-path lmsys/longchat-13b-16k --task topics
11
+ (FastChat) python3 -m fastchat.serve.cli --model-path lmsys/longchat-13b-16k
12
+ Under the hood, the monkey patch is added in:
13
+ https://github.com/lm-sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model_adapter.py#L429
14
+
15
  ## Model details
16
 
17
  **Model type:**