andrewzamai commited on
Commit
51cc6c6
1 Parent(s): 3060bc2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -23,4 +23,16 @@ SLIMER performs comparably to these state-of-the-art models on OOD input domains
23
  To experiment the ability of existing models on never-seen-before labels, we extend the standard zero-shot evaluations on BUSTER, which is characterized by financial entities that are rather far from the more traditional tags observed by all models during training.
24
  An inverse trend to the OOD table can be observed, with SLIMER instead emerging as the most effective in dealing with unseen labels, thanks to its lighter instruction tuning methodology and the use of definition and guidelines.
25
 
26
- <img src="https://huggingface.co/expertai/SLIMER/resolve/main/BUSTERvsOOD.png" width="250">
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  To experiment the ability of existing models on never-seen-before labels, we extend the standard zero-shot evaluations on BUSTER, which is characterized by financial entities that are rather far from the more traditional tags observed by all models during training.
24
  An inverse trend to the OOD table can be observed, with SLIMER instead emerging as the most effective in dealing with unseen labels, thanks to its lighter instruction tuning methodology and the use of definition and guidelines.
25
 
26
+ <img src="https://huggingface.co/expertai/SLIMER/resolve/main/BUSTERvsOOD.png" width="250">
27
+
28
+
29
+ ```python
30
+ from vllm import LLM, SamplingParams
31
+
32
+ vllm_model = LLM(model="expertai/SLIMER")
33
+
34
+ sampling_params = SamplingParams(temperature=0, max_tokens=128, stop=['</s>'])
35
+
36
+ prompts = [prompter.generate_prompt(instruction, input) for instruction, input in instruction_input_pairs]
37
+ responses = vllm_model.generate(prompts, sampling_params)
38
+ ```