andrewzamai
commited on
Commit
•
51cc6c6
1
Parent(s):
3060bc2
Update README.md
Browse files
README.md
CHANGED
@@ -23,4 +23,16 @@ SLIMER performs comparably to these state-of-the-art models on OOD input domains
|
|
23 |
To experiment the ability of existing models on never-seen-before labels, we extend the standard zero-shot evaluations on BUSTER, which is characterized by financial entities that are rather far from the more traditional tags observed by all models during training.
|
24 |
An inverse trend to the OOD table can be observed, with SLIMER instead emerging as the most effective in dealing with unseen labels, thanks to its lighter instruction tuning methodology and the use of definition and guidelines.
|
25 |
|
26 |
-
<img src="https://huggingface.co/expertai/SLIMER/resolve/main/BUSTERvsOOD.png" width="250">
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
To experiment the ability of existing models on never-seen-before labels, we extend the standard zero-shot evaluations on BUSTER, which is characterized by financial entities that are rather far from the more traditional tags observed by all models during training.
|
24 |
An inverse trend to the OOD table can be observed, with SLIMER instead emerging as the most effective in dealing with unseen labels, thanks to its lighter instruction tuning methodology and the use of definition and guidelines.
|
25 |
|
26 |
+
<img src="https://huggingface.co/expertai/SLIMER/resolve/main/BUSTERvsOOD.png" width="250">
|
27 |
+
|
28 |
+
|
29 |
+
```python
|
30 |
+
from vllm import LLM, SamplingParams
|
31 |
+
|
32 |
+
vllm_model = LLM(model="expertai/SLIMER")
|
33 |
+
|
34 |
+
sampling_params = SamplingParams(temperature=0, max_tokens=128, stop=['</s>'])
|
35 |
+
|
36 |
+
prompts = [prompter.generate_prompt(instruction, input) for instruction, input in instruction_input_pairs]
|
37 |
+
responses = vllm_model.generate(prompts, sampling_params)
|
38 |
+
```
|