Commit
•
97d0107
1
Parent(s):
89aff9a
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,6 +2,10 @@
|
|
| 2 |
base_model:
|
| 3 |
- unsloth/Mistral-Nemo-Instruct-2407
|
| 4 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
vllm (pretrained=/root/autodl-tmp/Mistral-Nemo-Instruct-2407,add_bos_token=true,tensor_parallel_size=2,max_model_len=4096,gpu_memory_utilization=0.85,swap_space=0), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
|
| 6 |
|Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
|
| 7 |
|-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
|
|
|
|
| 2 |
base_model:
|
| 3 |
- unsloth/Mistral-Nemo-Instruct-2407
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
Note: This model is no longer the optimal W8A8 quantization, please consider using a better quantization model I made later:
|
| 7 |
+
noneUsername/Mistral-Nemo-Instruct-2407-abliterated-W8A8-Dynamic-Per-Token
|
| 8 |
+
|
| 9 |
vllm (pretrained=/root/autodl-tmp/Mistral-Nemo-Instruct-2407,add_bos_token=true,tensor_parallel_size=2,max_model_len=4096,gpu_memory_utilization=0.85,swap_space=0), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
|
| 10 |
|Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
|
| 11 |
|-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
|