Abhinav Kulkarni
commited on
Commit
•
1c126ae
1
Parent(s):
69f4c6e
Updated README
Browse files
README.md
CHANGED
@@ -22,7 +22,7 @@ Please refer to the AWQ quantization license ([link](https://github.com/llm-awq/
|
|
22 |
|
23 |
## CUDA Version
|
24 |
|
25 |
-
This model was successfully tested on CUDA driver v530.30.02 and runtime v11.7 with Python v3.10.11. Please note that AWQ requires NVIDIA GPUs with compute capability of
|
26 |
|
27 |
## How to Use
|
28 |
|
@@ -81,7 +81,7 @@ output = model.generate(
|
|
81 |
repetition_penalty=1.1,
|
82 |
eos_token_id=tokenizer.eos_token_id
|
83 |
)
|
84 |
-
print(tokenizer.decode(output[0], skip_special_tokens=True))
|
85 |
```
|
86 |
|
87 |
## Evaluation
|
|
|
22 |
|
23 |
## CUDA Version
|
24 |
|
25 |
+
This model was successfully tested on CUDA driver v530.30.02 and runtime v11.7 with Python v3.10.11. Please note that AWQ requires NVIDIA GPUs with compute capability of `8.0` or higher.
|
26 |
|
27 |
## How to Use
|
28 |
|
|
|
81 |
repetition_penalty=1.1,
|
82 |
eos_token_id=tokenizer.eos_token_id
|
83 |
)
|
84 |
+
# print(tokenizer.decode(output[0], skip_special_tokens=True))
|
85 |
```
|
86 |
|
87 |
## Evaluation
|