jordiclive
commited on
Commit
•
cc34c66
1
Parent(s):
5e78296
Update README.md
Browse files
README.md
CHANGED
@@ -56,7 +56,7 @@ The input ends with the `<|assistant|>` token to signal that the model should
|
|
56 |
start generating the assistant reply.
|
57 |
|
58 |
|
59 |
-
|
60 |
|
61 |
```
|
62 |
from typing import List, NamedTuple
|
|
|
56 |
start generating the assistant reply.
|
57 |
|
58 |
|
59 |
+
# Example Inference Code (Note several embeddings need to be loaded along with the LoRA weights), assumes on GPU and torch.float16:
|
60 |
|
61 |
```
|
62 |
from typing import List, NamedTuple
|