jester6136
/

bags-llama3-chat-awq-onnx

Text Generation

onnxruntime_genai

Model card Files Files and versions Community

jester6136 commited on Jul 6, 2024

Commit

952487e

·

verified ·

1 Parent(s): 7ced1c2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -127,5 +127,5 @@ if __name__ == "__main__":
 3. Run API:
 ```python
-python llama3-awq-onnx-qa.py -m "/home/rad/bags/models/bags-llama3-awq-onnx" -k 1 -p 1 -t 0 -r 1.05
 ```

 3. Run API:
 ```python
+python llama3-awq-onnx-qa.py -m "/*{YourModelPath}*/bags-llama3-awq-onnx" -k 1 -p 1 -t 0 -r 1.05
 ```