Pooja Ganesh
commited on
Commit
•
c83e639
1
Parent(s):
43874ab
Update README.md
Browse files
README.md
CHANGED
@@ -11,4 +11,21 @@ tags:
|
|
11 |
- code
|
12 |
- onnx
|
13 |
- amd
|
14 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
- code
|
12 |
- onnx
|
13 |
- amd
|
14 |
+
---
|
15 |
+
|
16 |
+
# microsoft/Phi-3.5-mini-instruct
|
17 |
+
- ## Introduction
|
18 |
+
This model was created by applying [Quark](https://quark.docs.amd.com/latest/index.html) with calibration samples from Pile dataset, and applying [onnxruntime-genai model builder](https://github.com/microsoft/onnxruntime-genai/tree/main/src/python/py/models) to convert to ONNX.
|
19 |
+
- ## Quantization Strategy
|
20 |
+
- ***Quantized Layers***: TBD
|
21 |
+
- ***Weight***: TBD
|
22 |
+
- ## Quick Start
|
23 |
+
For quickstart, refer to AMD [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)
|
24 |
+
|
25 |
+
#### Evaluation scores
|
26 |
+
The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.12716.
|
27 |
+
|
28 |
+
#### License
|
29 |
+
Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.
|
30 |
+
|
31 |
+
license: mit
|