echarlaix HF staff commited on
Commit
95a2f33
1 Parent(s): 8342dc4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: echarlaix/distilgpt2-openvino
3
+ datasets:
4
+ - openwebtext
5
+ language: en
6
+ license: apache-2.0
7
+ tags:
8
+ - exbert
9
+ - openvino
10
+ - openvino-export
11
+ - nncf
12
+ - 8-bit
13
+ co2_eq_emissions: 149200
14
+ model-index:
15
+ - name: distilgpt2
16
+ results:
17
+ - task:
18
+ type: text-generation
19
+ name: Text Generation
20
+ dataset:
21
+ name: WikiText-103
22
+ type: wikitext
23
+ metrics:
24
+ - type: perplexity
25
+ value: 21.1
26
+ name: Perplexity
27
+ ---
28
+
29
+ This model is a quantized version of [`echarlaix/distilgpt2-openvino`](https://huggingface.co/echarlaix/distilgpt2-openvino) and is converted to the OpenVINO format. This model was obtained via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space with [optimum-intel](https://github.com/huggingface/optimum-intel).
30
+
31
+ First make sure you have `optimum-intel` installed:
32
+
33
+ ```bash
34
+ pip install optimum[openvino]
35
+ ```
36
+
37
+ To load your model you can do as follows:
38
+
39
+ ```python
40
+ from optimum.intel import OVModelForCausalLM
41
+
42
+ model_id = "echarlaix/distilgpt2-openvino-8bit"
43
+ model = OVModelForCausalLM.from_pretrained(model_id)
44
+ ```