Hugging Face's logo

pipilok
/
phi-4-unsloth-exl2-8bpw-hb8

Safetensors
llama
8-bit precision
exl2
Model card Files Community
2
pipilok commited on
Commit
7513663
·
verified ·
1 Parent(s): a62a16e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +88 -0
README.md ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - unsloth/phi-4
4
+ ---
5
+
6
+ -- Quantization strategy:
7
+ -- model.layers.0.self_attn 8.0414 bpw - exp. error: 0.00231304
8
+ -- model.layers.0.mlp 8.0346 bpw - exp. error: 0.00221935
9
+ -- model.layers.1.self_attn 8.0414 bpw - exp. error: 0.00190707
10
+ -- model.layers.1.mlp 8.0346 bpw - exp. error: 0.00185876
11
+ -- model.layers.2.self_attn 8.0414 bpw - exp. error: 0.00080757
12
+ -- model.layers.2.mlp 8.0346 bpw - exp. error: 0.00312320
13
+ -- model.layers.3.self_attn 8.0414 bpw - exp. error: 0.00055968
14
+ -- model.layers.3.mlp 8.0346 bpw - exp. error: 0.00349023
15
+ -- model.layers.4.self_attn 8.0414 bpw - exp. error: 0.00060596
16
+ -- model.layers.4.mlp 8.0346 bpw - exp. error: 0.00107729
17
+ -- model.layers.5.self_attn 8.0414 bpw - exp. error: 0.00063598
18
+ -- model.layers.5.mlp 8.0346 bpw - exp. error: 0.00079957
19
+ -- model.layers.6.self_attn 8.0414 bpw - exp. error: 0.00071120
20
+ -- model.layers.6.mlp 8.0346 bpw - exp. error: 0.00094647
21
+ -- model.layers.7.self_attn 8.0414 bpw - exp. error: 0.00074661
22
+ -- model.layers.7.mlp 8.0346 bpw - exp. error: 0.00109008
23
+ -- model.layers.8.self_attn 8.0414 bpw - exp. error: 0.00085548
24
+ -- model.layers.8.mlp 8.0346 bpw - exp. error: 0.00120750
25
+ -- model.layers.9.self_attn 8.0414 bpw - exp. error: 0.00090076
26
+ -- model.layers.9.mlp 8.0346 bpw - exp. error: 0.00136397
27
+ -- model.layers.10.self_attn 8.0414 bpw - exp. error: 0.00101369
28
+ -- model.layers.10.mlp 8.0346 bpw - exp. error: 0.00152688
29
+ -- model.layers.11.self_attn 8.0414 bpw - exp. error: 0.00113892
30
+ -- model.layers.11.mlp 8.0346 bpw - exp. error: 0.00160677
31
+ -- model.layers.12.self_attn 8.0414 bpw - exp. error: 0.00124207
32
+ -- model.layers.12.mlp 8.0346 bpw - exp. error: 0.00166692
33
+ -- model.layers.13.self_attn 8.0414 bpw - exp. error: 0.00120159
34
+ -- model.layers.13.mlp 8.0346 bpw - exp. error: 0.00180155
35
+ -- model.layers.14.self_attn 8.0414 bpw - exp. error: 0.00130511
36
+ -- model.layers.14.mlp 8.0346 bpw - exp. error: 0.00180295
37
+ -- model.layers.15.self_attn 8.0414 bpw - exp. error: 0.00128359
38
+ -- model.layers.15.mlp 8.0346 bpw - exp. error: 0.00182972
39
+ -- model.layers.16.self_attn 8.0414 bpw - exp. error: 0.00143487
40
+ -- model.layers.16.mlp 8.0346 bpw - exp. error: 0.00190457
41
+ -- model.layers.17.self_attn 8.0414 bpw - exp. error: 0.00141536
42
+ -- model.layers.17.mlp 8.0346 bpw - exp. error: 0.00189976
43
+ -- model.layers.18.self_attn 8.0414 bpw - exp. error: 0.00147880
44
+ -- model.layers.18.mlp 8.0346 bpw - exp. error: 0.00194527
45
+ -- model.layers.19.self_attn 8.0414 bpw - exp. error: 0.00140794
46
+ -- model.layers.19.mlp 8.0346 bpw - exp. error: 0.00198472
47
+ -- model.layers.20.self_attn 8.0414 bpw - exp. error: 0.00139448
48
+ -- model.layers.20.mlp 8.0346 bpw - exp. error: 0.00206014
49
+ -- model.layers.21.self_attn 8.0414 bpw - exp. error: 0.00141150
50
+ -- model.layers.21.mlp 8.0346 bpw - exp. error: 0.00203777
51
+ -- model.layers.22.self_attn 8.0414 bpw - exp. error: 0.00136862
52
+ -- model.layers.22.mlp 8.0346 bpw - exp. error: 0.00203118
53
+ -- model.layers.23.self_attn 8.0414 bpw - exp. error: 0.00129910
54
+ -- model.layers.23.mlp 8.0346 bpw - exp. error: 0.00203162
55
+ -- model.layers.24.self_attn 8.0414 bpw - exp. error: 0.00127187
56
+ -- model.layers.24.mlp 8.0346 bpw - exp. error: 0.00199441
57
+ -- model.layers.25.self_attn 8.0414 bpw - exp. error: 0.00124861
58
+ -- model.layers.25.mlp 8.0346 bpw - exp. error: 0.00201886
59
+ -- model.layers.26.self_attn 8.0414 bpw - exp. error: 0.00122997
60
+ -- model.layers.26.mlp 8.0346 bpw - exp. error: 0.00196617
61
+ -- model.layers.27.self_attn 8.0414 bpw - exp. error: 0.00116638
62
+ -- model.layers.27.mlp 8.0346 bpw - exp. error: 0.00189536
63
+ -- model.layers.28.self_attn 8.0414 bpw - exp. error: 0.00104954
64
+ -- model.layers.28.mlp 8.0346 bpw - exp. error: 0.00180170
65
+ -- model.layers.29.self_attn 8.0414 bpw - exp. error: 0.00097699
66
+ -- model.layers.29.mlp 8.0346 bpw - exp. error: 0.00176433
67
+ -- model.layers.30.self_attn 8.0414 bpw - exp. error: 0.00095343
68
+ -- model.layers.30.mlp 8.0346 bpw - exp. error: 0.00172087
69
+ -- model.layers.31.self_attn 8.0414 bpw - exp. error: 0.00091330
70
+ -- model.layers.31.mlp 8.0346 bpw - exp. error: 0.00169612
71
+ -- model.layers.32.self_attn 8.0414 bpw - exp. error: 0.00098182
72
+ -- model.layers.32.mlp 8.0346 bpw - exp. error: 0.00188125
73
+ -- model.layers.33.self_attn 8.0414 bpw - exp. error: 0.00076354
74
+ -- model.layers.33.mlp 8.0346 bpw - exp. error: 0.00162950
75
+ -- model.layers.34.self_attn 8.0414 bpw - exp. error: 0.00082926
76
+ -- model.layers.34.mlp 8.0346 bpw - exp. error: 0.00180018
77
+ -- model.layers.35.self_attn 8.0414 bpw - exp. error: 0.00105421
78
+ -- model.layers.35.mlp 8.0346 bpw - exp. error: 0.00170070
79
+ -- model.layers.36.self_attn 8.0414 bpw - exp. error: 0.00073896
80
+ -- model.layers.36.mlp 8.0346 bpw - exp. error: 0.00176191
81
+ -- model.layers.37.self_attn 8.0414 bpw - exp. error: 0.00075559
82
+ -- model.layers.37.mlp 8.0346 bpw - exp. error: 0.00165809
83
+ -- model.layers.38.self_attn 8.0414 bpw - exp. error: 0.00065418
84
+ -- model.layers.38.mlp 8.0346 bpw - exp. error: 0.00117587
85
+ -- model.layers.39.self_attn 8.0414 bpw - exp. error: 0.00041204
86
+ -- model.layers.39.mlp 8.0346 bpw - exp. error: 0.00097704
87
+ -- sum(log(err)): -530.376730
88
+ -- max(err): 0.003490