Hugging Face's logo

Diogo-V
/
llama3-nlr-cos-a215b8bb93bc

English
Model card Files Community
Diogo-V commited on
Commit
891ade8
·
verified ·
1 Parent(s): 1eda12d

Upload learned parameters for llama3 in bit 8

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. params/llama3/8/fixed/woq/init/lm_head/scale.pt +0 -0
  2. params/llama3/8/fixed/woq/init/lm_head/zp.pt +0 -0
  3. params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/scale.pt +0 -0
  4. params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/zp.pt +0 -0
  5. params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/scale.pt +0 -0
  6. params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/zp.pt +0 -0
  7. params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/scale.pt +0 -0
  8. params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/zp.pt +0 -0
  9. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/scale.pt +0 -0
  10. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/zp.pt +0 -0
  11. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/scale.pt +0 -0
  12. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/zp.pt +0 -0
  13. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/scale.pt +0 -0
  14. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/zp.pt +0 -0
  15. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/scale.pt +0 -0
  16. params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/zp.pt +0 -0
  17. params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/scale.pt +0 -0
  18. params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/zp.pt +0 -0
  19. params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/scale.pt +0 -0
  20. params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/zp.pt +0 -0
  21. params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/scale.pt +0 -0
  22. params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/zp.pt +0 -0
  23. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/scale.pt +0 -0
  24. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/zp.pt +0 -0
  25. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/scale.pt +0 -0
  26. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/zp.pt +0 -0
  27. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/scale.pt +0 -0
  28. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/zp.pt +0 -0
  29. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/scale.pt +0 -0
  30. params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/zp.pt +0 -0
  31. params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/scale.pt +0 -0
  32. params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/zp.pt +0 -0
  33. params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/scale.pt +0 -0
  34. params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/zp.pt +0 -0
  35. params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/scale.pt +0 -0
  36. params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/zp.pt +0 -0
  37. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/scale.pt +0 -0
  38. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/zp.pt +0 -0
  39. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/scale.pt +0 -0
  40. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/zp.pt +0 -0
  41. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/scale.pt +0 -0
  42. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/zp.pt +0 -0
  43. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/scale.pt +0 -0
  44. params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/zp.pt +0 -0
  45. params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/scale.pt +0 -0
  46. params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/zp.pt +0 -0
  47. params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/scale.pt +0 -0
  48. params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/zp.pt +0 -0
  49. params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/scale.pt +0 -0
  50. params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/zp.pt +0 -0
params/llama3/8/fixed/woq/init/lm_head/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/lm_head/scale.pt and b/params/llama3/8/fixed/woq/init/lm_head/scale.pt differ
 
params/llama3/8/fixed/woq/init/lm_head/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/lm_head/zp.pt and b/params/llama3/8/fixed/woq/init/lm_head/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.down_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.gate_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.mlp.up_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.k_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.o_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.q_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.0.self_attn.v_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.down_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.gate_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.mlp.up_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.k_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.o_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.q_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.1.self_attn.v_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.down_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.gate_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.mlp.up_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.k_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.o_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.q_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.10.self_attn.v_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.down_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.gate_proj/zp.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/scale.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/scale.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/scale.pt differ
 
params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/zp.pt CHANGED
Binary files a/params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/zp.pt and b/params/llama3/8/fixed/woq/init/model.layers.11.mlp.up_proj/zp.pt differ