Hugging Face's logo

mlx-community
/
Llama-3.1-Nemotron-70B-Instruct-HF-8bit

Text Generation
Transformers
Safetensors
MLX
English
llama
nvidia
llama3.1
conversational
text-generation-inference
8-bit precision
Model card Files Community
6

Upload folder using huggingface_hub

#3
by schroneko - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+35
-410594
Files changed (18) hide show
  1. .gitattributes +1 -0
  2. README.md +1 -1
  3. model-00001-of-00015.safetensors +2 -2
  4. model-00002-of-00015.safetensors +2 -2
  5. model-00003-of-00015.safetensors +2 -2
  6. model-00004-of-00015.safetensors +2 -2
  7. model-00005-of-00015.safetensors +2 -2
  8. model-00006-of-00015.safetensors +2 -2
  9. model-00007-of-00015.safetensors +2 -2
  10. model-00008-of-00015.safetensors +2 -2
  11. model-00009-of-00015.safetensors +2 -2
  12. model-00010-of-00015.safetensors +2 -2
  13. model-00011-of-00015.safetensors +2 -2
  14. model-00012-of-00015.safetensors +2 -2
  15. model-00013-of-00015.safetensors +2 -2
  16. model-00014-of-00015.safetensors +2 -2
  17. model-00015-of-00015.safetensors +2 -2
  18. tokenizer.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -17,7 +17,7 @@ fine-tuning: false
17
 
18
  # mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit
19
 
20
- The Model [mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit](https://huggingface.co/mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit) was converted to MLX format from [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) using mlx-lm version **0.19.1**.
21
 
22
  ## Use with mlx
23
 
 
17
 
18
  # mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit
19
 
20
+ The Model [mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit](https://huggingface.co/mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit) was converted to MLX format from [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) using mlx-lm version **0.19.0**.
21
 
22
  ## Use with mlx
23
 
model-00001-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c369434b8e5388151c86a3fce6548759719ff169a4c84ac8c51b1121d2eb55af
3
- size 5162938575
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62afcadae2d5168fd84432a0a8550b0571e13415710a0199d626086c0e44c4b5
3
+ size 5162938579
model-00002-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ca62fd95c4949113f7389494773fb14c118121f3be72adb484229247b09b37c
3
- size 5205343244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97b493d310926732a7461369011488793aac2baf8cf7958d72d46940628e9f52
3
+ size 5205343236
model-00003-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82a8761d4295170fe4ac242563ebf9278cb30faee328a0ed563e0e8777337174
3
- size 5365774823
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5eb3cf5010bc1478970de5361af36b1495eb56180a6f46254611d10e9ec9ca0
3
+ size 5365774815
model-00004-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e395a84223a27dcece15a846a3c9fef5252742eb77dd4c184f8d74311ba42f5b
3
- size 5134006885
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c800b3df10458fd0db081edc375f3f719210155b0a32b9aa31e79ce1d132b34
3
+ size 5134006863
model-00005-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f9e2f587abd498b5a4d85d756e6298649a52d6ad0ab69243e42a92d95d9f0078
3
- size 5205343388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:721764ad8707a5e31158544a8f3e797d56f73e2605dc7682e7a484de4a2b89c9
3
+ size 5205343384
model-00006-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:84ff09fc1993c9a644d6a3a5a9e2718b8c621770166975e192325ad1cf6813c9
3
- size 5205343345
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b58e50ec4af533121a9f8315c8a1df2bb4062e9c9e8dcef9d5eedc22831b621e
3
+ size 5205343355
model-00007-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c39d9b993f742c9df44dfa592e50813b21fd0e5b2462e5ab649cbd07cbb401b7
3
- size 5365774809
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ac5b63099f4e4ec805e9165c7d282e75ff50520faa3ece6eb37f5a29062be0f
3
+ size 5365774825
model-00008-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:efea3f2e42dd0f85d4ff7d99ed8e0e51fbd1e627eaf4fa456dff738fbbafbe47
3
- size 5134006875
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:454147291578d8cd051317e580f2c4c5fb10f20d98c907772b16ddbda8ed94ce
3
+ size 5134006849
model-00009-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1e4793a8dbed08d284e53e9367a29d1effc460ed05e576fe781d8286780eccb
3
- size 5205343378
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1609474c1d49007dc91ca5003f0fd9b9652a915d6d60afc19d88d1937c862fbf
3
+ size 5205343372
model-00010-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c4039dc2f81a6a526b3e942648d7a4d28f545df02869a7b6c93e5c491cb8ad7
3
- size 5205343347
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:916ea47c41bf611f22e124aa10f6efd861b3446609c40ad7533fa09cd41a041f
3
+ size 5205343369
model-00011-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5fe182ea36e3ebef2e85887b690126e44358edff2b11016f86ad34931f941c29
3
- size 5365774789
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b51484e9ba98919c919e1401a06466112e1ba39a7356791b5110d75dc464dfdf
3
+ size 5365774793
model-00012-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54ea0c884b4c36d2c464efe13540d2505cdd8808a7ce43815ac1d589e71c9f3c
3
- size 5134006901
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c920a08a6a6083a358508c62f16182fac51baf2187fa4a046d99cf56750438f1
3
+ size 5134006871
model-00013-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:385472a0236dc9f398e5d9f16f6c5575e86c68a4990e83608a447b21389caca8
3
- size 5205343376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c5f0dd09ecb1f25285cfb0cc7e17552f062fa642cbbd807edb24b3cf92e48a3
3
+ size 5205343360
model-00014-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96b307fef6ada91e7b4e67bf988ec3b0e67804770e8798b8583797940325f025
3
- size 5205343369
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c81b949074487770fa5e419d49e0582f62316afb66de5867f601a8b7f3276a8d
3
+ size 5205343363
model-00015-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03289dccbc9d3ec33db8a8ed28fbbcebd9f63f1bdbebdfb4a5077617b77cf0d0
3
- size 1865074261
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f35474696a9f25d677ee265b38ebe24a30e021beed1e3f3956f32e3e25234e8
3
+ size 1865074267
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff