Toots' MLX Quants - a mrtoots Collection

mrtoots 's Collections

Toots' MLX Quants

Evaluation Leaderboards

Video Gen Spaces

Video Gen Repos

Image Diffusion Spaces

Image Diffusion Repos

Gen Audio Spaces

Gen Audio Repos

LLM Train & Merge & Tune & Analyze

Uncategorized Spaces

Tag & Train & Test & Refine Spaces

Tag & Train & Test & Refine Repos

Toots' MLX Quants

updated 20 days ago

Various MLX quants for testing on Mac systems.

mrtoots/unsloth-GLM-4.6-mlx-3Bit

Text Generation • 353B • Updated Oct 1 • 251
mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit

Text Generation • 31B • Updated Aug 30 • 286
mrtoots/Tongyi-DeepResearch-30B-A3B-mlx-8Bit

Text Generation • 31B • Updated Sep 17 • 17
mrtoots/unsloth-GLM-4.5-MLX-3Bit

Text Generation • 353B • Updated Sep 1 • 61 • 1
mrtoots/unsloth-DeepSeek-V3.1-MLX-2Bit

Text Generation • 671B • Updated Aug 29 • 86
mrtoots/unsloth-gpt-oss-120b-mlx-8Bit

Text Generation • 117B • Updated Aug 31 • 107
mrtoots/unsloth-GLM-4.5-Air-MLX-8Bit

Text Generation • 107B • Updated Sep 1 • 44
mrtoots/Wayfarer-Large-70B-Llama-3.3-mlx-8Bit

Text Generation • 71B • Updated Aug 28 • 21
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-8Bit

123B • Updated Aug 29 • 21
mrtoots/unsloth-GLM-4.5-MLX-2Bit

Text Generation • 353B • Updated Aug 28 • 30
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-4Bit

123B • Updated Aug 29 • 12
mrtoots/Wayfarer_Eris_Noctis-12B-mlx-6Bit

Text Generation • 3B • Updated Aug 28 • 16
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit

107B • Updated Aug 29 • 39
mrtoots/L3.3-GeneticLemonade-Unleashed-70B-mlx-8Bit

Text Generation • 71B • Updated Aug 29 • 16
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-4Bit

107B • Updated Sep 10 • 31
mrtoots/CharGen-v3-mini-mlx-fp16

Text Generation • 5B • Updated Aug 30 • 5
mrtoots/Impish_Nemo_12B-mlx-8Bit

12B • Updated Aug 30 • 16 • 1
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-8Bit

12B • Updated Aug 31 • 8
mrtoots/unsloth-gpt-oss-20b-mlx-fp16

Text Generation • 21B • Updated Aug 31 • 112
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-8Bit

123B • Updated Aug 31 • 15
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-4Bit

123B • Updated Aug 31 • 18
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-6Bit

12B • Updated Sep 1 • 3
mrtoots/Nova-70B-Llama-3.3-mlx-8Bit

Text Generation • 71B • Updated Sep 4 • 24
mrtoots/Wayfarer-2-12B-mlx-8Bit

Text Generation • 12B • Updated Sep 4 • 6
mrtoots/Nova-70B-Llama-3.3-mlx-fp16

Text Generation • 71B • Updated Sep 4 • 15
mrtoots/Wayfarer-2-12B-mlx-6Bit

Text Generation • 12B • Updated Sep 4 • 7
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-8Bit

123B • Updated Sep 10 • 17
mrtoots/unsloth-Hermes-4-405B-mlx-2Bit

Text Generation • 406B • Updated Sep 10 • 30
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-4Bit

123B • Updated Sep 10 • 15
mrtoots/unsloth-Hermes-4-405B-mlx-3Bit

Text Generation • 406B • Updated Sep 11 • 28
mrtoots/Steelskull-L3.3-Nevoria-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 16
mrtoots/Hermes-3-Llama-3.1-405B-mlx-2Bit

Text Generation • 406B • Updated Sep 14 • 33
mrtoots/Steelskull-L3.3-Cu-Mai-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 9
mrtoots/Steelskull-L3.3-MS-Nevoria-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 31
mrtoots/Steelskull-L3.3-Electra-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 18
mrtoots/Steelskull-L3.3-Shakudo-70b-mlx-8Bit

71B • Updated Sep 14 • 31
mrtoots/BruhzWater-Sapphira-L3.3-70b-0.1-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 30
mrtoots/unsloth-Qwen3-235B-A22B-Thinking-2507-mlx-4Bit

Text Generation • 235B • Updated Sep 14 • 56
mrtoots/unsloth-Qwen3-235B-A22B-Instruct-2507-mlx-4Bit

Text Generation • 235B • Updated Sep 14 • 66
mrtoots/unsloth-Magistral-Small-2509-mlx-8Bit

24B • Updated Sep 17 • 38 • 1
mrtoots/SimpleChat-30BA3B-V2-mlx-8Bit

Text Generation • 31B • Updated Sep 20 • 5 • 1
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-3Bit

Text Generation • 671B • Updated Sep 23 • 194
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-2Bit

Text Generation • 671B • Updated Sep 23 • 220
mrtoots/unsloth-GLM-4.6-mlx-4Bit

Text Generation • 353B • Updated Oct 2 • 176
mrtoots/TheDrummer-Skyfall-31B-v4-mlx-4Bit

31B • Updated Oct 6 • 43