Hugging Face's logo
Michael Han's picture
127 18 197

Michael Han

shimmyshimmer
malavwarke's profile picture zeeshan73's profile picture efecelik's profile picture
·
https://unsloth.ai

AI & ML interests

None yet

Recent Activity

new activity about 15 hours ago
unsloth/DeepSeek-R1-GGUF:UD-IQ1_M models for distilled R1 versions?
new activity about 15 hours ago
unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit:thank you for the great work, can this be converted to gguf?
new activity about 15 hours ago
unsloth/DeepSeek-R1-GGUF:Got it running after downloading some RAM!
View all activity

Organizations

Unsloth AI's profile picture Hugging Face Discord Community's profile picture

shimmyshimmer's activity

New activity in unsloth/DeepSeek-R1-GGUF about 15 hours ago

UD-IQ1_M models for distilled R1 versions?

2
#6 opened 1 day ago by
SamPurkis
New activity in unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit about 15 hours ago

thank you for the great work, can this be converted to gguf?

1
#1 opened 1 day ago by
asidaddy
New activity in unsloth/DeepSeek-R1-GGUF about 15 hours ago

Got it running after downloading some RAM!

2
#7 opened 1 day ago by
ubergarm
New activity in unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF about 16 hours ago

Update README.md

1
#5 opened 1 day ago by
promiseokoli
New activity in unsloth/DeepSeek-V3-GGUF about 16 hours ago

Dynamic quants

2
#13 opened 1 day ago by
XelotX
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF about 16 hours ago

Dynamic Quant?

1
#5 opened about 19 hours ago by
wyes1
New activity in unsloth/DeepSeek-R1-GGUF about 16 hours ago

Inference speed

2
#9 opened about 23 hours ago by
Iker
New activity in unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF 2 days ago

Error loading on lm-studio

3
#1 opened 8 days ago by
victor-Des
New activity in unsloth/DeepSeek-R1-GGUF 2 days ago

license issue

2
#3 opened 5 days ago by
sandi99

Are the Q4 and Q5 models R1 or R1-Zero

18
#2 opened 9 days ago by
gng2info
New activity in unsloth/DeepSeek-R1-GGUF 4 days ago

What is the VRAM requirement to run this ?

5
#1 opened 9 days ago by
RageshAntony

Llama.cpp server chat template

2
#4 opened 4 days ago by
softwareweaver
New activity in unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit 6 days ago

Llama 3.2 vision 11B model for OCR task

1
#1 opened 6 days ago by
Pavankumar03
New activity in unsloth/Llama-3.3-70B-Instruct-GGUF 6 days ago

can vllm launch this model?

5
#2 opened about 1 month ago by
chopin1998
New activity in unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 7 days ago

Quality vs 4bnb version

5
#2 opened 8 days ago by
supercharge19
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF 8 days ago

Please consider awq version

1
#4 opened 9 days ago by
destranged
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF 9 days ago

IQ4_XS?

1
#1 opened 9 days ago by
AaronFeng753
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 9 days ago

The `tokenizer_config.json` is missing the `chat_template` jinja?

1
#1 opened 9 days ago by
ubergarm
New activity in unsloth/DeepSeek-R1-Distill-Qwen-14B-GGUF 9 days ago

unknown pre-tokenizer type: 'deepseek-r1-qwen'

7
#1 opened 9 days ago by
Neman
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF 9 days ago

Use with ollama

1
#2 opened 9 days ago by
Michael22