Munish Kumar's picture

Munish Kumar

munish0838

·

https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Organizations

New activity in QuantFactory/Ahma-3B-GGUF 6 months ago

Improve model card: Add GGUF usage, paper link, and correct metadata

#1 opened 6 months ago by

New activity in OpenMeditron/Meditron3-Gemma2-2B 11 months ago

GGUF

#1 opened 11 months ago by

New activity in QuantFactory/Ministral-3b-instruct-GGUF about 1 year ago

Heads up: this isn't the new ministral 3b

#1 opened about 1 year ago by

New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF about 1 year ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

#1 opened about 1 year ago by

New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF over 1 year ago

Error loading model in llama.cpp ?

#1 opened over 1 year ago by

New activity in QuantFactory/internistai-base-7b-v0.2-GGUF over 1 year ago

Add paper and citation

#1 opened over 1 year ago by

New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF over 1 year ago

What am I doing wrong? Using Oobabooga.

#1 opened over 1 year ago by

does not appear to have a file named config.json

#2 opened over 1 year ago by

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF over 1 year ago

Compatibility with llama-cpp and Ollama

#17 opened over 1 year ago by

New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF over 1 year ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

#1 opened over 1 year ago by

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF over 1 year ago

error when loading the model

#3 opened over 1 year ago by

New activity in mistralai/Codestral-22B-v0.1 over 1 year ago

How to convert to HF format?

#6 opened over 1 year ago by

New activity in internlm/internlm2-math-plus-1_8b over 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened over 1 year ago by

New activity in internlm/internlm2-math-plus-7b over 1 year ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened over 1 year ago by

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF over 1 year ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

#2 opened over 1 year ago by

Working with llama cpp ?

#1 opened over 1 year ago by