Mr. Finger's picture

Mr. Finger

Apel-sin

·

AI & ML interests

I do optimized EXL2 quants for 48GB VRAM setups.

Recent Activity

liked a model about 1 hour ago

DBMe/Behemoth-123B-v1.2-2.85bpw-h6-exl2

liked a model about 10 hours ago

DBMe/Mistral-Large-Instruct-2411-2.86bpw-h6-exl2

liked a model 1 day ago

onnx-community/Kokoro-82M-ONNX

View all activity

Organizations

None yet

Apel-sin's activity

New activity in rombodawg/Rombos-LLM-V2.5-Qwen-32b 16 days ago

This model is heavily censored. Can this finetuning be done ontop of an abliterated model?

#3 opened 3 months ago by

New activity in zypcastles/QwQ-32B-Instruct-abliterated about 1 month ago

Exllamav2 quant needed

#1 opened about 1 month ago by

New activity in cgus/Qwen2.5-14B-Instruct-abliterated-v2-exl2 2 months ago

How? :)

#1 opened 2 months ago by

New activity in bartowski/Dracarys2-72B-Instruct-GGUF 3 months ago

Could you please create an EXL2 version?

#1 opened 3 months ago by

New activity in nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B 4 months ago

New data to train

#1 opened 4 months ago by

New activity in bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF 4 months ago

Can u make an exl2 version?

#1 opened 4 months ago by

New activity in TheDrummer/Rocinante-12B-v1.1 4 months ago

Great model!

#4 opened 5 months ago by

New activity in intervitens/mini-magnum-12b-v1.1 5 months ago

Thanx for model

#8 opened 5 months ago by

New activity in mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated 6 months ago

My alternative quantizations.

#3 opened 6 months ago by

New activity in bartowski/Smaug-Llama-3-70B-Instruct-32K-GGUF 7 months ago

Can u make measurement.json for exl2 quantization?

#1 opened 7 months ago by

New activity in LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.65bpw-h6-exl2 7 months ago

4.25bpw version

#1 opened 7 months ago by

New activity in LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.25bpw-h6-exl2 7 months ago

You're the best!

#1 opened 7 months ago by

New activity in failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3 7 months ago

Smaug-Llama-3-70B-Instruct-32K

#3 opened 7 months ago by

New activity in Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_25bpw_exl2 7 months ago

Smaug-Llama-3-70B-Instruct-32K

#1 opened 7 months ago by

New activity in cognitivecomputations/dolphin-2.9.1-mixtral-1x22b 8 months ago

dolphin-2.9.2-codestral-22B

#2 opened 8 months ago by

New activity in NTQAI/Nxcode-CQ-7B-orpo 8 months ago

exl quants please

#3 opened 8 months ago by

New activity in RLHFlow/LLaMA3-iterative-DPO-final 8 months ago

exl2 quants

#2 opened 8 months ago by

New activity in failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 8 months ago

exl2 quants

#3 opened 8 months ago by

New activity in cognitivecomputations/Llama-3-8B-Instruct-abliterated-v2 8 months ago

exl2 quants

#4 opened 8 months ago by

New activity in Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-3000total-bf16 8 months ago

Still broken

#1 opened 8 months ago by