Hugging Face's logo
Kooten's picture
TFLOPS icon 49.6 TFLOPS
24 2 25

Kooten

Kooten
OxyLee's profile picture francoj's profile picture Nacholmo's profile picture
·
https://ko-fi.com/kooten

AI & ML interests

AI lobotomy

Organizations

None yet

Kooten's activity

New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS-6.5bpw-exl2 4 months ago

Issue with model.safetensors.index.json

2
#1 opened 4 months ago by ghostlamp
New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS 4 months ago

Getting a ValueError upon loading the model, tensors are not matching.

3
#1 opened 4 months ago by johann15
New activity in Kooten/Kunoichi-DPO-v2-7B-6bpw-exl2 9 months ago

Help. Getting Gibberish Responses?

6
#1 opened 10 months ago by deleted
New activity in Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 10 months ago

Request for Higher 4bpw Quant

3
#1 opened 10 months ago by deleted
New activity in NeverSleep/MiquMaid-v2-70B-GGUF 10 months ago

Any plan of realeasing q2_k_s quants?

4
#1 opened 10 months ago by stduhpf
New activity in Kooten/MiquMaid-v1-70B-6bpw-exl2 10 months ago

can i request 8bpw?

1
#1 opened 10 months ago by Perpetuity7
New activity in Kooten/MiquMaid-v1-70B-IQ2-GGUF 10 months ago

Thanks man!

10
#1 opened 10 months ago by Nexesenex

Thank you so much for doing this chore. IQ2 > EXL2 @ <3bpw ?

1
#2 opened 10 months ago by ProphetOfBostrom
New activity in Kooten/MiquMaid-v1-70B-3bpw-exl2 10 months ago

More quant?

2
#1 opened 10 months ago by Kotokin
New activity in Kooten/DaringMaid-20B-V1.1 10 months ago

Request for another exl quant

2
#1 opened 10 months ago by Clevyby
New activity in Kooten/DaringMaid-13B 10 months ago

It Delivers!

2
#1 opened 10 months ago by LunarAura
New activity in Kooten/FlatDolphinMaid-8x7B-4bpw-exl2 10 months ago

using context above 4096 - need to set compress_pos_emb above 1?

5
#1 opened 11 months ago by Samvanity
New activity in Kooten/Euryale-1.4-L2-70B-IQ2-GGUF 10 months ago

Kobold can run IQ2

2
#1 opened 10 months ago by Nexesenex
New activity in Kooten/Noromaid-7B-0.4-DPO-4bpw-exl2 10 months ago

This is the other model that had the same problem to my knowledge.

2
#1 opened 10 months ago by Nitral-AI
New activity in Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2 10 months ago

Thanks my dude <3

3
#1 opened 10 months ago by Nitral-AI
New activity in Kooten/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-3.5bpw-exl2 10 months ago

VRAM usage & card recommendations

1
#1 opened 11 months ago by tensiondriven
New activity in Kooten/DaringMaid-20B 11 months ago

Thanks! I like this one :-)

1
#1 opened 11 months ago by ThiloteE
New activity in Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx 11 months ago

exllama version?

2
#1 opened 11 months ago by Nexesenex
New activity in Kooten/DaringMaid-20B-GGUF 11 months ago

Which version of noromaid 0.2 or 0.1 ?

1
#2 opened 11 months ago by anmol989
New activity in Kooten/Clover3-17B-4bpw-exl2 11 months ago

3bpw?

2
#1 opened 11 months ago by idkman2