Hugging Face's logo
Plus Light's picture
17 18

Plus Light

Light4Bear
TheLonelyDevil's profile picture 21world's profile picture fibrosis's profile picture
·

AI & ML interests

None yet

Organizations

dreamgen-preview's profile picture SillyTilly's profile picture Anthracite's profile picture

Light4Bear's activity

New activity in deepseek-ai/DeepSeek-V2-Chat 5 months ago

Join LMSYS Chatbot Arena?

1
#11 opened 6 months ago by Light4Bear
New activity in alpindale/c4ai-command-r-plus-GPTQ 8 months ago

Can VLLM be used for loading?

6
#4 opened 8 months ago by wawoshashi

How many bits and what is the groupsize?

1
#3 opened 8 months ago by vitvit

How to load command r+ in text-generation-webui?

5
#1 opened 8 months ago by MLDataScientist
New activity in abacusai/Liberated-Qwen1.5-72B 9 months ago

GPTQ/AWQ quant that is runable in vllm?

2
#4 opened 9 months ago by Light4Bear
New activity in jondurbin/bagel-34b-v0.4 9 months ago

Difference between v0.2 and v0.4?

1
#2 opened 9 months ago by Light4Bear

Tokenizer is incorrectly tokenizing '<|im_start|>' and '<|im_end|>' as strings
#5 opened 9 months ago by Light4Bear
New activity in dreamgen/opus-v1-34b 9 months ago

Instruct sequences?

12
#2 opened 9 months ago by deleted

What is the context size of this model?

8
#1 opened 9 months ago by MarinaraSpaghetti
New activity in brucethemoose/Yi-34B-200K-RPMerge 9 months ago

Suggestion: increase the weights of instruction-following models.

3
#6 opened 9 months ago by Light4Bear
New activity in LoneStriker/MiquMaid-v2-2x70B-DPO-GPTQ 9 months ago

Safetensor naming convention

10
#1 opened 10 months ago by dannysemi
New activity in LoneStriker/Smaug-72B-v0.1-AWQ 10 months ago

vLLM output gibberish but text-generation-webui is fine

1
#2 opened 10 months ago by Light4Bear
New activity in ShinojiResearch/Senku-70B-Full 10 months ago

GPTQ and AWQ quants

1
#1 opened 10 months ago by Light4Bear
New activity in abacusai/Smaug-72B-v0.1 10 months ago

Congratulations!

10
#1 opened 10 months ago by TomGrc
New activity in bartowski/internlm2-chat-20b-llama-exl2 10 months ago

Difference between this and the non-"test" version?

16
#2 opened 10 months ago by samgreen
New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-6.0bpw-h6-exl2 11 months ago

8.0bpw-h8-exl2 quant of this model

6
#1 opened 11 months ago by Light4Bear
New activity in chavinlo/gpt4-x-alpaca over 1 year ago

fp16 version of the model

1
#6 opened over 1 year ago by Light4Bear