Wolfram Ravenwolf

wolfram

AI & ML interests

Local LLMs

Articles

Organizations

wolfram's activity

New activity in nvidia/Llama3-ChatQA-1.5-70B 6 months ago

Concerns regarding Prompt Format

6
#1 opened 6 months ago by wolfram
New activity in wolfram/miquliz-120b-v2.0 8 months ago
New activity in wolfram/miquliz-120b-v2.0-GGUF 8 months ago
New activity in wolfram/miquliz-120b-v2.0 8 months ago

VRAM Estimates

6
#3 opened 8 months ago by ernestr

Merge method

1
#4 opened 8 months ago by dnhkng
New activity in wolfram/miqu-1-103b 8 months ago

Can't wait to test

5
#4 opened 9 months ago by froggeric

Kindly asking for quants

7
#2 opened 9 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.5bpw-h6-exl2 8 months ago

Update README.md

#1 opened 8 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.0bpw-h6-exl2 8 months ago

Update README.md

#1 opened 8 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 8 months ago

Update README.md

#1 opened 8 months ago by wolfram
New activity in wolfram/miquliz-120b-v2.0 8 months ago

GPTQ / AWQ

1
#2 opened 8 months ago by agahebr
New activity in wolfram/miqu-1-120b 9 months ago

Guidance on GPU VRAM Split?

5
#3 opened 9 months ago by nmitchko
New activity in wolfram/miqu-1-103b 9 months ago
New activity in wolfram/miquliz-120b-v2.0-GGUF 9 months ago

iMatrix, IQ2_XS & IQ2_XXS

13
#2 opened 9 months ago by Nexesenex
New activity in wolfram/miqu-1-120b 9 months ago

Performance

13
#2 opened 9 months ago by KnutJaegersberg
New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 9 months ago

VRAM requirements

8
#1 opened 9 months ago by sophosympatheia