Lance's picture

24 5

Lance

clevnumb

·

AI & ML interests

None yet

Organizations

None yet

clevnumb's activity

New activity in anthracite-org/magnum-v2-32b-exl2 4 months ago

Which Quant of this model will fit in VRAM entirely on a single 24GB video card (4090)

#1 opened 4 months ago by

New activity in NeverSleep/Lumimaid-v0.2-12B 4 months ago

My alternate quantizations.

#3 opened 4 months ago by

New activity in bullerwins/Big-Tiger-Gemma-27B-v1-exl2_5.0bpw 4 months ago

Not loading in Latest Tabby (with SillyTavern) - ERROR

#2 opened 4 months ago by

New activity in BigHuggyD/alpindale_magnum-72b-v1_exl2_4.0bpw_h8 5 months ago

what quant should I use to use this with a single 24GB video card (PC) (4090 card)?

#2 opened 5 months ago by

New activity in bartowski/WizardLM-2-8x22B-GGUF 5 months ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

#3 opened 5 months ago by

New activity in AzureBlack/PsyMedRP-v1-20B-8bpw-8h-exl2 6 months ago

Single 4090 using OogaBooga? (Windows 11, 96GB of RAM)

#1 opened 10 months ago by

New activity in jondurbin/bagel-20b-v04 7 months ago

How do I load this in OogaBooga? (text-generation-webui)

#1 opened 7 months ago by

New activity in Wanlau/RVC_datealive 8 months ago

Where do I install these in my install of RVC Webui to they show up as 'inferencing voice' options to select? Somewhere in ASSETS folder? Where?

#1 opened 8 months ago by

New activity in LoneStriker/miquella-120b-3.0bpw-h6-exl2 8 months ago

Will any 120b model currently fit on a single 24GB VRAM card through any app I can run on PC? (aka 4090)

#1 opened 10 months ago by

New activity in supersonic013/Promptmaster-mistral-7b-GGUF 8 months ago

What is the difference between this model and Electrofried/Promptmaster-Mistral-7B-v1-GGUF (which is larger, but older)

#1 opened 8 months ago by

New activity in h94/IP-Adapter-FaceID 9 months ago

Are there safetensor files for the models?

#37 opened 10 months ago by

New activity in LoneStriker/goliath-120b-2.18bpw-h6-exl2 9 months ago

Will this fit on a single 24GB Video card (4090)?

#2 opened 9 months ago by

New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 9 months ago

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

#2 opened 9 months ago by

New activity in miqudev/miqu-1-70b 9 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

#30 opened 9 months ago by

New activity in TeeZee/Kyllene-57B-v1.0-bpw3.0-h6-exl2 10 months ago

Glacially slow on a RTX 4090??

#1 opened 10 months ago by

New activity in LoneStriker/Nous-Capybara-34B-4.0bpw-h6-exl2 about 1 year ago

Which of these 34B model BPW will fit on a single 24GB card's (4090) VRAM?

#1 opened about 1 year ago by

New activity in LoneStriker/Yi-34B-200K-4.0bpw-h6-exl2 about 1 year ago

RTX 4090 using Text-Generation-WebUI / Oogabooga FAILS to load this model with Exllama2 (or any method?)

#1 opened about 1 year ago by

New activity in NousResearch/Obsidian-3B-V0.5 about 1 year ago

How does this compare to LLama 13b models for "visual smarts"

#2 opened about 1 year ago by

New activity in MetaIX/GPT4-X-Alpasta-30b-4bit over 1 year ago

What are the different files for?

#9 opened over 1 year ago by

New activity in TheBloke/guanaco-33B-GPTQ over 1 year ago

Could this model be loaded in 3090 GPU?

#6 opened over 1 year ago by