Hugging Face's logo
John Leimgruber III's picture
19 4 73

John Leimgruber III

ubergarm
21world's profile picture Andhika1996's profile picture
·
https://emptyduck.com

AI & ML interests

Open LLMs and Astrophotography image processing.

Organizations

None yet

ubergarm's activity

New activity in bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF 28 days ago

Observation: 4-bit quantization can't answer the Strawberry prompt

11
#2 opened 28 days ago by ThePabli
New activity in bartowski/SuperNova-Medius-GGUF about 1 month ago

63.17 MMLU-Pro Computer Science with `Q8_0`
#2 opened about 1 month ago by ubergarm
New activity in bartowski/qwen2.5-7b-ins-v3-GGUF about 1 month ago

Benchmarks worse than Qwen2.5-7B-Instruct on MMLU-Pro Computer Science in limited testing.
#1 opened about 1 month ago by ubergarm
New activity in bartowski/Qwen2.5-32B-Instruct-GGUF about 2 months ago

Promising looking results on 24GB VRAM folks!

9
#3 opened about 2 months ago by ubergarm
New activity in deepseek-ai/DeepSeek-V2.5 about 2 months ago

Awesome model

6
#5 opened 2 months ago by dillfrescott
New activity in bartowski/DeepSeek-V2.5-GGUF about 2 months ago

vram usage of each?

3
#1 opened 2 months ago by jasonden
New activity in bartowski/Mistral-Large-Instruct-2407-GGUF 4 months ago

Works good generating python on my 64GB RAM w/ 3090TI 24GB VRAM dev box

3
#2 opened 4 months ago by ubergarm

Chat template

3
#3 opened 4 months ago by sydneyfong

Can you please provide the command to change the context size?

5
#1 opened 4 months ago by yehiaserag
New activity in qwp4w3hyb/Meta-Llama-3.1-8B-Instruct-iMat-GGUF 4 months ago

The first GGUF that works with long context on llama.cpp!

3
#1 opened 4 months ago by ubergarm
New activity in MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF 4 months ago

And where is the GGUF file itself?

12
#1 opened 4 months ago by Anonimus12345678902
New activity in CompendiumLabs/mistral-nemo-instruct-2407-gguf 4 months ago

Got it working in llama.cpp! Thanks!

1
#1 opened 4 months ago by ubergarm
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 4 months ago

Error loading model in llama.cpp ?

8
#1 opened 4 months ago by ubergarm
New activity in gradientai/Llama-3-70B-Instruct-Gradient-262k 6 months ago

Prompt Format

4
#6 opened 6 months ago by JamesConley
New activity in OpenGVLab/InternVL-Chat-V1-5 6 months ago

Quantized model coming?

8
#3 opened 7 months ago by dnhkng
New activity in failspy/InternVL-Chat-V1-5-4bit 6 months ago

Output is empty

2
#3 opened 6 months ago by bingw5
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 6 months ago

~8 tok/sec with ~5k context on vLLM with Flash Attention and `kv_cache_dtype="fp8"` on 3090TI 24GB VRAM

2
#2 opened 6 months ago by ubergarm
New activity in MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.3-32k-GGUF 7 months ago

The f16 with 32k ctx fits nicely in 24GB VRAM

5
#3 opened 7 months ago by ubergarm
New activity in stabilityai/stable-cascade 9 months ago

AttributeError: 'generator' object has no attribute 'image_embeddings'

1
#26 opened 9 months ago by MohamedRashad