AD

Erater's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 1 day ago

24GB VRAM Optimal Quants

Collection

When asked what I use locally on a 24GB card, this is what I point to. I favor exl2s for long context, GGUF for very short context. • 11 items • Updated 9 days ago • 2