Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
93
Mert
mertgulexe
·
AI & ML interests
None yet
Recent Activity
liked
a model
14 days ago
mosaicml/mpt-7b
Organizations
None yet
mertgulexe's activity
upvoted
5
articles
6 months ago
Article
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
•
63
Article
Introduction to Quantization cooked in 🤗 with 💗🧑🍳
By
•
•
19Article
🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware
•
37
Article
Overview of natively supported quantization schemes in 🤗 Transformers
•
11