Article
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
•
65
Bal Narendra Sapa
bnsapa
·
AI & ML interests
None yet
Recent Activity
liked
a model
about 2 months ago
nvidia/Nemotron-4-Mini-Hindi-4B-Base
Organizations
None yet
bnsapa's activity
upvoted
3
articles
5 months ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
99
Article
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
•
224