Fine-tuning LLMs with Singular Value Decomposition
•
8
Alberto Cetoli PRO
fractalego
AI & ML interests
Entity/relation extraction, Q&A, Summarisation
Recent Activity
upvoted
a
paper
2 days ago
Towards Best Practices for Open Datasets for LLM Training
upvoted
an
article
3 days ago
Visualize and understand GPU memory in PyTorch
liked
a dataset
4 days ago
liminghao1630/TableBank
Articles
Organizations
fractalego's activity
upvoted
a
paper
2 days ago
upvoted
an
article
3 days ago
Article
Visualize and understand GPU memory in PyTorch
•
162
liked
a
dataset
4 days ago
liked
a
model
9 days ago
reacted to
mitkox's
post with 🤯🔥➕
10 days ago
Post
2394
Can it run DeepSeek V3 671B is the new 'can it run Doom'.
How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU.
Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs.
Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU.
Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs.
Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
- 5 replies
liked
2
datasets
15 days ago
updated
a
model
16 days ago
upvoted
3
papers
25 days ago
Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoning
Paper
•
2411.18203
•
Published
•
33
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
Paper
•
2410.02884
•
Published
•
53
Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B
Paper
•
2406.07394
•
Published
•
26
liked
a
model
28 days ago
updated
a
dataset
about 1 month ago
liked
a
model
about 2 months ago
reacted to
julien-c's
post with 🔥
about 2 months ago
Post
2623
wow 😮
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
reacted to
merve's
post with ❤️
about 2 months ago
Post
3165
your hugging face profile now has your recent activities 🤗
liked
2
datasets
about 2 months ago