Post
207
AI & ML interests
None defined yet.
EricFillionΒ
posted an
update 14 days ago
EricFillionΒ
posted an
update 16 days ago
Post
2695
3B vs 120B parameter open-source LLMs running locally on a Mac. Your Mac might be more powerful than you think!
https://youtube.com/shorts/JdKtIdlnPs8?feature=share
https://youtube.com/shorts/JdKtIdlnPs8?feature=share
-
- 2 replies
EricFillionΒ
posted an
update 21 days ago
Post
3698
Run open-source models with up to 120B parameters locally on your Mac!
https://youtu.be/Ql4PDjoxNXQ?si=3yHpz51uinUjgyNh
https://youtu.be/Ql4PDjoxNXQ?si=3yHpz51uinUjgyNh
-
- 2 replies
EricFillionΒ
posted an
update 23 days ago
Post
263
I just launched three new open-source Python packages!
Eric Chat: Run LLMs locally, securely and offline on macOS through a GUI. Quantized models up to 120 billion parameters are supported.
Eric Transformer: Pre-train, fine-tune and perform inference with LLMs.
Eric Search: A vector database with built-in text ranking that scales to millions of documents while remaining fast. Integrates easily with Eric Transformer to enable RAG.
https://youtu.be/hgP4eBVfmFM
Eric Chat: Run LLMs locally, securely and offline on macOS through a GUI. Quantized models up to 120 billion parameters are supported.
Eric Transformer: Pre-train, fine-tune and perform inference with LLMs.
Eric Search: A vector database with built-in text ranking that scales to millions of documents while remaining fast. Integrates easily with Eric Transformer to enable RAG.
https://youtu.be/hgP4eBVfmFM