Migrated all my GPU consuming Spaces to ZERO, it was super easy to do so (add three lines of code and voila!) and the start-up time decreased dramatically as well 💜
17 replies
·
Reacted to philschmid's
post with 👍❤️10 months ago
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with: 💡Define and understand use cases for fine-tuning 🧑🏻💻 Setup of the development environment 🧮 Create and prepare dataset (OpenAI format) 🏋️♀️ Fine-tune LLM using TRL and the SFTTrainer 🥇 Test and evaluate the LLM 🚀 Deploy for production with TGI