Younghwan Na
AI & ML interests
Recent Activity
Organizations
yhna's activity
HuggingFaceH4/zephyr-7b-beta
For Accelerate, even though save_state
is a powerful feature, it can be limiting for users with custom serialization workflows. Extending get_state_dict
to support not just models but also optimizers, schedulers, and RNG states would provide more flexibility. Additionally, introducing a load_from_state_dict
method to load these components from user-defined dictionaries would make the library more adaptable and user-friendly.
Thank you for all your hard work!
For Accelerate, it would be great to have clearer distinctions around Plugin and KwargsHandler. Understanding when to use plugins versus handlers (and their compatibility) can be confusing, especially for new users. Streamlining this would make the library even more accessible.
Thank you for all the amazing work!
One improvement Iβd like to suggest is regarding the naming of the notebook_launcher
function in the Hugging Face Accelerate library. While the name is descriptive of its compatibility with Jupyter Notebooks, it might unintentionally limit its discoverability and perceived scope.
The function is actually a versatile tool for spawning distributed training processes programmatically within Python, making it similar in purpose to the Accelerate CLI but in a function-based format. However, because βnotebookβ is in the name, new users (myself included) might assume itβs restricted to Jupyter Notebook environments.
To better reflect its broader utility, I propose renaming it to something more general, such as accelerate_launcher
or distributed_launcher
.
What feature or improvement would make the biggest impact on Hugging Face?
Whether it's the Hub, better documentation, new integrations, or something completely different β we're all ears!
Your feedback shapes the future of Hugging Face. Drop your ideas in the comments below! π