Hugging Face's logo
raincandy_U's picture
31 9 78

raincandy_U

raincandy-u
SunsetMkt's profile picture faisalhr1997's profile picture Karsh-CAI's profile picture
Ā·

AI & ML interests

å¹»č¦šć€‚

Recent Activity

Reacted to beomi's post with šŸ˜Ž about 2 months ago
# PyTorch == 2.5.0 Breaks Transformers' SDPAttention! When you encounter "RuntimeError: cuDNN Frontend error: [cudnn_frontend] Error: No execution plans support the graph." We can use workaround like this: ```python torch.backends.cuda.enable_cudnn_sdp(False) ``` but this slow downs the performance gain from PyTorch 2.5. Although it is fixed(not "fixed" but default option is turn-off the cuDNN SDPA) at here -- https://github.com/pytorch/pytorch/pull/138587 , but not released yet. (you need to install directly from source) Fastest way for now : pip install "torch<2.5" Ref: https://github.com/huggingface/diffusers/issues/9704#issuecomment-2422585273
View all activity

Organizations

OpenBuddy Community's profile picture šŸŽ€č¶…ēµ¶ęœ€ć‹ć‚šŸŽ€ć¦ć‚“恗恔悃悓's profile picture Social Post Explorers's profile picture Cognitive Computations's profile picture

Posts 2

view post
Post
2347
šŸ¤— I trained what is probably the smallest (600k ~) TinyStories model! It really can write grammatically correct stories!

raincandy-u/TinyStories-656K

Try this space based on this minuscule model!

raincandy-u/Story-Teller

Edit: Moreover, the model weight size is only 1.31MB under bf16, and can be reduced to the 700KB level when using Q8_0 quantization Uā€¢ć‚§ā€¢*U

Edit: Now 1000K params chat model!

raincandy-u/TinyChat-1776K

Collections 4