26
Chroma
🔥
Generate images from text prompts
foil
foilmang
AI & ML interests
None yet
Recent Activity
liked
a Space
about 7 hours ago
silveroxides/Chroma-Extra
liked
a Space
about 7 hours ago
gokaygokay/Chroma
liked
a model
3 days ago
Camais03/camie-tagger-v2
Organizations
liked
2
Spaces
about 7 hours ago
liked
a
model
3 days ago
liked
2
Spaces
4 days ago
updated
a
collection
2 months ago
liked
2
Spaces
2 months ago
liked
a
Space
3 months ago
reacted to
a-r-r-o-w's
post with 🔥
4 months ago
Post
2267
Recently, I've been focusing my learning on the following topics:
- Pytorch internals, specifically the inductor system (roughly ~1 month of experience)
- Triton internals (~8 moe)
- CUDA (~3 moe)
- Understanding fusion patterns in compilers and how to improve them (~1 moe)
- Parallelism strategies for large scale inference optimization (~6-7 moe)
I thought it would be nice to document it somewhere for no particular reason. Maybe someone will find it useful? It's also because I want to get into the habit of writing, but had no motivation to do so. Maybe writing short informal posts will help build the habit.
Since I don't have a personal site, and don't plan to create one in the near future, I think HF posts are best suited for short and informal documentation to share my little discoveries and learnings. If you're interested, strap in!
First post in this series will be on basic study of Pytorch's float32 matmuls and their Triton implementation (nothing much, just the tutorial available on the website), short dive into TF32 and their TFLOPS comparison on an A100 machine.
- Pytorch internals, specifically the inductor system (roughly ~1 month of experience)
- Triton internals (~8 moe)
- CUDA (~3 moe)
- Understanding fusion patterns in compilers and how to improve them (~1 moe)
- Parallelism strategies for large scale inference optimization (~6-7 moe)
I thought it would be nice to document it somewhere for no particular reason. Maybe someone will find it useful? It's also because I want to get into the habit of writing, but had no motivation to do so. Maybe writing short informal posts will help build the habit.
Since I don't have a personal site, and don't plan to create one in the near future, I think HF posts are best suited for short and informal documentation to share my little discoveries and learnings. If you're interested, strap in!
First post in this series will be on basic study of Pytorch's float32 matmuls and their Triton implementation (nothing much, just the tutorial available on the website), short dive into TF32 and their TFLOPS comparison on an A100 machine.
- 3 replies
liked
a
model
4 months ago
liked
a
Space
4 months ago
liked
2
Spaces
5 months ago
updated
a
collection
6 months ago
liked
a
Space
6 months ago
updated
a
collection
6 months ago