Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
raincandy-uΒ 
posted an update Jun 12
Post
2347
πŸ€— I trained what is probably the smallest (600k ~) TinyStories model! It really can write grammatically correct stories!

raincandy-u/TinyStories-656K

Try this space based on this minuscule model!

raincandy-u/Story-Teller

Edit: Moreover, the model weight size is only 1.31MB under bf16, and can be reduced to the 700KB level when using Q8_0 quantization U‒ェ‒*U

Edit: Now 1000K params chat model!

raincandy-u/TinyChat-1776K
shaikatasif

greatworks, can you share us the steps how you trained etc. if possible

Β·
raincandy-u

https://github.com/Ce-daros/Tinystory-LM

Repo here!

In this post