Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
formll
/
resolving-scaling-law-discrepancies
like
3
Follow
Foundations of Robust Machine Learning Lab
2
RefinedWeb
EleutherAI/OpenWebText2
open_lm
arxiv:
2406.19146
License:
mit
Model card
Files
Files and versions
Community
main
resolving-scaling-law-discrepancies
/
dataset=rw
/
hparams=base_warmup=short_decay=chinchilla
/
params=28M_maxstep=4424
1 contributor
History:
3 commits
TomerPorian
Delete epoch_xx.pt file
8f4cc1e
verified
5 months ago
flop_2.00e+17_step_2218.pt
Safe
179 MB
LFS
Add files using large-upload tool
5 months ago
flop_4.00e+17_step_4434.pt
Safe
179 MB
LFS
Add files using large-upload tool
5 months ago