Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
formll
/
resolving-scaling-law-discrepancies
like
4
Follow
Foundations of Robust Machine Learning Lab
3
RefinedWeb
EleutherAI/OpenWebText2
open_lm
arxiv:
2406.19146
License:
mit
Model card
Files
Files and versions
Community
main
resolving-scaling-law-discrepancies
/
dataset=rw
/
hparams=base_warmup=short_decay=chinchilla
/
params=347M_maxstep=23440
1 contributor
History:
4 commits
TomerPorian
Delete epoch_xx.pt file
9f78155
verified
8 months ago
flop_1.28e+19_step_11724.pt
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
What is a pickle import?
1.6 GB
LFS
Add files using large-upload tool
8 months ago
flop_2.56e+19_step_23447.pt
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
What is a pickle import?
1.6 GB
LFS
Add files using large-upload tool
8 months ago