16.5 GB

1 contributor

History: 175 commits

allegro-lab

Add comprehensive model card for hubble-1b-500b_toks-perturbed-neox

161078a verified 7 days ago

configs
upload_1b_neox.py 5 months ago
.gitattributes

1.52 kB

initial commit 5 months ago
README.md

20.7 kB

Add comprehensive model card for hubble-1b-500b_toks-perturbed-neox 7 days ago
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_14_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_15_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_16_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_17_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_18_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_19_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_20_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_21_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_22_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_23_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_24_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_25_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_26_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_27_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_28_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_29_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_30_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_31_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_8_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
bf16_zero_pp_rank_9_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
442 MB
xet

upload_1b_neox.py 5 months ago
layer_00-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
206 MB
xet

upload_1b_neox.py 5 months ago
layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_03-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_04-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_07-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_08-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_09-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_10-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_14-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
122 MB
xet

upload_1b_neox.py 5 months ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)