Runjin
/

quality-lr5e-06-rr0.1-epochs2-bs16-wd0.01-warmup0.05-Llama3.21B

Generated from Trainer

Model card Files Files and versions Community

quality-lr5e-06-rr0.1-epochs2-bs16-wd0.01-warmup0.05-Llama3.21B

1 contributor

History: 47 commits

Runjin's picture

Training in progress, step 25254

ebaf85c verified 2 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
config.json

884 Bytes

Training in progress, step 549 3 months ago
model.safetensors

2.47 GB
LFS

Training in progress, step 25254 2 months ago
training_args.bin
Detected Pickle imports (13)
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.SchedulerType",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "accelerate.state.PartialState",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.training_args.TrainingArguments",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "torch.device",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.HubStrategy",
- "torch.bfloat16"
How to fix it?
7.03 kB
LFS

Training in progress, step 549 3 months ago