Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TokenBender
/
test_tokenizer_issue

PEFT
Safetensors
trl
sft
Generated from Trainer
Model card Files Files and versions
xet
Community
test_tokenizer_issue
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
TokenBender's picture
TokenBender
Upload folder using huggingface_hub
8cada09 verified over 1 year ago
  • checkpoint-16
    Upload folder using huggingface_hub over 1 year ago
  • checkpoint-24
    Upload folder using huggingface_hub over 1 year ago
  • checkpoint-8
    Upload folder using huggingface_hub over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    1.34 kB
    Upload folder using huggingface_hub over 1 year ago
  • adapter_config.json
    724 Bytes
    Upload folder using huggingface_hub over 1 year ago
  • adapter_model.safetensors
    313 MB
    xet
    Upload folder using huggingface_hub over 1 year ago
  • special_tokens_map.json
    557 Bytes
    Upload folder using huggingface_hub over 1 year ago
  • tokenizer.json
    1.84 MB
    Upload folder using huggingface_hub over 1 year ago
  • tokenizer_config.json
    1.59 kB
    Upload folder using huggingface_hub over 1 year ago
  • training_args.bin

    Detected Pickle imports (9)

    • "transformers.training_args.TrainingArguments",
    • "torch.device",
    • "transformers.training_args.OptimizerNames",
    • "transformers.trainer_utils.HubStrategy",
    • "transformers.trainer_utils.SchedulerType",
    • "accelerate.state.PartialState",
    • "transformers.trainer_pt_utils.AcceleratorConfig",
    • "transformers.trainer_utils.IntervalStrategy",
    • "accelerate.utils.dataclasses.DistributedType"

    How to fix it?

    4.92 kB
    xet
    Upload folder using huggingface_hub over 1 year ago