1 contributor

History: 6 commits

hungeni

Extend vocab size from 32000 to 44800, prepare for continued pretrain

bebdb8e over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

1.49 kB

Create README.md over 1 year ago
config.json

685 Bytes

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
generation_config.json

116 Bytes

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
pytorch_model-00001-of-00003.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
9.91 GB
LFS

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
pytorch_model-00002-of-00003.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
9.89 GB
LFS

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
pytorch_model-00003-of-00003.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
7.57 GB
LFS

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
pytorch_model.bin.index.json

24 kB

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
special_tokens_map.json

411 Bytes

Add Tokeninizer over 1 year ago
tokenizer.json

2.19 MB

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
tokenizer.model

708 kB
LFS

Extend vocab size from 32000 to 44800, prepare for continued pretrain over 1 year ago
tokenizer_config.json

727 Bytes

Add Tokeninizer over 1 year ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)