2 contributors

History: 35 commits

yhavinga

Update scripts to work around collator valueerror. Update weights

d9993eb about 3 years ago

clean
Saving weights and logs of step 900 about 3 years ago
runs
Update scripts to work around collator valueerror. Update weights about 3 years ago
.gitattributes

737 Bytes

initial commit about 3 years ago
.gitignore

38 Bytes

Saving weights and logs of step 300 about 3 years ago
Determine_batch_size.ipynb

6.45 kB

Saving weights and logs of step 16000 about 3 years ago
Load_preprocessed_dataset.ipynb

3.54 kB

Saving weights and logs of step 16000 about 3 years ago
Load_token_group_dataset.ipynb

34.1 kB

Update scripts. Add dataset load check notebook about 3 years ago
config.json

1.42 kB

Update scripts to work around collator valueerror. Update weights about 3 years ago
create_config.py

148 Bytes

Add config, tokenizer and training script about 3 years ago
flax_model.msgpack

892 MB
LFS

Update scripts to work around collator valueerror. Update weights about 3 years ago
flax_to_pt.py

158 Bytes

Saving weights and logs of step 600 about 3 years ago
opt_state.msgpack

1.99 MB
LFS

Update scripts to work around collator valueerror. Update weights about 3 years ago
pytorch_model.bin

892 MB
LFS

Update scripts to work around collator valueerror. Update weights about 3 years ago
run_t5.sh

1.4 kB

Update scripts to work around collator valueerror. Update weights about 3 years ago
run_t5_mlm_flax.py

73 Bytes

Add config, tokenizer and training script about 3 years ago
run_t5_mlm_flax_custom_dataset.py

44.4 kB

Update scripts to work around collator valueerror. Update weights about 3 years ago
streaming_dataset_filter_test.py

546 Bytes

Saving weights and logs of step 1500 about 3 years ago
t5_tokenizer_model.py

76 Bytes

Add config, tokenizer and training script about 3 years ago
tokenizer.json

1.03 MB

Add config, tokenizer and training script about 3 years ago
train_tokenizer.py

2.05 kB

Add config, tokenizer and training script about 3 years ago
training_state.json

15 Bytes

Update scripts to work around collator valueerror. Update weights about 3 years ago