2 contributors

History: 37 commits

yhavinga

Saving weights and log of step 501

f95015e over 3 years ago

clean
Saving weights and logs of step 900 over 3 years ago
runs
Saving weights and log of step 501 over 3 years ago
.gitattributes

737 Bytes

initial commit over 3 years ago
.gitignore

38 Bytes

Saving weights and logs of step 300 over 3 years ago
Determine_batch_size.ipynb

6.45 kB

Saving weights and logs of step 16000 over 3 years ago
Load_preprocessed_dataset.ipynb

3.54 kB

Saving weights and logs of step 16000 over 3 years ago
Load_token_group_dataset.ipynb

34.1 kB

Update scripts. Add dataset load check notebook over 3 years ago
config.json

1.42 kB

Update scripts to work around collator valueerror. Update weights over 3 years ago
create_config.py

148 Bytes

Add config, tokenizer and training script over 3 years ago
flax_model.msgpack

892 MB
LFS

Saving weights and log of step 501 over 3 years ago
flax_to_pt.py

158 Bytes

Saving weights and logs of step 600 over 3 years ago
opt_state.msgpack

1.99 MB
LFS

Saving weights and log of step 501 over 3 years ago
pytorch_model.bin

892 MB
LFS

Saving weights and log of step 501 over 3 years ago
run_t5.sh

1.4 kB

Update scripts to work around collator valueerror. Update weights over 3 years ago
run_t5_mlm_flax.py

73 Bytes

Add config, tokenizer and training script over 3 years ago
run_t5_mlm_flax_custom_dataset.py

44.4 kB

Update scripts to work around collator valueerror. Update weights over 3 years ago
streaming_dataset_filter_test.py

546 Bytes

Saving weights and logs of step 1500 over 3 years ago
t5_tokenizer_model.py

76 Bytes

Add config, tokenizer and training script over 3 years ago
tokenizer.json

1.03 MB

Retrain tokenizer for case sensitive over 3 years ago
train_tokenizer.py

2 kB

Retrain tokenizer for case sensitive over 3 years ago
training_state.json

13 Bytes

Saving weights and log of step 501 over 3 years ago