Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

100 contributors

History: 123 commits

Nanobit's picture

feat: validate sample packing requires flash_attention (#1465)

bf4cd67 unverified 8 months ago

core
fix(dataset): normalize tokenizer config and change hash from tokenizer class to tokenizer path (#1298) 8 months ago
e2e
strip out hacky qlora-fsdp workarounds now that qlora-fsdp fixes are upstreamed (#1428) 8 months ago
fixtures
Respect sequence_len in config for `type: llama2_chat` (#926) 12 months ago
monkeypatch
support for true batches with multipack (#1230) 10 months ago
prompt_strategies
Feat: Add sharegpt multirole (#1137) 8 months ago
utils
Add shifted sparse attention (#973) [skip-ci] 10 months ago
test_data.py

2.23 kB

Fix pretraining with iterable/streaming Dataset (#556) about 1 year ago
test_datasets.py

9.83 kB

Support loading datasets saved via save_to_disk (#1432) 8 months ago
test_dict.py

3.15 kB

Pydantic 2.x cfg (#1239) 9 months ago
test_expand_mask.py

1.43 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_freeze.py

8.91 kB

Train parameters exclusively in specific ranges (#1390) 9 months ago
test_normalize_config.py

2.66 kB

more fixes 20240228 (#1342) [skip ci] 9 months ago
test_packed_batch_sampler.py

3.32 kB

support for true batches with multipack (#1230) 10 months ago
test_packed_dataset.py

2.28 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_packed_pretraining.py

2.7 kB

Pretrain transforms (#1261) 10 months ago
test_prompt_tokenizers.py

19.1 kB

ORPO (#1419) 8 months ago
test_prompters.py

4.39 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_schedulers.py

1.72 kB

Scheduler implementation of Continual Pre-Training of Large Language Models: How to (re)warm your model? (#1273) 10 months ago
test_tokenizers.py

2.51 kB

Support for additional_special_tokens (#1221) [skip ci] 10 months ago
test_validation.py

34.1 kB

feat: validate sample packing requires flash_attention (#1465) 8 months ago