qwerrwe / src /axolotl /utils /collators.py

Commit History

Multipack simplify for Mixtral (#1142)
6910e6a
unverified

winglian commited on

streaming multipack for pretraining dataset (#959)
553c80f
unverified

jinwonkim93 jinwonkim93@github.com winglian commited on

support for mamba (#915)
40a6362
unverified

winglian commited on

multipack w batch sampler (#795)
641e6f7
unverified

winglian commited on

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on