hierarchical-transformer-base-4096 / tokenization_hat.py

Commit History

Fix minor bug in auto-chunking tokenization
1578b2b
verified

kiddothe2b commited on

Add mandatory register_for_auto_class function for transformers-4.26+ support
9638d60

kiddothe2b commited on

Add HAT implementation files
af99e83

kiddothe2b commited on

Add HAT implementation files
278b6ef

kiddothe2b commited on