Hugging Face's logo

jinaai
/
jina-bert-flash-implementation

Transformers
bert
custom_code
Inference Endpoints
🇪🇺 Region: EU
Model card Files Community
18
jina-bert-flash-implementation

Commit History

Added GLUMLP, changed config accordingly, added code to convert state_dict
0211324

Markus28 commited on

feat: updated activation checkpointing (#14)
4ed66c0
verified

Markus28 commited on

fix: use staticmethod istead of classmethod
6f8e8c5

Markus28 commited on

feat: added comment
d9a681b

Markus28 commited on

feat: added docstrings
dae5c58

Markus28 commited on

feat: Allow LoRA to be merged into weights (#12)
702e6c9
verified

Markus28 commited on

feat: added README
284316d

Markus28 commited on

removed num_tasks from config
6546b2c

Markus28 commited on

feat: removed tokenizer
559b3ae

Markus28 commited on

feat: removed task type embeddings
8e3d0b8

Markus28 commited on

fix: remove cleaving (#13)
139b4a5
verified

Markus28 commited on

fix: added trust_remote_code to tokenizer
9689b77

Markus28 commited on

fix: fixed from_bert method
151f328

Markus28 commited on

fix: fix LoRA implementation
20706dd

Markus28 commited on

feat: cleave off layers from encoder (#11)
b641603
verified

Markus28 commited on

feat: only apply select_task_for_layer if task has changed
462e28d

Markus28 commited on

feat: make num of loras part of the config
a416a9d

Markus28 commited on

feat: make main parameters trainable
cdf5490

Markus28 commited on

fix BertForMaskedLM
c0b46cc

Markus28 commited on

feat: added separate BertForMaskedLM class
3cb3930

Markus28 commited on

feat-add-constant-for-task-type-ids (#10)
11b09c9
verified

michael-guenther commited on

feat: added return_dict
59c0808

Markus28 commited on

fix: fixed syntax error in LoRA
e93b0fd

Markus28 commited on

feat: add current_task to forward
9410275

Markus28 commited on

feat: use property in LoRA parametrization
0ff7c3d

Markus28 commited on

feat: added LoRA copyright notice
faa9951

Markus28 commited on

feat: use property instead of setter
6aad619

Markus28 commited on

feat: return from_bert for from_pretrained
5549314

Markus28 commited on

support-fast-tokenizer (#6)
ed1b276
verified

jupyterjazz commited on

feat: made from_bert work
851184a

Markus28 commited on

feat: choose flash attention heuristically if not set explicitly
2e2b8d0

Markus28 commited on

feat: select first LoRA upon initialization
fabeb13

Markus28 commited on

feat: formatting and type hints
617fe56

Markus28 commited on

fix: use proper initilization for embedding layer
850b9a2

Markus28 commited on

fix: fixed typo
5c4e4bf

Markus28 commited on

feat: added LoRA
8561a1f

Markus28 commited on

feat: assert return_dict
326b1c4

Markus28 commited on

fix: same assertions in other models
c1d92c9

Markus28 commited on

fix: assert is None for other kwargs too
3f5615c

Markus28 commited on

feat: added head_mask
599c64e

Markus28 commited on

added classifier dropout
767b681

Markus28 commited on

fix: formatting
ae4c28c

Markus28 commited on

fix: formatting
f115a1d

Markus28 commited on

feat: added further GLUE models
ec37ae5

Markus28 commited on

feat: added BertForSequenceClassification
ba24fb1

Markus28 commited on

fix: cast mask to bool
ca5f516

Markus28 commited on

reference the flash attention GitHub
eec6c0e

Markus28 commited on