Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /monkeypatch

100 contributors

History: 39 commits

casperhansen's picture

Implement fused modules (#747)

15d3a65 unverified over 1 year ago

btlm_attn_hijack_flash.py

2.32 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
fastchat_conversation_turns.py

6.42 kB

use fastchat conversations template (#578) over 1 year ago
fused_modules.py

0 Bytes

Implement fused modules (#747) over 1 year ago
llama_attn_hijack_flash.py
26.8 kB

Implement fused modules (#747) over 1 year ago
llama_attn_hijack_sdp.py

4.67 kB

standardize attn hijack patches (#381) over 1 year ago
llama_attn_hijack_xformers.py

5.55 kB

standardize attn hijack patches (#381) over 1 year ago
llama_embeddings_hijack.py

1.37 kB

add noisy embedding (#721) over 1 year ago
llama_expand_mask.py

1.92 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
llama_landmark_attn.py

47.8 kB

Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var over 1 year ago
mistral_attn_hijack_flash.py
22.3 kB

Mistral: Sliding Window Attention with Flash Attention and Sample Packing (#732) over 1 year ago
mistral_embeddings_hijack.py

1.38 kB

add noisy embedding (#721) over 1 year ago
relora.py

14 kB

fix checkpints on multigpu (#481) over 1 year ago
stablelm_attn_hijack_flash.py

15.4 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
utils.py

4.2 kB

Implement fused modules (#747) over 1 year ago
xpos_rope_llama_monkey_patch.py

3.34 kB

add support to extend context with xpos rope over 1 year ago