Commits · Dovakiins/qwerrwe

Update Readme to include support for Mixtral8X22B (#1518) [skip ci]

bcaa923
unverified

Atlas commited on Apr 17

Update README.md (#1521) [skip ci]

7d9bafc
unverified

YTING commited on Apr 17

add docs around pre-processing (#1529)

e07dcb2
unverified

winglian commited on Apr 16

Feat: update doc (#1475) [skip ci]

c2b64e4
unverified

Nanobit commited on Apr 4

Added pip install ninja to accelerate installation of flash-attn (#1461)

cae608f
unverified

melvinebenezer commited on Apr 2

Reorganize Docs (#1468)

86b7d22
unverified

hamel commited on Apr 1

docs: update link to docs of advance topic in README.md (#1437)

324d59e
unverified

pphuc25 commited on Mar 25

chore(config): refactor old mistral config (#1435)

f1ebaa0
unverified

Nanobit commited on Mar 25

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

629450c
unverified

hamel commited on Mar 22

support galore once upstreamed into transformers (#1409)

dd449c5
unverified

winglian commited on Mar 19

Feat: Add sharegpt multirole (#1137)

40a88e8
unverified

Nanobit commited on Mar 19

Add a config not to shuffle merged dataset (#1394) [skip ci]

43bdc5d
unverified

seungduk

winglian commited on Mar 19

fix(config): passing gradient_checkpoint_kwargs (#1412)

b1e3e1b
unverified

Nanobit commited on Mar 19

Update README.md (#1418)

e8c8ea6
unverified

jbl commited on Mar 18

Fix(readme): Improve README QuickStart info (#1408)

f083aed
unverified

Nanobit commited on Mar 16

Feat(readme): Add instructions for Google GPU VM instances (#1410)

868c339
unverified

Nanobit commited on Mar 16

Add QLoRA + FSDP Docs (#1403)

8b12468
unverified

hamel commited on Mar 14

JarvisLabs (#1372)

638c2da
unverified

winglian commited on Mar 7

add docs for `input_output` format (#1367) [skip ci]

ed70a08
unverified

hamel commited on Mar 6

Remove unsupported python version 3.9 from README (#1364) [skip ci]

3765747
unverified

Nicolas Rojas commited on Mar 6

fix for protected model_ namespace w pydantic (#1345)

6b3b271
unverified

winglian commited on Feb 28

Mps mistral lora (#1292) [skip ci]

0f6af36
unverified

Maxime

Nanobit

winglian commited on Feb 27

ADD: push checkpoints to mlflow artifact registry (#1295) [skip ci]

d756534
unverified

JohanWork

Nanobit

winglian commited on Feb 26

chore: update readme to be more clear (#1326) [skip ci]

c6b01e0
unverified

Nanobit commited on Feb 26

Pydantic 2.x cfg (#1239)

cc3cebf
unverified

winglian commited on Feb 26

fix(readme): Clarify doc for tokenizer_config (#1323) [skip ci]

2ed52bd
unverified

Nanobit commited on Feb 24

fix(readme): update inference md link (#1311) [skip ci]

3d2cd80
unverified

Nanobit commited on Feb 21

Add seq2seq eval benchmark callback (#1274)

5a5d474
unverified

LeonardoEmili commited on Feb 13

Scheduler implementation of Continual Pre-Training of Large Language Models: How to (re)warm your model? (#1273)

8430db2
unverified

jinwonkim93 commited on Feb 13

allow the optimizer prune ratio for ReLoRA to be configurable (#1287)

4b997c3
unverified

winglian commited on Feb 12

Update README.md (#1281)

b2a4cb4
unverified

hamel commited on Feb 9

add support for https remote yamls (#1277)

9bca7db
unverified

hamel commited on Feb 9

allow remote data paths (#1278)

91cf4ee
unverified

hamel commited on Feb 8

copy edits (#1276)

1daecd1
unverified

winglian commited on Feb 8

Add link to axolotl cloud image on latitude (#1275)

4a654b3
unverified

winglian commited on Feb 8

contributor avatars (#1269)

411293b
unverified

winglian commited on Feb 7

add contact info for dedicated support for axolotl [skip ci] (#1243)

dfd1885
unverified

winglian commited on Feb 1

support for true batches with multipack (#1230)

00568c1
unverified

winglian commited on Feb 1

Fix and document test_datasets (#1228)

5787e1a
unverified

DreamGenX

winglian commited on Jan 31

Peft lotfq (#1222)

4cb7900
unverified

winglian commited on Jan 28

Feat/chatml add system message (#1117)

98b4762
unverified

mhenrichsen Mads Henrichsen

winglian commited on Jan 25

Mixtral fixes 20240124 (#1192) [skip ci]

54d2ac1
unverified

winglian commited on Jan 24

update docs [skip ci] (#1176)

b715cd5
unverified

winglian commited on Jan 23

Fine-Tuning Mistral-7b for Real-World Chatbot Applications Using Axolotl (Lora used) (#1155)

cc25039
unverified

Tilemachos Chatzipapas twenty8th

winglian commited on Jan 23

Update README.md (#1169) [skip ci]

9135b9e
unverified

Ayush Singh commited on Jan 23

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

782b6a4
unverified

winglian

Nanobit commited on Jan 22

Deprecate max packed sequence len (#1141)

2ce5c0d
unverified

winglian commited on Jan 20

feat(dataset): add config to keep processed dataset in memory (#1152)

3db5f2f
unverified

Nanobit commited on Jan 20

Fix link for Minotaur model (#1146) [skip-ci]

08b8ba0
unverified

jrc commited on Jan 18

Add shifted sparse attention (#973) [skip-ci]

1d70f24
unverified

jrc joecummings

winglian commited on Jan 18

Commit History

Update Readme to include support for Mixtral8X22B (#1518) [skip ci] bcaa923 unverified

Update README.md (#1521) [skip ci] 7d9bafc unverified

add docs around pre-processing (#1529) e07dcb2 unverified

Feat: update doc (#1475) [skip ci] c2b64e4 unverified

Added pip install ninja to accelerate installation of flash-attn (#1461) cae608f unverified

Reorganize Docs (#1468) 86b7d22 unverified

docs: update link to docs of advance topic in README.md (#1437) 324d59e unverified

chore(config): refactor old mistral config (#1435) f1ebaa0 unverified

Bootstrap Hosted Axolotl Docs w/Quarto (#1429) 629450c unverified

support galore once upstreamed into transformers (#1409) dd449c5 unverified

Feat: Add sharegpt multirole (#1137) 40a88e8 unverified

Add a config not to shuffle merged dataset (#1394) [skip ci] 43bdc5d unverified

fix(config): passing gradient_checkpoint_kwargs (#1412) b1e3e1b unverified

Update README.md (#1418) e8c8ea6 unverified

Fix(readme): Improve README QuickStart info (#1408) f083aed unverified

Feat(readme): Add instructions for Google GPU VM instances (#1410) 868c339 unverified

Add QLoRA + FSDP Docs (#1403) 8b12468 unverified

JarvisLabs (#1372) 638c2da unverified

add docs for `input_output` format (#1367) [skip ci] ed70a08 unverified

Remove unsupported python version 3.9 from README (#1364) [skip ci] 3765747 unverified

fix for protected model_ namespace w pydantic (#1345) 6b3b271 unverified

Mps mistral lora (#1292) [skip ci] 0f6af36 unverified

ADD: push checkpoints to mlflow artifact registry (#1295) [skip ci] d756534 unverified

chore: update readme to be more clear (#1326) [skip ci] c6b01e0 unverified

Pydantic 2.x cfg (#1239) cc3cebf unverified

fix(readme): Clarify doc for tokenizer_config (#1323) [skip ci] 2ed52bd unverified

fix(readme): update inference md link (#1311) [skip ci] 3d2cd80 unverified

Add seq2seq eval benchmark callback (#1274) 5a5d474 unverified

Scheduler implementation of Continual Pre-Training of Large Language Models: How to (re)warm your model? (#1273) 8430db2 unverified

allow the optimizer prune ratio for ReLoRA to be configurable (#1287) 4b997c3 unverified

Update README.md (#1281) b2a4cb4 unverified

add support for https remote yamls (#1277) 9bca7db unverified

allow remote data paths (#1278) 91cf4ee unverified

copy edits (#1276) 1daecd1 unverified

Add link to axolotl cloud image on latitude (#1275) 4a654b3 unverified

contributor avatars (#1269) 411293b unverified

add contact info for dedicated support for axolotl [skip ci] (#1243) dfd1885 unverified

support for true batches with multipack (#1230) 00568c1 unverified

Fix and document test_datasets (#1228) 5787e1a unverified

Peft lotfq (#1222) 4cb7900 unverified

Feat/chatml add system message (#1117) 98b4762 unverified

Mixtral fixes 20240124 (#1192) [skip ci] 54d2ac1 unverified

update docs [skip ci] (#1176) b715cd5 unverified

Fine-Tuning Mistral-7b for Real-World Chatbot Applications Using Axolotl (Lora used) (#1155) cc25039 unverified

Update README.md (#1169) [skip ci] 9135b9e unverified

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] 782b6a4 unverified

Deprecate max packed sequence len (#1141) 2ce5c0d unverified

feat(dataset): add config to keep processed dataset in memory (#1152) 3db5f2f unverified

Fix link for Minotaur model (#1146) [skip-ci] 08b8ba0 unverified

Add shifted sparse attention (#973) [skip-ci] 1d70f24 unverified