Commits · Dovakiins/qwerrwe

skip some flash attn patches unless explicitly enabled (#643)

895f0a0
unverified

winglian commited on Sep 27, 2023

use fastchat conversations template (#578)

e7d3e2d
unverified

winglian commited on Sep 27, 2023

Feat: Add support for upstream FA2 (#626)

19a600a
unverified

Nanobit commited on Sep 26, 2023

Added quotes to the pip install -e command to fix an incompatibility with shells that do glob expansion like zsh (#632)

5e5296a
unverified

Fernando Tarin Morales commited on Sep 25, 2023

Feat(doc): Add eval_sample_packing to doc (#625)

67b9888
unverified

Nanobit commited on Sep 23, 2023

update README w deepspeed info (#605)

c25ba79
unverified

winglian commited on Sep 22, 2023

Feat(data): Allow loading local csv and text (#594)

00dce35
unverified

Nanobit commited on Sep 17, 2023

Feat(doc): Add features to doc (#583)

3a2edc8
unverified

Nanobit commited on Sep 15, 2023

support custom field for completion from yml (#580)

f7a2263
unverified

winglian commited on Sep 15, 2023

update support matrix with btlm and phi (#579)

a5a625f
unverified

winglian commited on Sep 15, 2023

refactor scripts/finetune.py into new cli modules (#550)

861ceca
unverified

winglian

Nanobit commited on Sep 15, 2023

let hf trainer handle torch compile (#516)

a4e1bb6
unverified

winglian

tmm1 commited on Sep 13, 2023

Add training callback to send predictions to WandB table (#521)

5b67ea9
unverified

Glavin001 commited on Sep 13, 2023

document that packaging needs to be installed before flash-attn (#559)

9845c5e
unverified

winglian commited on Sep 12, 2023

ergonomic update to optimizer config doc (#548)

6d57f2f
unverified

The Objective Dad commited on Sep 11, 2023

update readme to point to direct link to runpod template, cleanup install instrucitons (#532)

34c0a86
unverified

winglian commited on Sep 8, 2023

Adding NCCL Timeout Guide (#536)

5e2d8a4
unverified

The Objective Dad commited on Sep 8, 2023

Fix(doc): Inform Windows users to use WSL/docker (#518)

f51c9c5
unverified

Nanobit commited on Sep 1, 2023

Added advanced DDP args (#515)

396a7a7
unverified

Jan Philipp Harries Jan Philipp Harries commited on Aug 31, 2023

support for datasets with multiple names (#480)

5ac3392
unverified

winglian commited on Aug 29, 2023

Fix(doc): Clarify no amp to full yaml docs (#496)

48c5647
unverified

Nanobit commited on Aug 29, 2023

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

8e197f6
unverified

Birch-san

tmm1 commited on Aug 28, 2023

Feat(doc): Update eval_steps doc (#487)

ad8be43
unverified

Nanobit commited on Aug 27, 2023

ReLoRA implementation (with quantization) (#322)

bde3c5a
unverified

chargoddard

winglian commited on Aug 24, 2023

Fix(doc): Clarify config (#466)

55c23c7
unverified

Nanobit commited on Aug 23, 2023

feat: add Metharme prompt strategy (#446)

f474650
unverified

TearGosling

Nanobit commited on Aug 22, 2023

feat(docs): improve user customized prompts (#443)

04a42b6
unverified

Nanobit commited on Aug 21, 2023

feat(doc): add pillow to lambda instructions (#445)

919f4ca
unverified

Nanobit commited on Aug 21, 2023

support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348)

d2e7f27
unverified

winglian commited on Aug 20, 2023

docs(readme): add `cd axolotl` (#440)

d21318d
unverified

philpax commited on Aug 19, 2023

use save_strategy from config if available (#434)

b3f5e00
unverified

winglian commited on Aug 19, 2023

flash attn pip install (#426)

cf66547
unverified

mhenrichsen Ubuntu mhenrichsen Mads Henrichsen

winglian commited on Aug 18, 2023

Fix(docs): Remove gptq+lora and fix xformer compat list (#423)

3d1f203
unverified

Nanobit commited on Aug 16, 2023

hopefully improve the README (#419)

2495909
unverified

winglian commited on Aug 15, 2023