Commit History

update outputs path so that we can mount workspace to /workspace/data (#1623)
4fde300
unverified

winglian commited on

update torch 2.2.1 -> 2.2.2 (#1622)
3319780
unverified

winglian commited on

Fix `total_num_steps` (#1566)
81da7d2
unverified

bofenghuang commited on

FIX: max_length and max_prompt_length was not being sent to ORPOTrainer (#1584)
1e1921b
unverified

alimosavian Ali Mosavian winglian commited on

make sure to save on the last step (#1615)
1634ac8
unverified

winglian commited on

fix attention mask collation (#1603)
0298273
unverified

winglian commited on

add dstack section (#1612) [skip ci]
5d97e65
unverified

chansung winglian commited on

feat: Add LLaMA-3 instruct prompt strategies for fine-tuning (#1553)
50421c8
unverified

Ram Ram winglian commited on

adding llama3 fastchat conversation monkeypatch (#1539)
b32c08f
unverified

Antoni-Joan Solergibert winglian commited on

ignore the fsdp_config section too (#1606) [skip ci]
fff06af
unverified

winglian commited on

make sure to save the lora adapter at the end of RL/dpo training (#1573)
796a085
unverified

winglian commited on

improve tool handling roles (#1587)
cb78a36
unverified

winglian commited on

feat: exclude mamba blocks for jamba (#1578)
8b9c15b
unverified

Nanobit commited on

Pass deepspeed and fsdp as None explicitly when merging adapters to allow custom device_map (#1575)
9e1480e
unverified

chiragjn commited on

Gradio configuration parameters (#1591)
3367fca
unverified

marijnfs Marijn Stollenga Marijn Stollenga winglian commited on

docs(config.qmd): add loraplus example (#1577)
1ac8998
unverified

tpoisonooo commited on

add torch 2.3.0 to builds (#1593)
7018576
unverified

winglian commited on

fix for jupyterlab on cloud start (#1594)
120b809
unverified

winglian commited on

improve save callbacks (#1592)
29cf15a
unverified

winglian commited on

Pass weakref to model in the SIGINT handler to free up model post train function (#1581)
dde02fc
unverified

chiragjn winglian commited on

FIX: TRL trainer preprocessing step was running in one process (#1583)
b9bb169
unverified

Ali Mosavian Ali Mosavian commited on

ADD: warning hub model (#1301)
601c08b
unverified

JohanWork Nanobit commited on

Add debug option for RL dataset preprocessing (#1404)
cc5d31e
unverified

abhinand Nanobit commited on

chore(doc): clarify micro_batch_size (#1579) [skip ci]
1aeece6
unverified

Nanobit commited on

PoSE context length ext (#1567)
5294653
unverified

winglian commited on

Add ORPO example and e2e test (#1572)
98c25e1
unverified

tokestermw commited on

make sure everything stays in the same dtype when using dpo + FSDP (#1559)
68601ec
unverified

winglian commited on

wrap prepared_ds_path in str() to avoid TypeError in fsspec package (#1548)
7477a53
unverified

Frank Ruis winglian commited on

ORPO Trainer replacement (#1551)
7d1d22f
unverified

winglian commited on

fix(yml): update llama-3 config (#1543) [skip ci]
0e8f340
unverified

Nanobit commited on

fix(packages): lock datasets version (#1545)
59ef254
unverified

Nanobit commited on

fix broken linting (#1541)
c10563c
unverified

winglian commited on

Adding Llama-3 qlora (#1536)
37c037c
unverified

aaditya commited on

llama-3 examples (#1537)
15f7910
unverified

winglian commited on

feat(doc): Add example for pad_token (#1535)
d28ba2e
unverified

Nanobit commited on

Create mixtral_22.yml (#1514) [skip ci]
0eadfc8
unverified

Atlas commited on

Update Readme to include support for Mixtral8X22B (#1518) [skip ci]
bcaa923
unverified

Atlas commited on

Update README.md (#1521) [skip ci]
7d9bafc
unverified

YTING commited on

add docs around pre-processing (#1529)
e07dcb2
unverified

winglian commited on

Unsloth gradient checkpointing offload (#1528)
6319da1
unverified

winglian commited on

DBRX Model Support (#1462)
132eb74
unverified

winglian commited on

Update SaveAxolotlConfigtoWandBCallback to use artifact instead of save (#1483)
5ed2939
unverified

tcapelle winglian commited on

use locale agnostic seperator to make large nums easier to read (#1503)
da9b1a3
unverified

winglian commited on

WIP: Support table logging for mlflow, too (#1506)
057fa44
unverified

DavidFarago Dave Farago winglian commited on

Correctly handle splits for datasets.arrow_dataset.Dataset objects (#1504)
8fa0785
unverified

scottifer8 winglian commited on

Print versions (#1496)
4313b1a
unverified

winglian commited on

Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci]
7f17eff
unverified

MaziyarPanahi commited on

add field to sft dataset pydantic for completion support (#1497)
ff01c45
unverified

winglian commited on