habanoz
/

TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-2.2epochs-oasst1-top1-instruct-V1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

habanoz commited on Nov 21, 2023

Commit

c5bfdee

•

1 Parent(s): 74cd9eb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ accelerate launch $BASE_DIR/qlora/train.py \
   --output_dir $BASE_DIR/$OUTPUT_NAME-peft \
   --merged_output_dir $BASE_DIR/$OUTPUT_NAME \
   --final_output_dir $BASE_DIR/$OUTPUT_NAME-final \
-  --num_train_epochs 1 \
   --logging_steps 1 \
   --save_strategy steps \
   --save_steps 75 \

   --output_dir $BASE_DIR/$OUTPUT_NAME-peft \
   --merged_output_dir $BASE_DIR/$OUTPUT_NAME \
   --final_output_dir $BASE_DIR/$OUTPUT_NAME-final \
+  --num_train_epochs 2 \
   --logging_steps 1 \
   --save_strategy steps \
   --save_steps 75 \