Nanobit commited on
Commit
3a2edc8
1 Parent(s): f7a2263

Feat(doc): Add features to doc (#583)

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -2,6 +2,18 @@
2
 
3
  Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
4
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  <table>
6
  <tr>
7
  <td>
 
2
 
3
  Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
4
 
5
+ Features:
6
+ - Train various Huggingface models such as llama, pythia, falcon, mpt
7
+ - Supports fullfinetune, lora, qlora, relora, and gptq
8
+ - Customize configurations using a simple yaml file or CLI overwrite
9
+ - Load different dataset formats, use custom formats, or bring your own tokenized datasets
10
+ - Integrated with xformer, flash attention, rope scaling, and multipacking
11
+ - Works with single GPU or multiple GPUs via FSDP or Deepspeed
12
+ - Easily run with Docker locally or on the cloud
13
+ - Log results and optionally checkpoints to wandb
14
+ - And more!
15
+
16
+
17
  <table>
18
  <tr>
19
  <td>