Files changed (2) hide show
  1. README.md +1 -16
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -1,18 +1,3 @@
1
  ---
2
- license: apache-2.0
3
- language:
4
- - en
5
- library_name: transformers
6
- pipeline_tag: text-generation
7
  ---
8
-
9
- [Falcon 7b](https://huggingface.co/tiiuae/falcon-7b) model trained on [FAQ from an ecommerce website](https://www.kaggle.com/datasets/saadmakhdoom/ecommerce-faq-chatbot-dataset).
10
-
11
- ## Tutorials
12
-
13
- - Text tutorial: https://www.mlexpert.io/prompt-engineering/fine-tuning-llm-on-custom-dataset-with-qlora
14
- - YouTube video: https://www.youtube.com/watch?v=DcBC4yGHV4Q
15
-
16
- ## Training
17
-
18
- Fine-tuned using the QLoRA technique (only adapter uploaded). With the help of bitsandbytes, peft and transformers. Full reproduction is available in the tutorials.
 
1
  ---
2
+ library_name: peft
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c507033f393c37833ac3a8932e3ed6d5b92b1f26a6d07763860767f5f4d910fe
3
  size 18898161
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:920a20ec1904a79d70340fc7539cfe1872eb874f0a8da9b62fe00615cef347e8
3
  size 18898161