Updated inference code in README.md

README.md

@@ -1,12 +1,11 @@
 ---
 base_model: meta-llama/Meta-Llama-3-8B
-library_name: peft
 license: llama3
 tags:
 - axolotl
 - generated_from_trainer
 model-index:
-- name: llama_3_translator_v3
+- name: Egyptian-Arabic-Translator-Llama-3-8B
   results: []
 ---
 
@@ -113,6 +112,72 @@ This model is an attempt to create a small translation model from English to Egy
 
 - Translating instruction finetuning and text generation datasets
 
+## Inference code
+
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
+
+tokenizer = AutoTokenizer.from_pretrained("ahmedsamirio/Egyptian-Arabic-Translator-Llama-3-8B")
+model = AutoModelForCausalLM.from_pretrained("ahmedsamirio/Egyptian-Arabic-Translator-Llama-3-8B")
+pipe = pipeline(task='text-generation', model=model, tokenizer=tokenizer)
+
+
+en_template = """<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
+
+### Instruction:
+Translate the following text to English.
+
+### Input:
+{text}
+
+### Response:
+"""
+
+ar_template = """<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
+
+### Instruction:
+Translate the following text to Arabic.
+
+### Input:
+{text}
+
+### Response:
+"""
+
+eg_template = """<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
+
+### Instruction:
+Translate the following text to Egyptian Arabic.
+
+### Input:
+{text}
+
+### Response:
+"""
+
+text = """Some habits are known as "keystone habits," and these influence the formation of other habits. \
+For example, identifying as the type of person who takes care of their body and is in the habit of exercising regularly, \
+can also influence eating better and using credit cards less. In business, \
+safety can be a keystone habit that influences other habits that result in greater productivity.[17]"""
+
+ar_text = pipe(ar_template.format(text=text), 
+               max_new_tokens=256, 
+               do_sample=True, 
+               temperature=0.3, 
+               top_p=0.5)
+
+
+eg_text = pipe(eg_template.format(text=ar_text), 
+               max_new_tokens=256, 
+               do_sample=True, 
+               temperature=0.3, 
+               top_p=0.5)
+
+print("Original Text:" text)
+print("\nArabic Translation:", ar_text)
+print("\nEgyptian Arabic Translation:", eg_text)
+```
+
 ## Training and evaluation data
 
 [ahmedsamirio/oasst2-9k-translation](https://huggingface.co/datasets/ahmedsamirio/oasst2-9k-translation)