Update README.md

README.md

@@ -37,11 +37,19 @@ This gemma model was trained 2x faster with [Unsloth](https://github.com/unsloth
 ### Running Model:
 
 ```python
+# Importing necessary modules
 from transformers import AutoModelForCausalLM, AutoTokenizer
 
+# Setting the device to load the model onto (assuming GPU availability)
+device = 'cuda'
+
+# Loading the tokenizer for the model
 tokenizer = AutoTokenizer.from_pretrained("pmking27/PrathameshLLM-7B")
+
+# Loading the pre-trained model
 model = AutoModelForCausalLM.from_pretrained("pmking27/PrathameshLLM-7B")
 
+# Defining the Alpaca prompt template
 alpaca_prompt = """
 ### Instruction:
 {}
@@ -52,11 +60,15 @@ alpaca_prompt = """
 ### Response:
 {}"""
 
-inputs = tokenizer(
+# Providing the input to the model
+model_inputs = tokenizer(
 [
     alpaca_prompt.format(
-        '''You're an assistant trained to answer questions using the given context.
+        '''
+        You're an assistant trained to answer questions using the given context.
+        
         context:
+
         General elections will be held in India from 19 April 2024 to 1 June 2024 to elect the 543 members of the 18th Lok Sabha. The elections will be held in seven phases and the results will be announced on 4 June 2024. This will be the largest-ever election in the world, surpassing the 2019 Indian general election, and will be the longest-held general elections in India with a total span of 44 days (excluding the first 1951–52 Indian general election). The incumbent prime minister Narendra Modi who completed a second term will be contesting elections for a third consecutive term.
 
         Approximately 960 million individuals out of a population of 1.4 billion are eligible to participate in the elections, which are expected to span a month for completion. The Legislative assembly elections in the states of Andhra Pradesh, Arunachal Pradesh, Odisha, and Sikkim will be held simultaneously with the general election, along with the by-elections for 35 seats among 16 states.
@@ -64,29 +76,33 @@ inputs = tokenizer(
         "भारतातील सार्वत्रिक निवडणुका किती टप्प्यात पार पडतील?", # input
         "", # output - leave this blank for generation!
     )
-], return_tensors = "pt").to("cuda")
-outputs = model.generate(**inputs, max_new_tokens = 100)
-result=tokenizer.batch_decode(outputs)[0]
-print(result)
-```
+], return_tensors = "pt")
 
-### Output:
+# Moving model inputs to the specified device
+model_inputs.to(device)
+model.to(device)
 
-```markdown
-<bos>
-### Instruction:
-You're an assistant trained to answer questions using the given context.
-        context:
-        General elections will be held in India from 19 April 2024 to 1 June 2024 to elect the 543 members of the 18th Lok Sabha. The elections will be held in seven phases and the results will be announced on 4 June 2024. This will be the largest-ever election in the world, surpassing the 2019 Indian general election, and will be the longest-held general elections in India with a total span of 44 days (excluding the first 1951–52 Indian general election). The incumbent prime minister Narendra Modi who completed a second term will be contesting elections for a third consecutive term.
+# Generating responses from the model
+outputs = model.generate(**model_inputs, max_new_tokens=100)
+decoded_output = tokenizer.batch_decode(outputs, skip_special_tokens=True)[0]
 
-        Approximately 960 million individuals out of a population of 1.4 billion are eligible to participate in the elections, which are expected to span a month for completion. The Legislative assembly elections in the states of Andhra Pradesh, Arunachal Pradesh, Odisha, and Sikkim will be held simultaneously with the general election, along with the by-elections for 35 seats among 16 states.
-        
+# Finding the start and end positions of the response
+start_marker = "### Response:"
+end_marker = "<eos>"
+start_pos = decoded_output.find(start_marker) + len(start_marker)
+end_pos = decoded_output.find(end_marker, start_pos)
 
-### Input:
-भारतातील सार्वत्रिक निवडणुका किती टप्प्यात पार पडतील?
+# Extracting the response text
+response_text = decoded_output[start_pos:end_pos].strip()
 
-### Response:
-भारतातील सार्वत्रिक निवडणुका 7 टप्प्यांमध्ये पार पडतील.<eos>
+print(response_text)
+
+```
+
+### Output:
+
+```markdown
+भारतातील सार्वत्रिक निवडणुका 7 टप्प्यांमध्ये पार पडतील.
 ```