onkarpandit-g42
commited on
Commit
•
98d773e
1
Parent(s):
1dffdad
Update README.md
Browse files
README.md
CHANGED
@@ -248,7 +248,7 @@ evaluation setup, we input a lengthy irrelevant text (the haystack) along with a
|
|
248 |
needle), which is embedded within this text. The model's task is to answer the question by locating and extracting the
|
249 |
needle from the text.
|
250 |
|
251 |
-
We plot the accuracies of the model at retrieving the needle from the given context.
|
252 |
We observe that jais-30b-chat-v3 is improved over jais-30b-chat-v1 as it can answer the question upto 8k context
|
253 |
lengths.
|
254 |
|
|
|
248 |
needle), which is embedded within this text. The model's task is to answer the question by locating and extracting the
|
249 |
needle from the text.
|
250 |
|
251 |
+
We plot the accuracies of the model at retrieving the needle from the given context. We conducted evaluations for both Arabic and English languages. For brevity, we are presenting the plot for Arabic only.
|
252 |
We observe that jais-30b-chat-v3 is improved over jais-30b-chat-v1 as it can answer the question upto 8k context
|
253 |
lengths.
|
254 |
|