Sao10K
/

L3-8B-Stheno-v3.3-32K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Sao10K commited on Jun 22, 2024

Commit

6a13613

·

verified ·

1 Parent(s): 3e03e7c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ Notes:
 <br>\- This model works when tested in bf16 with the same configs as within the file.
 <br>\- I do not know the effects quantisation has on it.
 <br>\- Roleplays pretty well. Feels nice in my opinion.
-<br>\- As mentioned earlier, it has some issues on long context understanding and reasoning. Much better vs rope scaling normally though, so that is a plus.
 <br>\- Reminder, this isn't a native 32K model. It has it's issues, but it's coherent and working well.
 Sanity Check // Needle in a Haystack Results:

 <br>\- This model works when tested in bf16 with the same configs as within the file.
 <br>\- I do not know the effects quantisation has on it.
 <br>\- Roleplays pretty well. Feels nice in my opinion.
+<br>\- It has some issues on long context understanding and reasoning. Much better vs rope scaling normally though, so that is a plus.
 <br>\- Reminder, this isn't a native 32K model. It has it's issues, but it's coherent and working well.
 Sanity Check // Needle in a Haystack Results: