Spaces:
Runtime error
Runtime error
Updating link to blog in app
Browse files
app.py
CHANGED
@@ -85,7 +85,7 @@ with st.sidebar:
|
|
85 |
st.subheader('About the project')
|
86 |
with st.expander("All languages are NOT created (tokenized) equal!"):
|
87 |
|
88 |
-
link="The purpose of this project is to compare the tokenization length for different languages. For some tokenizers, tokenizing a message in one language may result in 10-20x more tokens than a comparable message in another language (e.g. try English vs. Burmese). This is part of a larger project of measuring inequality in NLP. See the original article: [All languages are NOT created (tokenized) equal](https://
|
89 |
st.markdown(link)
|
90 |
|
91 |
|
|
|
85 |
st.subheader('About the project')
|
86 |
with st.expander("All languages are NOT created (tokenized) equal!"):
|
87 |
|
88 |
+
link="The purpose of this project is to compare the tokenization length for different languages. For some tokenizers, tokenizing a message in one language may result in 10-20x more tokens than a comparable message in another language (e.g. try English vs. Burmese). This is part of a larger project of measuring inequality in NLP. See the original article: [All languages are NOT created (tokenized) equal](https://www.artfish.ai/p/all-languages-are-not-created-tokenized)"
|
89 |
st.markdown(link)
|
90 |
|
91 |
|