JVice commited on
Commit
f0262ad
1 Parent(s): 2e0c65d

text changes

Browse files
Files changed (1) hide show
  1. app.py +12 -11
app.py CHANGED
@@ -141,7 +141,7 @@ def setup_how_to():
141
  expander.image(Image.open('./assets/HF_MODEL_ID_EXAMPLE.png'))
142
  expander.write("3. Test your chosen model by generating an image using an input prompt e.g.: 'A corgi with some cool sunglasses'\n")
143
  expander.image(Image.open('./assets/lykon_corgi.png'))
144
- expander.write("4. Navigate to the '\U0001F30E General Eval.' or '\U0001F3AF Task-Oriented Eval.' tabs "
145
  " to evaluate your model once it has been loaded\n"
146
  "5. Once you have generated some evaluation images, head over to the '\U0001F4C1 Generated Images' tab to have a look at them\n"
147
  "6. To check out your evaluations or all of the TBYB Community evaluations, head over to the '\U0001F4CA Model Comparison' tab\n"
@@ -272,32 +272,33 @@ def setup_additional_information_tab(tab):
272
  promise that all T2I models will work - if you run into any issues that you think should be possible, feel
273
  free to reach out!
274
  - Currently, a model_index.json file is required to load models and use them with TBYB, we will look to
275
- address other models in future works
276
  - TBYB only works on T2I models hosted on HuggingFace, other model repositories are not currently supported
277
  - Adaptor models are currently not supported, we will look to add evaluation functionalities of these
278
  models in the future.
279
- - Download, generation, inference and evaluation times are all hardware dependent.
 
280
 
281
  Keep in mind that these constraints may be removed or added to any time.
282
  """)
283
- st.header('4. Misuse, Malicious Use, and Out-of-Scope Use')
284
  st.markdown(
285
  """
286
  Given this application is used for the assessment of T2I biases and relies on
287
  pre-trained models available on HuggingFace, we are not responsible for any content generated
288
  by public-facing models that have been used to generate images using this application.
289
-
290
- TBYB is proposed as an auxiliary tool to assess model biases and thus, if a chosen model is found to output
 
291
  insensitive, disturbing, distressing or offensive images that propagate harmful stereotypes or
292
  representations of marginalised groups, please address your concerns to the model providers.
293
 
294
-
295
  However, given the TBYB tool is designed for bias quantification and is driven by transparency, it would be
296
  beneficial to the TBYB community to share evaluations of biased T2I models!
297
 
298
- We share no association with HuggingFace \U0001F917, we only use their services as a model repository,
299
- given their growth in popularity in the computer science community recently.
300
-
301
 
302
  For further questions/queries or if you want to simply strike a conversation,
303
  please reach out to Jordan Vice at: jordan.vice@uwa.edu.au""")
@@ -307,7 +308,7 @@ setup_how_to()
307
 
308
 
309
  if user_login_create():
310
- tab1, tab2, tab3, tab4, tab5, tab6 = st.tabs(["\U0001F527 Setup", "\U0001F30E General Eval.", "\U0001F3AF Task-Oriented Eval.",
311
  "\U0001F4CA Model Comparison", "\U0001F4C1 Generated Images", "\U0001F4F0 Additional Information"])
312
  setup_additional_information_tab(tab6)
313
 
 
141
  expander.image(Image.open('./assets/HF_MODEL_ID_EXAMPLE.png'))
142
  expander.write("3. Test your chosen model by generating an image using an input prompt e.g.: 'A corgi with some cool sunglasses'\n")
143
  expander.image(Image.open('./assets/lykon_corgi.png'))
144
+ expander.write("4. Navigate to the '\U0001F30E Bias Eval. (BEval)' or '\U0001F3AF Task-Oriented BEval' tabs "
145
  " to evaluate your model once it has been loaded\n"
146
  "5. Once you have generated some evaluation images, head over to the '\U0001F4C1 Generated Images' tab to have a look at them\n"
147
  "6. To check out your evaluations or all of the TBYB Community evaluations, head over to the '\U0001F4CA Model Comparison' tab\n"
 
272
  promise that all T2I models will work - if you run into any issues that you think should be possible, feel
273
  free to reach out!
274
  - Currently, a model_index.json file is required to load models and use them with TBYB, we will look to
275
+ address other models in the future
276
  - TBYB only works on T2I models hosted on HuggingFace, other model repositories are not currently supported
277
  - Adaptor models are currently not supported, we will look to add evaluation functionalities of these
278
  models in the future.
279
+ - Download, generation, inference and evaluation times are hardware dependent. We are currently deploying the
280
+ TBYB space on a T4 GPU. With more funding and usage, we plan on deploying more powerful GPU options.
281
 
282
  Keep in mind that these constraints may be removed or added to any time.
283
  """)
284
+ st.header('4. Disclaimer')
285
  st.markdown(
286
  """
287
  Given this application is used for the assessment of T2I biases and relies on
288
  pre-trained models available on HuggingFace, we are not responsible for any content generated
289
  by public-facing models that have been used to generate images using this application.
290
+
291
+ Bias cannot be easily measured and we do not claim that our approach is without any faults. TBYB is proposed
292
+ as an auxiliary tool to assess model biases and thus, if a chosen model is found to output
293
  insensitive, disturbing, distressing or offensive images that propagate harmful stereotypes or
294
  representations of marginalised groups, please address your concerns to the model providers.
295
 
 
296
  However, given the TBYB tool is designed for bias quantification and is driven by transparency, it would be
297
  beneficial to the TBYB community to share evaluations of biased T2I models!
298
 
299
+ Despite only being able to assess HuggingFace \U0001F917 models, we share no association with them outside of
300
+ hosting TBYB as a HuggingFace space. Given their growth in popularity in the computer science community and their
301
+ host of T2I model repositories, we have decided to host our web-app here.
302
 
303
  For further questions/queries or if you want to simply strike a conversation,
304
  please reach out to Jordan Vice at: jordan.vice@uwa.edu.au""")
 
308
 
309
 
310
  if user_login_create():
311
+ tab1, tab2, tab3, tab4, tab5, tab6 = st.tabs(["\U0001F527 Setup", "\U0001F30E Bias Eval. (BEval)", "\U0001F3AF Task-Oriented BEval.",
312
  "\U0001F4CA Model Comparison", "\U0001F4C1 Generated Images", "\U0001F4F0 Additional Information"])
313
  setup_additional_information_tab(tab6)
314