README.md

metadata

license: llama2

UGround

• Homepage: https://osu-nlp-group.github.io/UGround/

• Repository: https://github.com/OSU-NLP-Group/UGround

• Papaer: https://arxiv.org/abs/2410.05243

• Demo: https://huggingface.co/spaces/orby-osu/UGround

• Point of Contact: Boyu Gou

• Model Weights

• Code

  • Inference Code of UGround
  • Offline Experiments
    • Screenspot (along with referring expressions generated by GPT-4/4o)
    • Multimodal-Mind2Web
    • OmniAct
  • Online Experiments
    • Mind2Web-Live
    • AndroidWorld

• Data

  • Data Examples
  • Data Construction Scripts
  • Guidance of Open-source Data
  • Full Data

• Online Demo (HF Spaces)