15 3 233

Eugene Siow

eugenesiow

https://eugenesiow.com

AI & ML interests

None yet

Recent Activity

liked a model 5 days ago

Datou1111/shou_xin

upvoted an article 12 days ago

🐺🐦‍⬛ LLM Comparison/Test: 25 SOTA LLMs (including QwQ) through 59 MMLU-Pro CS benchmark runs

Reacted to m-ric's post with 🔥 12 days ago

𝗦𝗵𝗼𝘄𝗨𝗜: 𝗮 𝘀𝗺𝗮𝗹𝗹 𝗲𝗻𝗱-𝘁𝗼-𝗲𝗻𝗱 𝗮𝗴𝗲𝗻𝘁 𝘁𝗵𝗮𝘁 𝗰𝗮𝗻 𝗻𝗮𝘃𝗶𝗴𝗮𝘁𝗲 𝗮𝗻𝘆 𝗨𝗜 𝗮𝗻𝗱 𝗼𝘂𝘁𝗽𝗲𝗿𝗳𝗼𝗿𝗺𝘀 𝗺𝘂𝗰𝗵 𝗯𝗶𝗴𝗴𝗲𝗿 𝘀𝘆𝘀𝘁𝗲𝗺𝘀! 📲 A team from NUS and Microsoft just released an agent that can act on any UI (Desktop, Android, Web) without needing additional text information. It works extremely well : they applied their method on a tiny Qwen2-VL-2B, and they managed to beat methods that use either much more powerful vision models (like GPT-4V) without using any additional info (e.g. leveraging the DOM of a webpage) like previous methods did ! 👏👏 They started from the idea that most existing methods rely heavily on text, which makes them less generalizable, while letting aside rich UI structure that user actually rely on when navigating this interfaces. ⚙️ They put several good ideas to work: 💡 Simplify screenshots to the max: They prune a lot the heavy visual content of UI screenshots, by removing cloned image patches (like any vast patch of the same color will be reduced to a small patch, while maintaining positional embeddings), then group patches from the same GUI elements together to simplify even further 💡 Build a truly generalist dataset: To train a general UI agent, you need trajectories from each possible UI, and express them in a common language. Authors merge datasets like OmniAct for Desktop, Mind2Web for websites, AMEX for Android trajectories to create a high-quality and diverse dataset. ➡️ Nice results ensued: They fine-tune a tiny Qwen-2-VL-2B on their method, and it reaches SOTA on several task (element identification, web navigation), even beating methods that either use additional info from the DOM or use much bigger VLMS like GPT-4v! 🏆 And performance could certainly jump with a slightly bigger vision model. Let's hope the community builds this soon! 🚀 Paper added to my "Agents" collection 👉 https://huggingface.co/collections/m-ric/agents-65ba776fbd9e29f771c07d4e

View all activity

Organizations

eugenesiow's activity

liked a model 5 days ago

Datou1111/shou_xin

Text-to-Image • Updated 9 days ago • 20.7k • • 523

liked a model 14 days ago

Qwen/Qwen2.5-72B-Instruct

Text Generation • Updated Sep 25 • 282k • • 606

liked a model 22 days ago

OuteAI/OuteTTS-0.2-500M

Text-to-Speech • Updated 15 days ago • 18.5k • 269

liked a model 23 days ago

dblasko/blip-dalle3-img2prompt

Image-to-Text • Updated Nov 20, 2023 • 96 • 35

liked a model 24 days ago

voyageai/voyage-3-lite

Updated Sep 17 • 1

liked 2 Spaces 29 days ago

Running on Zero

5.81k

🖥️

FLUX.1 [dev]

Running

290

💻

Qwen2.5 Turbo 1M Demo

liked a dataset 30 days ago

blnewman/arxivDIGESTables

Updated Oct 31 • 83 • 2

liked 3 models about 1 month ago

jinaai/jina-embeddings-v2-base-en

Feature Extraction • Updated Aug 6 • 80.9k • 703

dunzhang/stella_en_1.5B_v5

Alibaba-NLP/gte-Qwen2-1.5B-instruct

liked 4 datasets about 1 month ago

liked a Space about 1 month ago

Running

🥇

MEGA-Bench

A leaderboard for multimodal models

liked 3 models about 1 month ago

chuanli11/Llama-3.2-3B-Instruct-uncensored

Text Generation • Updated Oct 18 • 18.6k • 105

Qwen/Qwen2-VL-7B-Instruct

Image-Text-to-Text • Updated 12 days ago • 2.65M • • 949

google/gemma-2-2b-it

Text Generation • Updated Aug 27 • 405k • 785

liked a Space about 2 months ago

Running

🏆

Open LLM Leaderboard Model Comparator

Compare Open LLM Leaderboard results