OFIR SHIN's picture

1 1

OFIR SHIN

ofirst

·

AI & ML interests

None yet

Recent Activity

New activity 10 days ago

microsoft/OmniParser:Missing configuration files for transformer support

Reacted to merve's post with 🔥 11 days ago

Microsoft released a groundbreaking model that can be used for web automation, with MIT license 🔥 https://huggingface.co/microsoft/OmniParser Interesting highlight for me was Mind2Web (a benchmark for web navigation) capabilities of the model, which unlocks agentic behavior for RPA agents. no need for hefty web automation pipelines that get broken when the website/app design changes! Amazing work. Lastly, the authors also fine-tune this model on open-set detection for interactable regions and see if they can use it as a plug-in for VLMs and it actually outperforms off-the-shelf open-set detectors like GroundingDINO. 👏 OmniParser is a state-of-the-art UI parsing/understanding model that outperforms GPT4V in parsing.

upvoted a paper 28 days ago

LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding

View all activity

Organizations

None yet

ofirst's activity

New activity in microsoft/OmniParser 10 days ago

Missing configuration files for transformer support

#30 opened 11 days ago by