microsoft/OmniParser
Image-Text-to-Text
β’
Updated
β’
10.8k
β’
1.33k
Hugo Duprez
HugoDzz
AI & ML interests
Product, Svelte, On-device AI
Recent Activity
liked
a model
27 days ago
microsoft/OmniParser
liked
a model
about 1 month ago
stabilityai/stable-diffusion-3.5-large
liked
a Space
about 2 months ago
akhaliq/depth-pro
Organizations
HugoDzz's activity
liked
a
model
27 days ago
liked
a
model
about 1 month ago
liked
a
Space
about 2 months ago
liked
a
model
about 2 months ago
liked
a
Space
4 months ago
updated
a
Space
5 months ago
liked
a
Space
5 months ago
liked
2
models
5 months ago
liked
a
model
7 months ago
liked
3
Spaces
8 months ago
liked
3
Spaces
9 months ago
liked
a
model
10 months ago
liked
2
Spaces
10 months ago
Reacted to
clem's
post with β€οΈ
10 months ago
Post
Is synthetic data the future of AI? π₯π₯π₯
@HugoLaurencon @Leyo & @VictorSanh are introducing HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models ππ»
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
You can explore the dataset here: HuggingFaceM4/WebSight
What do you think?
@HugoLaurencon @Leyo & @VictorSanh are introducing HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models ππ»
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
You can explore the dataset here: HuggingFaceM4/WebSight
What do you think?
- 12 replies