Open LLM Leaderboard: DROP deep dive
•
4
Nathan Habib
SaylorTwift
AI & ML interests
None yet
Recent Activity
posted
an
update
2 days ago
How do I test an LLM for my unique needs?
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
Reacted to
Symbol-LLM's
post
with 🔥
2 days ago
🥳 Thrilled to introduce our recent efforts on bootstrapping VLMs for multi-modal chain-of-thought reasoning !
📕 Title: Vision-Language Models Can Self-Improve Reasoning via Reflection
🔗 Link: https://huggingface.co/papers/2411.00855
😇Takeaways:
- We found that VLMs can self-improve reasoning performance through a reflection mechanism, and importantly, this approach can scale through test-time computing.
- Evaluation on comprehensive and diverse Vision-Language reasoning tasks are included !
Articles
Organizations
SaylorTwift's activity
liked
a
Space
30 days ago
liked
a
Space
about 1 month ago
liked
a
dataset
about 2 months ago
liked
a
model
2 months ago
liked
a
dataset
2 months ago
liked
2
Spaces
3 months ago
liked
a
Space
4 months ago
liked
a
Space
5 months ago
liked
a
dataset
7 months ago
liked
2
models
8 months ago
liked
a
Space
11 months ago
liked
a
Space
12 months ago
liked
4
models
about 1 year ago
liked
2
Spaces
about 1 year ago