Nathan Habib's picture

Nathan Habib

SaylorTwift

·

AI & ML interests

None yet

Recent Activity

Reacted to elliesleightholm's post with 🤗 2 days ago

I made a beginners guide to Hugging Face Spaces 🤗 I hope it's useful to some of you :) YouTube video: https://www.youtube.com/watch?v=xqdTFyRdtjQ Blog: https://www.marqo.ai/blog/how-to-create-a-hugging-face-space

posted an update 2 days ago

How do I test an LLM for my unique needs? If you work in finance, law, or medicine, generic benchmarks are not enough. This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models. https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md

Reacted to Symbol-LLM's post with 🔥 2 days ago

🥳 Thrilled to introduce our recent efforts on bootstrapping VLMs for multi-modal chain-of-thought reasoning ! 📕 Title: Vision-Language Models Can Self-Improve Reasoning via Reflection 🔗 Link: https://huggingface.co/papers/2411.00855 😇Takeaways: - We found that VLMs can self-improve reasoning performance through a reflection mechanism, and importantly, this approach can scale through test-time computing. - Evaluation on comprehensive and diverse Vision-Language reasoning tasks are included !

View all activity

Articles

Open LLM Leaderboard: DROP deep dive

What's going on with the Open LLM Leaderboard?

Organizations

SaylorTwift's activity

New activity in hf-doc-build/doc-build 2 months ago

Create lighteval/_versions.yml

#28 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

bump-transformers-to-4.41.1

#753 opened 6 months ago by

apply-ruff

#748 opened 6 months ago by

New activity in open-llm-leaderboard/GenerationVisualizer 6 months ago

bbh_math_fixes

#1 opened 6 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

Understanding raw result data files

#729 opened 7 months ago by

No good way to identify number of activated parameters causes MIxtral evaluation failures

#680 opened 7 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 7 months ago

GSM8K failure with Llama 3 finetunes

#703 opened 7 months ago by

New activity in open-llm-leaderboard-old/results 7 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#57 opened 7 months ago by

New activity in open-llm-leaderboard-old/requests 7 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#102 opened 7 months ago by

New activity in databricks/dbrx-base 8 months ago

Update README.md

#16 opened 8 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

Model evaluation failed after 2 days

#622 opened 9 months ago by

bigstral and bigyi both failed

#628 opened 9 months ago by

New activity in open-llm-leaderboard-old/results 9 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#46 opened 9 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#45 opened 9 months ago by

New activity in google/gemma-7b 9 months ago

Fix typo

#15 opened 9 months ago by

New activity in open-llm-leaderboard-old/details_google__gemma-2b 9 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#1 opened 9 months ago by

New activity in open-llm-leaderboard-old/details_google__gemma-7b 9 months ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#1 opened 9 months ago by

New activity in open-llm-leaderboard-old/requests 9 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#59 opened 9 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#58 opened 9 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 10 months ago

Model not found on hub

#584 opened 10 months ago by