Iftach Arbel

iarbel

AI & ML interests

Optimization Algorithms, NLP, LLMs, CV

Recent Activity

Organizations

Cimphony's profile picture Project Didi's profile picture Neradot ltd's profile picture Chaos Labs's profile picture

iarbel's activity

New activity in cimphony-ai-admin/Cimphony-Mistral-Law-7B about 1 month ago

Fail to run on vLLM

5
#1 opened about 2 months ago by yaronr
New activity in microsoft/Phi-3-mini-4k-instruct 4 months ago

Is it required to add a BOS token?

#92 opened 4 months ago by iarbel
replied to DmitryRyumin's post 6 months ago
view reply

The evaluation benchmarks use zero-shot, where usually few-shot is used. This raises the question whether the few-shot results weren't as good, compared to similar-sized models.

Hopefully the authors will release few-shot results, aligned with common practice (e.g. HF Open LLM Leaderboard)

New activity in Equall/Saul-7B-Instruct-v1 8 months ago

How was the evaluation executed?

1
#3 opened 8 months ago by iarbel