MEDDEB's picture

MEDDEB

NOBODY204

·

AI & ML interests

None yet

Recent Activity

replied to codelion's post 14 days ago

The new Claude Sonnet 3.5 model from Anthropic AI has been getting good reviews on since last night. It is quite good at coding related tasks. We tried it on the Static Analysis Eval benchmark (https://huggingface.co/datasets/patched-codes/static-analysis-eval) which measures the ability of a LLM to fix vulnerabilities. The model scores 59.21% which is good but not better than other frontier models (like GPT-4, Gemini-1.5 and LLama-3).

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet