bigcode-models-leaderboard / community_results /stabilityai_stablecode-completion-alpha-3b /stabilityai_stablecode-completion-alpha-3b_loubnabnl.json
loubnabnl's picture
loubnabnl HF staff
add stablecode
b9d3833
raw
history blame contribute delete
743 Bytes
{"results": [{"task": "multiple-js", "pass@1": 0.18981366459627327}, {"task": "humaneval", "pass@1": 0.20195121951219516}, {"task": "multiple-r", "pass@1": 0.008074534161490688}, {"task": "multiple-jl", "pass@1": 0.0}, {"task": "multiple-cpp", "pass@1": 0.20770186335403729}, {"task": "multiple-d", "pass@1": 0.0476923076923077}, {"task": "multiple-rs", "pass@1": 0.020384615384615386}, {"task": "multiple-php", "pass@1": 0.03950310559006212}, {"task": "multiple-java", "pass@1": 0.19544303797468357}, {"task": "multiple-lua", "pass@1": 0.05142857142857145}, {"task": "multiple-swift", "pass@1": 0.009873417721518986}, {"task": "multiple-rkt", "pass@1": 0.0008695652173913058}], "meta": {"model": "stabilityai/stablecode-completion-alpha-3b"}}