leaderboard-pr-bot's picture
Adding Evaluation Results
bd2dae4
|
raw
history blame
1.37 kB
metadata
license: apache-2.0
language:
  - en

Model Card

Model Description

Mistral 7B fine-tuned using OpenChat + ShareGPT datasets for multi-turn conversations.

  • Developed by: l3utterfly
  • Funded by: Layla Network
  • Model type: Mistral
  • Language(s) (NLP): English
  • License: Apache-2.0
  • Finetuned from model: Mistral 7B

Uses

Base model used by Layla - the offline personal assistant: https://www.layla-network.ai

Prompt:

User:
Assistant:

Built with Axolotl

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 55.05
ARC (25-shot) 60.15
HellaSwag (10-shot) 83.25
MMLU (5-shot) 60.31
TruthfulQA (0-shot) 48.9
Winogrande (5-shot) 75.93
GSM8K (5-shot) 16.83
DROP (3-shot) 40.01