Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
mistralai 's Collections
Mistral Large 3
Ministral 3
Ministral 3 - Additional Checkpoints
Speech Evals

Speech Evals

updated 5 days ago

Synthesized speech evals generated by MistralAI from popular text evaluation datasets to evaluate spoken-language reasoning capabilities of Audio LLMs

Upvote
11

  • mistralai/mmlu_speech

    Viewer • Updated Jul 15 • 14.3k • 582 • 13

  • mistralai/triviaqa_speech

    Viewer • Updated Jul 15 • 17.9k • 231 • 6

  • mistralai/gsm8k_speech

    Viewer • Updated Jul 15 • 1.32k • 138 • 4
Upvote
11
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs