REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Organization Card
IBM ❤️ Open Source AI
IBM is building enterprise-focused foundation models to drive the future of business.
We strongly believe in the power of collaboration and community-driven development to propel AI forward. As such, we will be hosting our latest open innovations from IBM Research in this Hugging Face organization. We hope that the AI community will find our efforts useful and that our models help fuel their research.
If you have any questions, please visit our discussions page.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 13 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 5 -
ibm-research/AssetOpsBench
Viewer • Updated • 2.81k • 200 • 1 -
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 13 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 5 -
ibm-research/AssetOpsBench
Viewer • Updated • 2.81k • 200 • 1 -
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
spaces
8
pinned
Running
3
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
Running
AssetOpsBench
📉
Evaluating Autonomous AI Agents for Industry 4.0 Tasks
Running
1
SMI-TED-demo1
🦦
Generate chemical embeddings from SMILES
Sleeping
1
Fm4m Eval Demo
👁
Running
4
FM4M-demo2
🐢
Generate molecules and predict properties from SMILES
Running
7
FM4M-demo1
🐢
Generate and analyze molecules using SMILES
models
320
ibm-research/biomed.dna.snp.modernbert.113m.v1
Updated
•
2
ibm-research/biomed.dna.ref.modernbert.113m.v1
Updated
ibm-research/biomed.rna.bert.110m.mlm.rda.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.mlm.multitask.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.wced.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.wced.multitask.v1
Updated
•
3
ibm-research/materials.pos-egnn
Graph Machine Learning
•
Updated
•
401
•
7
ibm-research/materials.selfies-ted
Feature Extraction
•
0.4B
•
Updated
•
20.9k
•
9
ibm-research/materials.smi-ted
Feature Extraction
•
Updated
•
23.4k
•
•
29
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP3A4-101
Updated
•
5
datasets
66
ibm-research/REAL-MM-RAG_TechReport_BEIR
Viewer
•
Updated
•
5.57k
•
38
ibm-research/REAL-MM-RAG_TechSlides_BEIR
Viewer
•
Updated
•
6.09k
•
32
ibm-research/REAL-MM-RAG_FinSlides_BEIR
Viewer
•
Updated
•
5.5k
•
27
ibm-research/REAL-MM-RAG_FinReport_BEIR
Viewer
•
Updated
•
5.27k
•
41
ibm-research/Split-IFEval
Viewer
•
Updated
•
541
•
90
ibm-research/POBS
Viewer
•
Updated
•
415
•
26
ibm-research/struct-text
Viewer
•
Updated
•
6.28k
•
1.1k
•
3
ibm-research/REAL-MM-RAG_FinTabTrainSet_rephrased
Viewer
•
Updated
•
48.2k
•
224
•
1
ibm-research/REAL-MM-RAG_FinTabTrainSet
Viewer
•
Updated
•
48.2k
•
118
ibm-research/AssetOpsBench
Viewer
•
Updated
•
2.81k
•
200
•
1