SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM
Abstract
A unified multimodal large language model framework called SIMART is proposed for generating articulated 3D assets with reduced tokenization overhead and improved simulation readiness.
High-quality articulated 3D assets are indispensable for embodied AI and physical simulation, yet 3D generation still focuses on static meshes, leaving a gap in "sim-ready" interactive objects. Most recent articulated object creation methods rely on multi-stage pipelines that accumulate errors across decoupled modules. Alternatively, unified MLLMs offer a single-stage path to joint static asset understanding and sim-ready asset generation. However dense voxel-based 3D tokenization yields long 3D token sequences and high memory overhead, limiting scalability to complex articulated objects. To address this, we propose SIMART, a unified MLLM framework that jointly performs part-level decomposition and kinematic prediction. By introducing a Sparse 3D VQ-VAE, SIMART reduces token counts by 70% vs. dense voxel tokens, enabling high-fidelity multi-part assemblies. SIMART achieves state-of-the-art performance on PartNet-Mobility and in-the-wild AIGC datasets, and enables physics-based robotic simulation.
Community
arxiv: https://arxiv.org/pdf/2603.23386
video demo: https://www.youtube.com/watch?v=Facqav-LthQ
project page: https://simart-mllm.github.io/
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins (2026)
- ArtLLM: Generating Articulated Assets via 3D LLM (2026)
- MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction (2026)
- PAct: Part-Decomposed Single-View Articulated Object Generation (2026)
- URDF-Anything+: Autoregressive Articulated 3D Models Generation for Physical Simulation (2026)
- Easy3E: Feed-Forward 3D Asset Editing via Rectified Voxel Flow (2026)
- SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper