Image-to-3D
3d
dmitriitochilkin commited on
Commit
df19d89
1 Parent(s): 5ccee89

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md CHANGED
@@ -1,3 +1,52 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
2
  license: mit
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ datasets:
3
+ - allenai/objaverse
4
+ tags:
5
+ - 3d
6
+ extra_gated_fields:
7
+ Name: text
8
+ Email: text
9
+ Country: text
10
+ Organization or Affiliation: text
11
+ I ALLOW Stability AI to email me about new model releases: checkbox
12
  license: mit
13
+ pipeline_tag: image-to-3d
14
  ---
15
+ # TripoSR
16
+
17
+ ## Model Description
18
+
19
+ TripoSR is a fast and feed-forward 3D generative model developed in partnership with Tripo AI inspired by the recent work of [LRM: Large Reconstruction Model For Single Image to 3D](https://arxiv.org/abs/2311.04400).
20
+
21
+ This new image-to-3D model leverages cutting-edge AI advancements to set new standards in 3D model generation. Designed to cater to the growing demands of entertaining, gaming, industrial design, and architecture professionals, TripoSR enriches the conversion process with detail and precision while providing efficient and responsive outputs for visualizing 3D objects.
22
+
23
+ <img src='img.png' width='700'>
24
+
25
+ ## Usage
26
+
27
+ For usage instructions, please refer to our [TripoSR GitHub repository](https://github.com/VAST-AI-Research/TripoSR).
28
+
29
+ ## Model Details
30
+
31
+ ### Model Description
32
+
33
+ We closely follow [LRM](https://arxiv.org/abs/2311.04400) network architecture for the model design, where TripoSR incorporates a series of technical advancements over the LRM model in terms of both data curation as well as model and training improvements. For more technical details and evaluations, please refer to [the tech report on our model](link).
34
+
35
+ * **Developed by**: [Stability AI](https://stability.ai/), [Tripo AI](https://tripo3d.ai/)
36
+ * **Model type**: Feed-forward model
37
+ * **License**: MIT
38
+ * **Hardware**: `TripoSR` was trained on the Stability AI cluster on 22 nodes with 8 A100 40GBs GPUs for 5 days.
39
+
40
+ ### Model Sources
41
+
42
+ * **Repository**: https://github.com/VAST-AI-Research/TripoSR
43
+ * **Tech report**: *link*
44
+
45
+ ### Training Dataset
46
+
47
+ We use renders from the [Objaverse](https://objaverse.allenai.org/objaverse-1.0) dataset, utilizing our enhanced rendering method that more closely replicate the distribution of images found in the real world, significantly improving our model’s ability to generalize. We selected a carefully curated subset of the Objaverse dataset for the training data, which is available under the CC-BY license.
48
+
49
+
50
+ ### Misuse, Malicious Use, and Out-of-Scope Use
51
+
52
+ The model should not be used to intentionally create or disseminate 3D models that people would foreseeably find disturbing, distressing, or offensive; or content that propagates historical or current stereotypes.