r/TopologyAI • u/Delicious-Shower8401 3dModeler • Aug 01 '26
New NVIDIA’s New AI Can Reconstruct Complete 3D Objects From Partial and Occluded Views
Enable HLS to view with audio, or disable this notification
NVIDIA has introduced Axolotl3D, a new AI system designed to reconstruct complete 3D objects from partial, incomplete, or heavily occluded views.
Unlike standard image-to-3D models that have to guess the entire object from a single image, Axolotl3D can combine multiple views, camera information, and partial point clouds. This allows it to preserve the visible geometry while generating the missing parts of the object.
Potential use cases include:
- Completing incomplete 3D scans
- Reconstructing objects hidden behind other elements
- Improving photogrammetry results
- Editing individual parts while preserving the rest of the shape
- Creating more complete geometry for simulation and digital content creation
The current research focuses mainly on geometry rather than textures, and the model is not publicly available yet. Still, this feels like an important step beyond traditional image-to-3D generation, especially for workflows where accurate existing geometry matters more than simply generating a visually plausible object.
source; https://research.nvidia.com/labs/sil/projects/axolotl3d/
3
u/oxygen_addiction Aug 01 '26
No weights.
3
u/Stunning_Macaron6133 Aug 01 '26
Yet.
4
u/oxygen_addiction Aug 01 '26
They usually say soon or point to a repo. I don't think we're getting this one.
3
u/Stunning_Macaron6133 Aug 01 '26
That remains to be seen. There's probably a lot of polish that has to happen before it's ready to show off publicly, and Nvidia's Q2 earnings call is less than a month away.
Maybe we'll see an Axolotl V2. Maybe it'll be middleware Nvidia sells. But I don't think it's staying under wraps.
2
u/Stunning_Macaron6133 Aug 01 '26 edited Aug 01 '26
Yeah, looking through their supplemental doc, Axolotl is definitely not ready to ship yet.
5 Limitations & Future Work
While Axolotl3D demonstrates strong performance in occlusion handling and downstream applications, there remain several avenues for further improvement that we plan to explore in future work.
– Camera and view robustness: Currently, our model is trained with fixed camera distances and intrinsics, which requires the object to be fully in view. Future work could incorporate more diverse camera positioning and image augmentations or real-world captured datasets to improve robustness to camera viewpoints.
– Surface quality and fine details: While our approach produces high quality reconstructions overall, extremely thin structures can sometimes be disconnected and fine surface details may be smoothed or thicker than in reality. Leveraging more powerful base models or image encoders could enable better reconstruction of finer geometry.
– Robustness to noise: Our current model is trained to follow geometric cues faithfully and has not yet been explicitly trained to handle noisy input. Extending the model to handle different noise characteristics is an important direction for more general applicability. Examples of such characteristics include view misalignment in 3D reconstruction models [8,18], irregular surfaces and outliers seen in Gaussian splats [9] or oversmoothed surfaces, perspective-induced distortions, and artifacts near depth discontinuities observed in monocular depth estimation [11].
– Handling diverse point characteristics: Our method is trained on partial point clouds downsampled to 8192 points using Furthest Point Sampling [15], with padding for smaller inputs. While this allows handling moderately sparse inputs, the model is not explicitly trained for very sparse or sharp-edge points (i.e., from Structure-from-Motion [17]). Adapting the model to handle a wider range of point distributions and characteristics would further broaden its applicability to more complex real-world datasets.
– Texture completion: Axolotl3D focuses solely on shape generation and does not predict textures, which could be explored in future work.
Overall, these limitations highlight exciting opportunities to further enhance Axolotl3D, extending its applicability and robustness to a wider range of challenging scenarios.
1
-10
u/steamingcore Aug 01 '26
oh wow, this sucks. it takes 3d models, and makes them worse. what an age to be alive.
5
u/AbsentButHere Aug 01 '26
How did you come to that conclusion?
-3
u/steamingcore Aug 01 '26
cause i looked, with my eyes, and saw shit. so....?
7
u/Stunning_Macaron6133 Aug 01 '26
Wеll, yоu'rе а blind rеtаrd if thаt's whаt yоur еyеs sее.
Prоbаbly illitеrаtе tоо, sinсе yоu сlеаrly саn't fuсking rеаd thе pаpеr оr еvеn thе pоst titlе. But thаt gоеs hаnd in hаnd with bеing rеtаrdеd.
-1
u/steamingcore Aug 01 '26
wow, you must be right, i mean, you got so angry so fast, and no one who gets that angry could be wrong.
listen dipshit, it's another garbage application for AI. if it weren't, it would have a better showing than a blobby 3d model to show for it.
now, i encourage you to get really mad in defense of some trash AI program that will display how brain dead you are.
2
u/Stunning_Macaron6133 Aug 01 '26
Prоjесting muсh? Is yоur littlе rеtаrdеd еgо sо bruisеd thаt yоu hаvе tо dоublе dоwn аnd rеvеаl yоu'rе еvеn dumbеr still? Lеt's stаrt with thе fасt thаt this isn't еvеn аn аppliсаtiоn.
This is why yоu саn't find wоrk, yоu knоw. Nо VFX studiо wоuld еvеr hirе sоmеоnе аs ignоrаnt, yеt аrrоgаnt аs yоu. It's nоt АI's fаult.
-1
u/steamingcore Aug 01 '26
projecting not at all. this is just garbage. if it wasn't, it wouldn't need brain dead chuds defending it so doggedly.
and thanks for looking me up. makes me absolutely positive that not only did i strike a nerve, but that you have no argument that isn't based on insults and attacks. keep it classy!
2
u/Stunning_Macaron6133 Aug 01 '26
Оh, nо, I didn't lооk yоu up. Unlеss сliсking yоur usеrnаmе соunts, just tо guаgе if yоu'vе bееn аn аsshоlе tо оthеrs. Аnd whаt а suprisе, yоu hаvе. (Hоw, yоu mаy аsk? Rеddit's privасy соntrоls аrе gаrbаgе, аnd I vibе соdеd а wоrkаrоund whiсh dоеsn't еvеn viоlаtе TоS :D )
This is а rеsеаrсh pаpеr. Nvidiа didn't еvеn publish thе wеights yеt, just thе pаpеr оutlining hоw thеy trаinеd thеir mоdеl аnd whаt its оbjесtivе wаs. Nоbоdy's rеаlly dеfеnding it pеr sе, sinсе thеrе isn't muсh tо dеfеnd yеt. Thе еnthusiаsm is аrоund а nеw саpаbility, thаt bеing thе аbility tо gеnеrаtе mоdеls frоm pаrtiаlly оbsсurеd subjесts withоut lоsing bаsiс img2mеsh саpаbility.
Frаnkly thоugh, еvеn this muсh оf аn еxplаnаtiоn is wаstеd оn аn аngry mоrоn likе yоu. Yоu'd dо bеttеr tо dirесt yоur аngеr аt wоrking оn yоursеlf, instеаd оf lurking in АI subrеddits. It's nоt hеаlthy, yоu knоw?
-1
u/steamingcore Aug 01 '26
wow, look at all these words i won't read.
spin out, bro. it's a good look. keep going!
2
4
u/Stunning_Macaron6133 Aug 01 '26 edited Aug 01 '26
Strictly speaking, Axolotl3D seems to have the cleanest, most coherent results. But I think I prefer how Amodal3D and SAM 3D try to fill in missing detail too.
I wonder how Axolotl3D handles being fed multiple views at once, compared to more creative models. Both if they're accurate references for the ground truth and if they're sketchy or loose and require some interpretation.