KIAM Main page Web Library  •  Publication Searh   
Publication

Conference material: "Proceedings of the International Conference on Computer Graphics and Vision Graphicon (19-21 September 2023, Moscow)"
Authors: Garifullin A.R., Maiorov N.D., Frolov V.A.
Differentiable Procedural Models for Single-view 3D Mesh Reconstruction
Abstract:
Most of the existing solutions for single-view 3D object reconstruction rely on deep learning techniques that use implicit or voxel representations of the scene. However, these approaches struggle to generate detailed and high-quality meshes and textures that can be directly applied in practical applications. On the other hand, differentiable rendering techniques can produce superior mesh quality, but they typically require multiple images of the object. We propose a novel approach to single-view 3D reconstruction that leverages procedural generator input parameters as a scene representation. Instead of directly estimating the vertex positions of the mesh, we estimate the input parameters of a procedural generator by minimizing the silhouette loss function between reference and rendered images. By employing differentiable rendering and differentiable procedural generators, we can optimize the loss function using gradients. This enables us to create highly detailed models from a single image.
Keywords:
Procedural generation, 3D reconstruction, differentiable rendering
Publication language: russian,  pages: 11 (p. 14-24)
Russian source text:
Export link to publication in format:   RIS    BibTeX
About authors:
  • Garifullin Albert Rustemovich,  orcid.org/0000-0003-3802-1774Lomonosov Moscow State University
  • Maiorov Nikolay Dmitrievich,  orcid.org/0009-0001-2677-881XLomonosov Moscow State University
  • Frolov Vladimir Alexandrovich,  orcid.org/0000-0001-8829-9884Lomonosov Moscow State University; KIAM RAS