Skip to Main content Skip to Navigation
Conference papers

Fast Gradient Descent for Surface Capture Via Differentiable Rendering

Briac Toussaint 1, 2 Maxime Genisson 1, 2 Jean-Sébastien Franco 1, 2 
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : Differential rendering has recently emerged as a powerful tool for image-based rendering or geometric reconstruction from multiple views, with very high quality. Up to now, such methods have been benchmarked on generic object databases and promisingly applied to some real data, but have yet to be applied to specific applications that may benefit. In this paper, we investigate how a differential rendering system can be crafted for raw multi-camera performance capture. We address several key issues in the way of practical usability and reproducibility, such as processing speed, explainability of the model, and general output model quality. This leads us to several contributions to the differential rendering framework. In particular we show that a unified view of differential rendering and classic optimization is possible, leading to a formulation and implementation where complete non-stochastic gradient steps can be analytically computed and the full perframe data stored in video memory, yielding a straightforward and efficient implementation. We also use a sparse storage and coarse-to-fine scheme to achieve extremely high resolution with contained memory and computation time. We show experimentally that results rivaling in quality with state of the art multi-view human surface capture methods are achievable in a fraction of the time, typically around a minute per frame.
Document type :
Conference papers
Complete list of metadata

https://hal.inria.fr/hal-03748662
Contributor : Briac Toussaint Connect in order to contact the contributor
Submitted on : Tuesday, August 9, 2022 - 7:03:44 PM
Last modification on : Thursday, September 8, 2022 - 3:49:54 AM

File

Fast_Differential_Rendering_fo...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03748662, version 1

Citation

Briac Toussaint, Maxime Genisson, Jean-Sébastien Franco. Fast Gradient Descent for Surface Capture Via Differentiable Rendering. 3DV 2022 - International Conference on 3D Vision, Sep 2022, Prague, Czech Republic. ⟨hal-03748662v1⟩

Share

Metrics

Record views

293

Files downloads

186