Inpainting Holes In Folded Fabric Meshes
Abstract
When scanning real shapes, occlusion issues may lead to holes in the reconstructed surface which must be solved using an inpainting technique. When dealing with fabrics with folds, reconstruction gets even more problems become almost inevitable and strong assumptions are implied on the physical model of the inpainted surface. We propose a framework to fill holes in triangle mesh surfaces representing fabrics. The method uses the developable nature of fabrics to recover the intrinsic geometry of the missing patch in 2D. Our inpainting strategy is then based on a variational method to smoothly integrate the patch into the surface by minimizing an isometric energy. The proposed approach allows us to produce folds and creases which are difficult to obtain with general purpose hole filling techniques. Moreover, our approach remains relevant in the case where the model is not provided by the digitization of a real fabric as for the acquisition from ancient statues with draperies.
Illustration of the overall pipeline: Given an input mesh of a developable fabric with a hole (a), the first step consists in estimating the missing 2D patch shape. For this, a parametrization algorithm is applied to flatten the triangle strip surrounding the hole, which is then triangulated in the 2D plane (b); The 3d geometry is subsequently restored in two steps, first by applying As-Rigid-As-Possible deformation to preserve some rigidity in every direction around the points (c), and second by optimizing a developability function in order to further curve the fabric model and its different folds. (d).
@article{inpainting-gisbert,
author = {Guillaume Gisbert and Raphaelle Chaine and David Coeurjolly },
journal = {Computer & Graphics (Proc. of SMI 2023)},
month = {July},
doi = {10.1016/j.cag.2023.05.025},
note = {(to appear)},
title = {Inpainting Holes In Folded Fabric Meshes},
year = {2023}
}