GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting

Jiajun Huang1, Hongchuan Yu1
1Bournemouth University
arXiv Video Code (Coming Soon)

GSDeformer achieves free-form deformation on 3DGS, without making any architectual changes

Abstract

We present GSDeformer, a method that achieves free-form deformation on 3D Gaussian Splatting(3DGS) without requiring any architectural changes.

Our method extends cage-based deformation, a traditional mesh deformation method, to 3DGS. This is done by converting 3DGS into a novel proxy point cloud representation, where its deformation can be used to infer the transformations to apply on the 3D gaussians making up 3DGS. We also propose an automatic cage construction algorithm for 3DGS to minimize manual work. Our method does not modify the underlying architecture of 3DGS. Therefore, any existing trained vanilla 3DGS can be easily edited by our method.

We compare the deformation capability of our method against other existing methods, demonstrating the ease of use and comparable quality of our method, despite being more direct and thus easier to integrate with other concurrent developments on 3DGS.

Method Diagram

We propose a deformation algorithm that deforms gaussians making up the 3DGS representation in 5-steps. We also provide a cage-building algorithm to automatically build cages from 3DGS scenes for deformation.

BibTeX

@misc{huang2024gsdeformer,
      title={GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting}, 
      author={Jiajun Huang and Hongchuan Yu},
      year={2024},
      eprint={2405.15491},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}