GraphDeco

3D Gaussian Splatting for Real-Time Radiance Field Rendering
Presentation | Team members | Collaborations | Publications | Job offers | Contact

 

3D Gaussian Splatting for Real-Time Radiance Field Rendering

Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis
ACM Transactions on Graphics (SIGGRAPH Conference Proceedings), Volume 42, Number 4 - July 2023
Download the publication : fast_radiance_fields.pdf [71.3Mo]  
Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while recent faster methods inevitably trade off speed for quality. For unbounded and complete scenes (rather than isolated objects) and 1080p resolution rendering, no current method can achieve real-time display rates. We introduce three key elements that allow us to achieve state-of-the-art visual quality while maintaining competitive training times and importantly allow high-quality real-time (≥ 100 fps) novel-view synthesis at 1080p resolution. First, starting from sparse points produced during camera calibration, we represent the scene with 3D Gaussians that preserve desirable properties of continuous volumetric radiance fields for scene optimization while avoiding unnecessary computation in empty space; Second, we perform interleaved optimization/density control of the 3D Gaussians, notably optimizing anisotropic covariance to achieve an accurate representation of the scene; Third, we develop a fast visibility-aware rendering algorithm that supports anisotropic splatting and both accelerates training and allows realtime rendering. We demonstrate state-of-the-art visual quality and real-time rendering on several established datasets.

Images and movies

 

See also




See also the project webpage

Acknowledgements and Funding

This research was funded by the ERC Advanced grant FUNGRAPH No 788065 http://fungraph.inria.fr. The authors are grateful to the OPAL infrastructure from Université Côte'Azur for providing resources and support. The and for the HPC resources from GENCI-IDRIS (Grant 2022-AD011013409). The authors thank the anonymous reviewers for their valuable feedback, P. Hedman and A. Tewari for proofreading earlier drafts also T. Müller, A. Yu and S. Fridovich-Keil for helping with the comparisons.

BibTex references

@Article{KKLD23,
  author       = "Kerbl, Bernhard and Kopanas, Georgios and Leimk{\"u}hler, Thomas and Drettakis, George",
  title        = "3D Gaussian Splatting for Real-Time Radiance Field Rendering",
  journal      = "ACM Transactions on Graphics (SIGGRAPH Conference Proceedings)",
  number       = "4",
  volume       = "42",
  month        = "July",
  year         = "2023",
  url          = "http://www-sop.inria.fr/reves/Basilic/2023/KKLD23"
}

Other publications in the database

» Bernhard Kerbl
» Georgios Kopanas
» Thomas Leimkühler
» George Drettakis