GraphDeco

Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes
Presentation | Team members | Collaborations | Publications | Job offers | Contact

 

Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes

Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games - may 2018
Download the publication : philip2018mvplanarInpaint.pdf [12.3Mo]  
Image-Based Rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing for IBR. This requires multi-view inpainting of the input images. Previous methods suffer from several major limitations: they lack true multi-view coherence, resulting in artifacts such as blur, they do not preserve perspective during inpainting, provide inaccurate depth completion and can only handle scenes with a few tens of images. Our approach addresses these limitations by introducing a newmulti-viewmethod that performs inpainting in intermediate, locally common planes. Use of these planes results in correct perspective and multi-view coherence of inpainting results. For efficient treatment of large scenes, we present a fast planar region extraction method operating on small image clusters. We adapt the resolution of inpainting to that required in each input image of the multi-view dataset, and carefully handle image resampling between the input images and rectified planes. We show results on large indoors and outdoors environments.

Images and movies

 

See also

Acknowledgements and Funding

This research was partially funded by the European Union Horizon 2020 research and innovation programme under grant agreement No. 727188 “EMOTIVE”, http://www.emotiveproject.eu/, the French research grant ANR SEMAPOLIS and by generous donations from Technicolor and Adobe. The authors thank T. Thonat for his help and S. Bonopera for system support.

Video

BibTex references

@InProceedings{PD18,
  author       = "Philip, Julien and Drettakis, George",
  title        = "Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes",
  booktitle    = "Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games",
  month        = "may",
  year         = "2018",
  organization = "ACM",
  keywords     = "Inpainting, Multi-View, Image-Based Rendering",
  url          = "http://www-sop.inria.fr/reves/Basilic/2018/PD18"
}

Other publications in the database

» Julien Philip
» George Drettakis