GraphDeco

Lifting Freehand Concept Sketches into 3D
Presentation | Team members | Collaborations | Publications | Job offers | Contact

 

Lifting Freehand Concept Sketches into 3D

ACM Transactions on Graphics (SIGGRAPH Asia Conference Proceedings) - 2020
Download the publication : LiftingSketches.pdf [51.8Mo]  
We present the first algorithm capable of automatically lifting real-world, vector-format, industrial design sketches into 3D. Targeting real-world sketches raises numerous challenges due to inaccuracies, use of overdrawn strokes, and construction lines. In particular, while construction lines convey important 3D information, they add significant clutter and introduce multiple accidental 2D intersections. Our algorithm exploits the geometric cues provided by the construction lines and lifts them to 3D by computing their intended 3D intersections and depths. Once lifted to 3D, these lines provide valuable geometric constraints that we leverage to infer the 3D shape of other artist drawn strokes. The core challenge we address is inferring the 3D connectivity of construction and other lines from their 2D projections by separating 2D intersections into 3D intersections and accidental occlusions. We efficiently address this complex combinatorial problem using a dedicated search algorithm that leverages observations about designer drawing preferences, and uses those to explore only the most likely solutions of the 3D intersection detection problem. We demonstrate that our separator outputs are of comparable quality to human annotations, and that the 3D structures we recover enable a range of design editing and visualization applications, including novel view synthesis and 3D-aware scaling of the depicted shape.

Images and movies

 

See also

Project page (paper, video, data, code, supplemental materials)

Acknowledgements

This work was supported by the ERC Starting Grant D3 (ERC-2016- STG 714221), NSERC and by software and research donations from Adobe. The authors are grateful to Inria Sophia Antipolis - Méditerranée ``Nef'' computation cluster for providing resources and support. We thank Bastien Wailly for his help on intermediate data visualizations and Valentin Deschaintre for the final video compilation; Enrique Rosales, Yuan Yao and Jerry Yin for data annotation, as well as all the anonymous participants of the perceptual study and the designers who created concept sketches for our work.

BibTex references

@Article{GHLSB20,
  author       = "Gryaditskaya, Yulia and H{\"a}hnlein, Felix and Liu , Chenxi and Sheffer, Alla and Bousseau, Adrien",
  title        = "Lifting Freehand Concept Sketches into 3D",
  journal      = "ACM Transactions on Graphics (SIGGRAPH Asia Conference Proceedings)",
  year         = "2020",
  url          = "http://www-sop.inria.fr/reves/Basilic/2020/GHLSB20"
}

Other publications in the database

» Yulia Gryaditskaya
» Alla Sheffer
» Adrien Bousseau