GraphDeco

Sketch2CAD: Sequential CAD Modeling by Sketching in Context
Presentation | Team members | Collaborations | Publications | Job offers | Contact

 

Sketch2CAD: Sequential CAD Modeling by Sketching in Context

ACM Transactions on Graphics (SIGGRAPH Asia Conference Proceedings) - 2020
Download the publication : Sketch2CAD.pdf [47.3Mo]  
We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities between the steps industrial designers follow to draw 3D shapes, and the operations CAD modeling systems offer to create similar shapes. To overcome the strong ambiguity with parsing 2D sketches, we observe that in a sketching sequence, each step makes sense and can be interpreted in the \emph{context} of what has been drawn before. In our system, this context corresponds to a partial CAD model, inferred in the previous steps, which we feed along with the input sketch to a deep neural network in charge of interpreting how the model should be modified by that sketch. Our deep network architecture then recognizes the intended CAD operation and segments the sketch accordingly, such that a subsequent optimization estimates the parameters of the operation that best fit the segmented sketch strokes. Since there exists no datasets of paired sketching and CAD modeling sequences, we train our system by generating synthetic sequences of CAD operations that we render as line drawings. We present a proof of concept realization of our algorithm supporting four frequently used CAD operations. Using our system, participants are able to quickly model a large and diverse set of objects, demonstrating Sketch2CAD to be an alternate way of interacting with current CAD modeling systems.

Images and movies

 

See also

Project page (paper, video, code, supplemental materials)

Acknowledgements

The work of Niloy was supported by ERC Grant (SmartGeometry 335373), Google Faculty Award and gifts from Adobe, and the work of Adrien was supported by ERC Starting Grant D3 (ERC-2016-STG 714221), research and software donations from Adobe.

BibTex references

@Article{LPBM20,
  author       = "Li, Changjian and Pan, Hao and Bousseau, Adrien and Mitra, Niloy J.",
  title        = "Sketch2CAD: Sequential CAD Modeling by Sketching in Context",
  journal      = "ACM Transactions on Graphics (SIGGRAPH Asia Conference Proceedings)",
  year         = "2020",
  url          = "http://www-sop.inria.fr/reves/Basilic/2020/LPBM20"
}

Other publications in the database

» Adrien Bousseau