Yotam Gingold
Takeo Igarashi
Denis Zorin
Abstract
We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives and annotations on the 2D image. Our primitives are based on commonly used sketching conventions and allow users to maintain a single view of the model. This eliminates the frequent view changes inherent to existing 3D modeling tools, both traditional and sketch-based, and enables users to match input to the 2D guide image. Our annotations---same-lengths and angles, alignment, mirror symmetry, and connection curves---allow the user to communicate higher-level semantic information; through them our system builds a consistent model even in cases where the original image is inconsistent. We present the results of a user study comparing our approach to a conventional "sketch-rotate-sketch" workflow.
Supplemental Material
Available for Download
"auxiliary_user_study_data.pdf": Additional data from our user studies. "comparison_study/subject_N_FiberMesh.obj": The model created by comparison study subject #N using FiberMesh. "comparison_study/subject_N_our-system.obj": The model created by comparison study subject #N using our system. "making_kat-girl.mov": Screen recording of the "Kat Girl" model being created in our system. "making_man-on-arrow.mov": Screen recording of the "Man on Arrow" model being created in our system.
- Adobe, 2007. Illustrator. http://www.adobe.com/products/illustrator/.Google Scholar
- Agrawala, M., Zorin, D., and Munzner, T. 2000. Artistic multiprojection rendering. In Proceedings of the Eurographics Workshop on Rendering Techniques, 125--136. Google ScholarDigital Library
- Andre, A., Saito, S., and Nakajima, M. 2007. CrossSketch: Freeform surface modeling with details. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 45--52. Google ScholarDigital Library
- Autodesk, 2009. Maya. http://www.autodesk.com/maya.Google Scholar
- Bae, S.-H., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: As-natural-as-possible sketching system for creating 3D curve models. In Proceedings of the ACM symposium on User interface software and technology (UIST), 151--160. Google ScholarDigital Library
- Blair, P. 1994. Cartoon Animation. Walter Foster, Laguna Hills, California.Google Scholar
- Bloomenthal, J., Ed. 1997. Introduction to Implicit Surfaces. Morgan Kaufmann, San Francisco, California. Google ScholarDigital Library
- Cabral, M., Lefebvre, S., Dachsbacher, C., and Drettakis, G. 2009. Structure preserving reshape for textured architectural scenes. Computer Graphics Forum 28, 2, 469--480.Google ScholarCross Ref
- Chen, X., Kang, S. B., Xu, Y.-Q., Dorsey, J., and Shum, H.-Y. 2008. Sketching reality: Realistic interpretation of architectural designs. ACM Transactions on Graphics 27, 2, 11. Google ScholarDigital Library
- Cherlin, J. J., Samavati, F., Sousa, M. C., and Jorge, J. A. 2005. Sketch-based modeling with few strokes. In Proceedings of the Spring Conference on Computer Graphics, 137--145. Google ScholarDigital Library
- Cordier, F., and Seo, H. 2007. Free-form sketching of self-occluding objects. IEEE Computer Graphics and Applications 27, 1, 50--59. Google ScholarDigital Library
- Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of ACM SIGGRAPH, 11--20. Google ScholarDigital Library
- Dorsey, J., Xu, S., Smedresman, G., Rushmeier, H., and McMillan, L. 2007. The mental canvas: A tool for conceptual architectural design and analysis. In Proceedings of Pacific Graphics, 201--210. Google ScholarDigital Library
- Eggli, L., Hsu, C.-Y., Bruderlin, B. D., and Elber, G. 1997. Inferring 3D models from freehand sketches and constraints. Computer-Aided Design 29, 2 (February), 101--112.Google ScholarCross Ref
- Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of ACM SIGGRAPH, 409--416. Google ScholarDigital Library
- Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics 24, 3, 1134--1141. Google ScholarDigital Library
- Infografica, R., 2009. MetaReyes. http://www.reyes-infografica.com/plugins/meta.php.Google Scholar
- Kako, S. 1973. Karasu no Panya-san. Kaiseisha, Tokyo, Japan. Pages 18--19.Google Scholar
- Kallio, K. 2005. 3D6B editor: Projective 3D sketching with line-based rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBM), 73--80.Google Scholar
- Karpenko, O. A., and Hughes, J. F. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics 25, 3, 589--598. Google ScholarDigital Library
- Koenderink, J. J., van Doorn, A. J., and Kappers, A. M. L. 1992. Surface perception in pictures. Perception&Psychophysics 52, 5, 487--496.Google Scholar
- Loran, E. 1943. Cezanne's Composition. University of California Press.Google Scholar
- Microsoft, 2003. Office. http://office.microsoft.com.Google Scholar
- Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Transactions on Graphics 26, 3, 41. Google ScholarDigital Library
- Olsen, L., Samavati, F. F., Costa Sousa, M., and Jorge, J. 2008. A taxonomy of modeling techniques using sketch-based interfaces. In Eurographics State of the Art Reports.Google Scholar
- Peng, J., Kristjansson, D., and Zorin, D. 2004. Interactive modeling of topologically complex geometric detail. ACM Transactions on Graphics 23, 3, 635--643. Google ScholarDigital Library
- Prados, E. 2004. Application of the theory of the viscosity solutions to the Shape From Shading problem. PhD thesis, University of Nice-Sophia Antipolis.Google Scholar
- Schmidt, R., Isenberg, T., Jepp, P., Singh, K., and Wyvill, B. 2007. Sketching, scaffolding, and inking: A visual history for interactive 3D modeling. In Proceedings of NPAR, 23--32. Google ScholarDigital Library
- Schmidt, R., Singh, K., and Balakrishnan, R. 2008. Sketching and composing widgets for 3D manipulation. Computer Graphics Forum 27, 2, 301--310.Google ScholarCross Ref
- Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics 27, 5, 159. Google ScholarDigital Library
- Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of Eurographics/ACM SGP, 175--184. Google ScholarDigital Library
- Thormählen, T., and Seidel, H.-P. 2008. 3D-modeling by ortho-image generation from image sequences. ACM Transactions on Graphics 27, 3, 86. Google ScholarDigital Library
- Tsang, S., Balakrishnan, R., Singh, K., and Ranjan, A. 2004. A suggestive interface for image guided 3D sketching. In Proceedings of ACM SIGCHI, 591--598. Google ScholarDigital Library
- van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. VideoTrace: Rapid interactive scene modelling from video. ACM Transactions on Graphics 26, 3, 86. Google ScholarDigital Library
- Varley, P., and Company, P. 2007. Sketch input of 3D models: Current directions. In VISAPP 2007: 2nd International Conference on Computer Vision Theory and Applications, 85--91.Google Scholar
- Vilppu, G. 1997. Vilppu Drawing Manual. Vilppu Studio, Acton, California.Google Scholar
- Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. ShapePalettes: Interactive normal transfer via sketching. ACM Transactions on Graphics 26, 3, 44. Google ScholarDigital Library
- Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. SKETCH: An interface for sketching 3D scenes. In Proceedings of ACM SIGGRAPH, 163--170. Google ScholarDigital Library
- Zhang, L., Dugas-Phocion, G., Samson, J.-S., and Seitz, S. M. 2001. Single view modeling of free-form scenes. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 990--997.Google Scholar
Index Terms
- Structured annotations for 2D-to-3D modeling
Recommendations
Structured annotations for 2D-to-3D modeling
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papersWe present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives ...
Interactive 3D content modeling for Digital Earth
Digital Earth is a global reference model for integrating, processing and visualizing geospatial datasets. In this reference model, various data-types, including Digital Elevation Models (DEM) and imagery (orthophotos), are universally and openly ...
Comments