3D Reconstruction of Curved Objects from Single 2D Line Drawings

1. 3D Reconstruction of Curved Objects from Single 2D Line Drawings Reporter: PoHan 05/04/2010 CVPR'09

2. Reconstruction of Curved Manifolds Assumptions Experimental Results Conclusions Outline Introduction

3. Introduction propose an approach to the 3D reconstruction from line drawings of solids with not only planar but also curved faces

4. Introduction a line drawing LDa is transformed into another line drawing LDb with only straight lines.

5. Assumptions • (a) A line drawing, represented by a single edge-vertex graph, is the parallel or near-parallel projection of a wireframe manifold object in a generic view where all the vertices and edges of the object are visible. • Manifold: a solid，在2D Euclidean space下，其表面可以被攤 開成一片連續的2D 平面 • property :each edge is shared exactly by two faces • (b) Every curved edge of a line drawing is the projection of a 3D planar curve. • (c) All the faces of a manifold that a line drawing represents are available.

6. Reconstruction of Curved Manifolds • Distinguishing between curved & planar faces • Transformation of Line Drawings • Regularities • 3D Wireframe Reconstruction • Generating Curved Faces • The Complete 3D Reconstruction Algorithm

7. Reconstruction of Curved Manifolds • Distinguishing between curved & planar faces

8. Reconstruction of Curved Manifolds • Property 1 Two faces that share a straight edge can be either planar or curved. • Property 2 At least one of the two faces that share a curved edge is curved. • Property 3 Both faces that share a silhouette are curved. • Property 4 Two or more co-surface faces indicated by artificial lines are all planar or all curved faces.

9. Reconstruction of Curved Manifolds • In some cases, multiple solutions occur

10. Reconstruction of Curved Manifolds • Transformation of Line Drawings

11. Reconstruction of Curved Manifolds • Singular point. the points having the maximal distance to the line passing through the two endpoints of the curve.

12. Reconstruction of Curved Manifolds • Regularities

13. Reconstruction of Curved Manifolds • based on the transformed line drawing and the original line drawing, to recover the 3D wireframe of the curved object

14. Reconstruction of Curved Manifolds • Curve Parallelism. • G(s) :the normalized arc-length parametrization of the curve C(t)

15. Reconstruction of Curved Manifolds • Generalized Face Perpendicularity. [19] K is the number of the combinations (a, e, f, g, c, b, a) perpendicular to (a, d, c, b, a) and (e, h, g, f, e). [19] H. Lipson andM. Shpitalni. Optimization-based reconstruction of a 3d object from a single freehand line drawing. Computer- Aided Design, 28(8):651–663, 1996.

16. Reconstruction of Curved Manifolds • Curve Concurvity. [19] e1 and e2 are curved, p12, p21, and v are collinear e1 is curved and e2 is straight, p12 and v and v2 are collinear N is the number of vertices of the line drawing ε(i) is the set of all the edges ending at vertex i When Pi, Pj , and Pk are nearly collinear, wclose to 1;

17. Reconstruction of Curved Manifolds • 3D Wireframe Reconstruction

18. Reconstruction of Curved Manifolds • (1)minimizing the standard deviation of the angles (MSDA) in the reconstructed object [25] T. Marill. Emulating the human interpretation of line-drawings as three-dimensional objects. IJCV, 6(2):147–161, 1991. • (2)face planarity • [15] Y. Leclerc and M. Fischler. An optimization-based approach to the interpretation of single line drawings as 3D wire frames. IJCV, 9(2):113–136, 1992. • (3)line parallelism [19] • (4)corner orthogonality[19] • three new regularities:(5)(6)(7) • (8)regularity isometry[19]

19. Reconstruction of Curved Manifolds • Not only the depths but also the 3D curves are required to compute all the regularity terms • 3D curve C(t) = (x(t), y(t), z(t))T parallel projection↓ • C’(t) = (x(t), y(t))T

20. Reconstruction of Curved Manifolds • the 3D curve is planar (assumptions(b)) unit normal vector n = (nx, ny, nz)T endpoint P0 = (x0, y0, z0)T z1−N are the depths of all the N vertices of the line drawing, n1−M are the unit normal vectors of the M planes on which each of the M curved edges is the intersection of two curved faces 兩曲面交集的m個曲邊,這m個曲邊所在的m個平面的unit normal vectors hill-climbing method presented in [15] to minimize F

21. Reconstruction of Curved Manifolds • Generating Curved Faces • A Bezier patch is generated for a curved face with three or four edges • a triangle mesh is used to create a curved face with more than four edges

22. Reconstruction of Curved Manifolds • Bezier and Coons patches [12] [12] A. Davies and P. Samuels. An introduction to computational geometry for curves and surfaces. New York: Oxford University Press Inc., 1996.

23. Reconstruction of Curved Manifolds triangle mesh N(i) is the set of mesh points connected to the ith point in the mesh S is the set of mesh points located on the 3D wireframe 1.the first term enforces the smoothness on the mesh 2.the second term is used to maintain the continuity of the curvature in the mesh 3.the last term is the fitting constraint that requires the mesh to fit the points on the wireframe well [34] G. Taubin. A signal processing approach to fair surface design. Proc. SIGGRAPH, 7:351–358, 1995.

24. Reconstruction of Curved Manifolds • The Complete 3D Reconstruction Algorithm

25. Experimental Results

26. Conclusions • proposed a novel approach to 3D curved manifold object reconstruction from single 2D line drawings • In contrast, our approach can reconstruct complex curved objects automatically. • Our future work includes fine-tuning the results and developing more regularities for curved object reconstruction

27. Thanks you !