1 / 30

Robotica e Sensor Fusion per i Sistemi Meccatronici Object Detection with Superquadrics

Robotica e Sensor Fusion per i Sistemi Meccatronici Object Detection with Superquadrics. Prof. Mariolino De Cecco , Dr. Ilya Afanasyev, Ing. Nicolo Biasi Department of Structural Mechanical Engineering, University of Trento Email: mariolino.dececco@ing.unitn.it ilya.afanasyev@ing.unitn.it

stuart-nicholson
Download Presentation

Robotica e Sensor Fusion per i Sistemi Meccatronici Object Detection with Superquadrics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Robotica e Sensor Fusion per i Sistemi Meccatronici Object Detection with Superquadrics Prof. Mariolino De Cecco, Dr. Ilya Afanasyev, Ing. Nicolo Biasi Department of Structural Mechanical Engineering, University of Trento Email: mariolino.dececco@ing.unitn.it ilya.afanasyev@ing.unitn.it http://www.mariolinodececco.altervista.org/

  2. Object detection and localization The block diagram of recognition task: - Camera, laser A-priori know: Measurement system - Kinect - Dimensions; Object - Features (shape, curvature, etc.) - Multicamera system Data - Point clouds - Images, video Math. model - Superquadrics, etc. - Eliminating the background; Pre-processing - Changing the contrast, size, etc. - Optimization, iterations, etc.; - RANSAC; Fitting Algorithm - Criteria of quality. - Transformation matrix, angles, distance, accuracy, etc. Results

  3. Examples of Superquadrics [1] Examples of Superquadrics

  4. Wireframes of Superquadrics [1] Examples of Superquadrics

  5. Examples of Superellipsoids Superellipsoids can model spheres, cylinders, parallelepipeds and shapes in between. Modeling capabilities can be enhanced by tapering, bending and making cavities. [4] Examples of Superellipsoids

  6. About Superquadrics The term of Superquadrics was defined by Alan Barr in 1981 [2]. Superquadrics are a flexible family of 3D parametric objects, useful for geometric modeling. By adjusting a relatively few number of parameters, a large variety of shapes may be obtained. A particularly attractive feature of superquadrics is their simple mathematical representation. Superquadrics are used as primitives for shape representation and play the role of prototypical parts and can be further deformed and glued together into realistic looking models. [9] About Superquadrics

  7. Classification of Superquadrics a) b) c) a) Superellipsoids. b) Superhyperboloids of one piece. c) Superhyperboloids of two pieces. d) Supertoroids. d) [9] Classification of Superquadrics [2,9]

  8. Definition of Spherical Products For two 2x1 vectors [a b]’ and [c d]’ the spherical product is 3x1 vector for which: Example. For two 2D curves: circle and parabola, the spherical product is 3D paraboloid. Definition of Spherical Products

  9. Spherical Products A 3D surface can be obtained by the spherical product of two 2D curves [2]. The spherical product is defined to operate on two 2D curves. A unit sphere is produced by a spherical product of a circle h(ω) horizontally and a half circle m(η) vertically. Spherical Products [9]

  10. Spherical Products for Superellipsoids The equation of Superellipse is and in parametric form: Superellipsoids can be obtained by a spherical products of a pair of such superellipses: The implicit equation is: where - are parameters of shape squareness; - parameters of Superellipsoid sizes. Superellipsoids

  11. Spherical Products for Superhyperboloids of one piece Superhyperboloids of one piece can be obtained by a spherical products of a hyperboloid and a superellipse: The implicit equation is: where - are parameters of shape squareness; - parameters of Superellipsoid sizes. Superhyperboloids of one piece

  12. Spherical Products for Superhyperboloids of two pieces Superhyperboloids of two pieces can be obtained by a spherical products of a pair of such hyperboloids: The implicit equation is: where - are parameters of shape squareness; - parameters of Superellipsoid sizes. Superhyperboloids of two pieces

  13. Spherical Products for Supertoroids Supertoroids can be obtained by a spherical products of the following surface vectors: The implicit equation is: where - are parameters of shape squareness; - parameters of Superellipsoid sizes. Supertoroids

  14. Superquadrics in MATLAB Modelling Superquadrics in MATLAB:- Demo-function: xpquad - superquadrics plotting demonstration.- ezmeshand ezsurf functions (see, Superquadrics_visualization.m). %--------------------------------------------------------------- % a1 = 4; a2 = 2; a3 = 1; eps1 = 1; eps2 = 1; figure('Name','Superellipsoids') ezmesh('4*sin(u)*cos(v)', '2*sin(u)*sin(v)', 'cos(u)', [0, 2*pi], [0, 2*pi], 20) colormap([0 0 1]) hold on rotate3d on %---------------------------------------------------------------

  15. a1, a2 and a3 – are parameters of parallelepiped’s semi-sides. What a1, a2 and a3 mean? If parallelepiped has dimensions: 20 x 30 x 10 cm, it means that a1 = 10, a2 = 15 and a3 = 5. The parameters of shape squareness for parallelepiped are: ε1 = ε1 = 0.1 05/04/2011 16/20

  16. ε1 and ε2 – are parameters of shape squareness. ε2 = 0.1 What ε1 and ε2 mean? ε2 = 1 ε2 = 2 [9] ε1 = 1 ε1 = 2 ε1 = 0.1 05/04/2011 17/20

  17. ε1 = 3 ε2 = 1 Superellipsoids shapes varying from ε1, ε2 ε1 = 1 ε2 = 3 ε1 = 3 ε2 = 3 05/04/2011 18/20

  18. z a3 r(η,ω) Plotting Superellipsoids in spherical coordinates a2 η y a1 Vector r(η,ω)sweeps out a closed surface in space when η,ω change in the given intervals: ω η,ω– independent parameters (latitude and longitude angles) of vector r(η,ω) expressed in spherical coordinates. x Superellipsoids

  19. Plotting Superellipsoids in Cartesian coordinates Use the implicit equation in Cartesian coordinates, considering z -a1 ≤x≤a1 f(x,y,z) = 1 -a2 ≤y≤a2 z’ y’ y=a2 y x’ z=NaN x=a1 x,y– independent parameters (Cartesian coordinates of SQ) are used to obtain z. The implicit form is important for the recovery of Superquadrics and testing for intersections, while the explicit form is more suitable for scene reconstruction and rendering. x

  20. Warning: complex numbers in SQ equation 2. Analogically if xor y < 1 and ε1> 1, the functionf(x,y,z)willl have the complex values of z. To overcome it, use the f(x,y,z)in power ofexponent ε1. 1. If ε1or ε2 < 1 and cos or sin of angles ω or η < 0, then vector r(η,ω) has complex values. To escape them, it should be used signum-function of sin or cos and absolute values of the vector components. f(x,y,z)ε1 = 1 05/04/2011

  21. z zW xW Rotation and translation of SQ yW Elevation y Azimuth T – transformation matrix. n – amounts of points in SQ surface. SQ – coordinates of points of SQ surface. Pw – coordinates of points of rotated SQ surface. xW, yW, zW– world system of coordinates (with center in viewpoint). x 05/04/2011 22/20

  22. z zW px xW Rotation and translation of SQ yW Elevation y Azimuth T SQ Pw x az,el,px,py,pz,x,y,z – are given; xW,yW,zW– should be found. 05/04/2011 23/20

  23. Superquadrics have been employed in computer vision and robotics problems related to object recognition. Superquadrics can be used for 1. Object recognition by fitting geometric shapes to 3D sensor data obtained by a robot. Applications with Superquadrics In order to fit a superquadric to a surface region, 11 parameters must be determined: three extent parameters (a1, a2, a3), two shape parameters (ε1 and ε2), three translation parameters, and three rotation parameters. 2. Scene reconstruction and recognition. Rendering. Shape reconstruction is a low level process where sensor data is interpreted to regenerate objects in a scene making as few assumptions as possible about the objects. Object recognition is a higher level process whose goal is to abstract from the detailed data in order to characterize objects in a scene. Applications with Superquadrics

  24. Figures from Superquadrics [3] Definition of Superquadrics

  25. Applications with SQ Reconstruction of complex object [6] Reconstruction of complex object [8] Reconstruction of complex object [7] 05/04/2011 26/20

  26. Applications with SQ Reconstruction of multiple objects [9] Reconstruction of multiple objects [9] 05/04/2011 27/20

  27. Task 1: To model Europallet in SQ Dimensions of EuroPallet

  28. It should be created SQ model of pallet As an example of a Pallet model Transformation: SQc – SQr Transformation: SQc – SQl

  29. Task 2: To model objects by deformed SQ Objects like an apple, a bottle, a chair, a tin of beer

  30. Links A. Skowronski, J. Feldman. Superquadrics. cs557 Project, McGill University. http://www.skowronski.ca/andrew/school/557/start.html Barr A.H. Superquadrics and Angle-Preserving Transformations. IEEE Computer Graphics and Applications, 1, 11-22. 1981. Chevalier L., etc. Segmentation and superquadric modeling of 3D objects. Journal of WSCG, V.11 (1), 2003. ISSN 1213-6972. Kindlmann G. Superquadric Tensor Glyphs. EUROGRAPHICS. IEEE TCVG Symposium on Visualization (2004). Pages 8. Solina F. and Bajcsy R. Recovery of parametric models from range images: The case for superquadrics with global deformations. // IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-12(2):131--147, 1990. Chella A. and Pirrone R. A Neural Architecture for Segmentation and Modeling of Range Data. // 10 pages. Leonardis A., Jaklic A., and Solina F. Superquadrics for Segmenting and Modeling Range Data. // IEEE Transactions On Pattern Analysis And Machine Intelligence, vol. 19, no. 11, 1997. Bhabhrawala T., Krovi V., Mendel F. and Govindaraju V. Extended Superquadrics. // Technical Report. New York, 2007. 93 pages. Jaklic Ales, Leonardis Ales, Solina Franc. Segmentation and Recovery of Superquadrics. // Computational imaging and vision 20, Kluwer, Dordrecht, 2000. Grazie per attenzione!!

More Related