A flexible seam detection t echnique
This presentation is the property of its rightful owner.
Sponsored Links
1 / 61

A flexible seam detection t echnique PowerPoint PPT Presentation


  • 53 Views
  • Uploaded on
  • Presentation posted in: General

A flexible seam detection t echnique. for robotic laser welding. (Shortened English version) Jorg Entzinger. Laser bundel. Seam to Weld. Laser Focus Lens. Camera lens. Video camera. Dichroic mirror. Laser diode. Laser Focus Lens. Presentation Structure. Introduction

Download Presentation

A flexible seam detection t echnique

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


A flexible seam detection t echnique

A flexible seam detection technique

for robotic laser welding

(Shortened English version)

Jorg Entzinger


A flexible seam detection t echnique

Laser bundel

Seam to Weld


A flexible seam detection t echnique

Laser

Focus Lens


A flexible seam detection t echnique

Camera lens

Video camera

Dichroic mirror

Laser diode


A flexible seam detection t echnique

Laser

Focus Lens


Presentation structure

Presentation Structure

  • Introduction

  • Lens & camera calibration

  • Image undistortion

  • Seam Detection


Functions of the multifunctional welding head

Detect seams

Track & learn seams

Laser weld seams

Process control

Quality control

Functions of the Multifunctional Welding head


S p ecialities of this welding head

Specialities of this welding head

  • Multifunctionality

    All needed technology is integrated in one machine

  • Compactness

    Flexible in use for complex geometries

  • Lightweight

    For higher accuracies with the use of robots


Assignment

Assignment

  • Develop a system that can compensate for lens distortions

  • Develop a system to determine the exact position of the workpiece with respect to the welding head from camera images


Distortion types

Distortion Types

  • Perspective distortions

  • Camera distortions (skew, non-squareness of pixels)

  • Lens distortions (radial: barrel/pincushion)

  • Noise (dust, bad focussing, CCD measurement noise)

Normal Perspective Skew Barrel Pincushion


Program structure

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

Program Structure


Program structure1

Program Structure

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image


The calibration pattern

The calibration-pattern

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Estimate parameters

Write params to file


Pictures of thecalibration pattern

Pictures of theCalibration-pattern

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Estimate parameters

Write params to file


Identified keypoints

Identified Keypoints

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Estimate parameters

Write params to file


Sorted keypoints

Sorted Keypoints

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Estimate parameters

Write params to file


Parameter estimation 1

Perspective

Camera

Parameter estimation (1)


Parameter estimation 2

Parameter estimation (2)

Barrel Pincushion

or


Estimation refinement

Estimation refinement

Homography was calculated without considering radial distortions

 Distortions are calculated from an inaccurate homography

 The estimations must be refined, all parameters are optimized at the same time


Program structure2

Program Structure

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image


Program structure3

Program Structure

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image


Undistortion

Undistortion


An original distorted picture

An Original (Distorted) Picture


Test result

Test Result


Test result1

Test Result

Original Undistorted


Simulated distortion test

Simulated Distortion Test

Original Undistorted


Result

Result

Original Undistorted


Amout of distortion

Amout of Distortion

Pixel movement in %

Position on image diagonal


Programma structuur

Programma Structuur

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image


Program structure4

Program Structure

MATLAB

Make calibration pattern

Take pictures

Identify keypoints

Sort keypoints

Parameter estimation

Write Params to File

C++

Read parameters

from file

Generate look-op table

of pixel displacements

Aquire camera image

Undistort image

Determine seam location

Move Robot


Changes in camera image due to a change of relative position

Changes in camera image due to a change of relative position


Changes in camera image due to a change of relative position1

Changes in camera image due to a change of relative position


World co rdinates

World Coördinates

  • How many millimeters in reality

    is 10 pixels in the image?

  • If the image moves to the right, in what direction did the robot move?

  • Where is the camera

    with respect to the welding spot?


Test objects

Test objects


Following a seam

Following a seam


Thank you

Thank you

for your attention

Jorg Entzinger


Rotatie matrix

Rotatie Matrix


Rodrigues parameters

Rodrigues Parameters


Rotatie matrix rodrigues parameters

Rotatie Matrix  Rodrigues Parameters


Schatten van de parameters 1

Schatten van de Parameters (1)

met


Aanbevelingen

Aanbevelingen

  • Pixel-millimeter schaling hoogte afhankelijk maken

  • Bepaling naad-positie minder afhankelijk maken van handmatige instellingen

  • Zorgen voor goede afhandeling als de naad dicht bij de kruising van de lijnen komt

  • Goede gebruikers-interface voor camera & lens calibration maken


Camera lens distortions

Camera & Lens distortions

  • Perspective distortion

  • Skew distortion

  • Radial distortions (barrel & pincushion)

  • Noise

Normal Perspective Skew Barrel Pincushion


Why camera calibration

Why Camera Calibration?


Detectie van lijnen

Detectie van Lijnen


Scheiden van lijnen in het kruis

Scheiden van Lijnen in het Kruis


Detectie van de lasnaad

Detectie van de Lasnaad


Parameters schatten

Parameters schatten

Er worden subsets gemaakt van

Datapunten uit 4 plaatjes, bijvoorbeeld:

Subset 1 Subset 2 Subset 3 ...

Dataset 1 Dataset 2 Dataset 3

Dataset 2 Dataset 4 Dataset 5

Dataset 3 Dataset 6 Dataset 7

Dataset 4 Dataset 8 Dataset 8

Voor elke subset wordt een calibration

uitgevoerd

MATLAB

calibration patroon

maken

Foto’s nemen

Keypoints identificeren

Keypoints sorteren

Parameters schatten

Parameters naar

bestand schrijven


Parameter schattingen op basis van meerdere subsets

Parameter Schattingen Op Basis Van Meerdere Subsets

RMS alfa f


Schatten van de parameters 2

Schatten van de Parameters (2)

Homografie (per plaatje):8 DOFs

Plaatje afhankelijk: 6 DOFs

(3 rotatie en 3 translatie)-

Over voor schatting camera

parameters:2 DOFs

Er zijn 5 camera afhankelijke parameters,

dus er is minstens 2½ plaatje nodig


Verstorings gebied fotocamera

Verstorings-gebied fotocamera


Experiment

Experiment


Experiment1

Experiment


Meetfouten

Meetfouten

Y-fout [mm]

X-positie [mm]

Z-fout [mm]

X-positie [mm]

Totaal-fout [mm]

X-positie [mm]


A flexible seam detection t echnique1

A flexible seam detection technique

for robotic laser welding

Jorg Entzinger


Dagplanning

Dagplanning

13:00 – 13:45Presentatie

13:45 – 14:00Vragen uit de zaal

Jorg & Examencommissie

14:00 – 14:30Demonstratie in het lab

14:30 – 15:30Ondervraging

Rest

14:00 – 15:30Rondleiding door Niels en/of

Koffie/Thee in WB (Horst) kantine

Iedereen

15:30 – 16:00Diploma-uitreiking & felicitatie (WB-Z109)

16:15 – 18:00Borrel & Demonstraties in het Lab

(WB-Hal IV = Westhorst)


  • Login