Smart traveller with visual translator
1 / 26

Smart Traveller with Visual Translator - PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Smart Traveller with Visual Translator. What is Smart Traveller?. Mobile Device which is convenience for a traveller to carry E.g. Pocket PC, Mobile Phone. What is Visual Translator?. Recognize the foreign text and translate it into native language Detect the face and recognize it into name.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

Download Presentationdownload

Smart Traveller with Visual Translator

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Smart traveller with visual translator

Smart Traveller with Visual Translator

What is smart traveller

What is Smart Traveller?

  • Mobile Device which is convenience for a traveller to carry

  • E.g. Pocket PC, Mobile Phone

What is visual translator

What is Visual Translator?

  • Recognize the foreign text and translate it into native language

  • Detect the face and recognize it into name



  • Simple (Computational low power)

  • Lightweight (Low Storage)

  • User Friendly

Core pattern recognition model

Find Each Object from the Image

Quantify the object by some characteristics

Assign Label for each object



Feature Extraction


Input Image

Object Image

Feature Vector

Object Type

Core Pattern Recognition Model

Character recognition

Character Recognition

  • Language: Korean

  • Target: Sign, Guidepost

    • Contrast in Color

    • Printed Character

Image segmentation

Image Segmentation

  • Binarization

    • Using Color Histogram to binarize the image for the background and the character

  • Text Region Segmentation

    • User Define Method

    • Edge Detection with horizontal and vertical projections

  • Stroke Extraction

    • Labeling of connected component Algorithm

Feature extraction

Feature Extraction

  • Stroke Features

    • Number of Junctions, Corners

    • Any Hole

  • Gabor Features



  • Minimum Euclid Distance

  • Learn the Decision Tree by training examples

Smart traveller with visual translator


Face detection

Face Detection


Find Face Region

Find the potential eye region

Locate the iris and eyelids

Find face region color based model

Find Face Region - Color-based model

  • We used this method because of its simplicity and robustness.

  • Usually RGB color model will be transformed to other color modes such as YUV (luminance-chrominance) and HSB (hue, saturation and brightness)

Smart traveller with visual translator


  • We use YUV or YCbCr color model.

  • Y component is used to represent the intensity of the image

  • Cb and Cr are used to represent the blue and red component respectively.

Yc b c r image

YCbCr Image

  • Y, Cb ,Cr component image

Y Cb Cr

Representation of skin color

Representation of skin color

  • We just use a simple ellipse equation to model skin color.



Representation of skin color1

Representation of skin color

  • The white regions represent the skin color pixels

Color segmentation

Color segmentation

  • We distribute some agent in the image uniformly.

  • Then each agent will check whether the pixel is a skin-like pixel and not visited by the other agent.

  • If yes, it will produce 4 more agents at its four neighboring points.

  • If no, it will move to one of four neighboring points randomly and decrease its lifespan by 1. When its lifespan becomes zero, it will be removed from the image.

Color segmentation1

Color segmentation

  • This agent produce 4 more agents

Color segmentation2

Color segmentation

  • The advantage of this algorithm is that we need not to search the whole image.

  • Therefore, it is fast.

Color segmentation3

Color segmentation

  • 19270 of 102900 pixels is searched (about 18.7%)

  • There are 37 regions

  • Each color regions represent each regions searched by a father agent

Eye detection

Eye detection

  • After the segmentation of face region, we have some parts which are not regarded as skin color.

  • They are probably the region of eye and mouth

  • We only consider the red component of these regions because it usually includes the most information about faces.

Eye detection1

Eye detection

  • We extraction such regions.

  • The red region represent the region which is not skin color.

Eye detection2

Eye detection

We do the following on the regions of potential eye region

  • Histogram equalization

  • Threshold

  • Template matching

Eye detection3

Eye detection

Histogram equalization

Threshold with < 49

Template Matching

Locating the iris and eyelids

Locating the iris and eyelids

We plan to use the following methods to improve the face detection

We can use these methods to locate the iris and eyelid precisely.

Template matching

  • Correlation variance filter

  • Deformable template

Smart traveller with visual translator


  • Login