A parallel genetic algorithm with distributed environment scheme
This presentation is the property of its rightful owner.
Sponsored Links
1 / 15

A Parallel Genetic Algorithm with Distributed Environment Scheme PowerPoint PPT Presentation


  • 51 Views
  • Uploaded on
  • Presentation posted in: General

A Parallel Genetic Algorithm with Distributed Environment Scheme. M. Kaneko M. Miki T. Hiroyasu. Doshisha University, Kyoto, Japan. Background. GAs(Genetic Algorithms) Stochastic search algorithms based on the mechanics of natural selection and natural genetics Disadvantage

Download Presentation

A Parallel Genetic Algorithm with Distributed Environment Scheme

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


A parallel genetic algorithm with distributed environment scheme

A Parallel Genetic Algorithm withDistributed Environment Scheme

M. Kaneko

M. Miki

T. Hiroyasu

Doshisha University, Kyoto, Japan


Background

Background

  • GAs(Genetic Algorithms)

    • Stochastic search algorithms based on the mechanics of natural selection and natural genetics

  • Disadvantage

    • A huge amount of computational resource is required.

    • The performance of GAs depends on a choice for the rates of parameters. However, it is difficult to choose proper rates of parameters.

Parallel Distributed GA (PDGA)

PDGA with

Distributed Environment


Parallel distributed ga

Parallel Distributed GA

Single Population GA

(SPGA)

Parallel Distributed GA

(PDGA)

Subpopulation

Population

Migration

Individual

  • Some GAs are performed in multiple subpopulations.

  • Migration: Exchange of individuals among subpopulations


Crossover and mutation

Crossover and Mutation

parent A

parent B

  • Crossover

    • To perform direct information exchange between individuals

  • Mutation

    • To avoid stagnation in evolution

0.6DeJong (1975)

0.95Grefenstette (1986)

0.75~0.95 Bäck (1996)

child A

child B

0.001DeJong (1975)

0.01Grefenstette (1986)

0.005~0.01 Schaffer (1989)

1/L Bäck (1996)

L: Coromosome Length


Test functions

Test Functions

Epistasis

Name

Functions

Chromosome

length (bit)

none

Rastrigin

100

(10bits×10variables)

none

Schwefel

100

(10bits×10variables)

100

(10bits×10variables)

weak

Griewank

120

(12bits×10variables)

strong

Rosenbrock

Rastrigin

Schwefel

Griewank

Rosenbrlck


Procedures of experiments

Procedures of Experiments

10/L

1.0

Mutation Rate

9

20, 180

180,1620

20

0.3

1000

Number of Subpopulations

Subpopulation size

Total Population size

Migration Interval

Migration Rate

Max Generations

10/L

0.1/L

1/L

0.3

0.1/L

1/L

10/L

0.3

0.3

0.3

0.6

0.1/L

1/L

10/L

Crossover Rate

Roulette selection

Conservation of elite

One point crossover

The average of 10 trials out of 12 trials omitting the highest and lowest values

0.6

0.6

0.6

0.1/L

1/L

1.0

1.0

1.0

L:Chromosome length

nCUBE2 with 64 processors

Processor network : Hypercube

One processor is assigned to one subpopulation.


History of fitness spga

History of Fitness (SPGA)

Pc 1.0

0.6

0.3

Rastrigin

Pop. Size 180

Fitness value

Pm = 0.1/L

Pm = 1/L

Pm = 10/L


The effect of crossover and mutation rates

The Effect of Crossover and Mutation Rates

(SPGA)

Pc - Pm


History of fitness pdga

History of Fitness (PDGA)

Pc 1.0

0.6

0.3

Rastrigin

Pop. Size 180

Fitness value

Pm = 0.1/L

Pm = 1/L

Pm = 10/L


The effect of crossover and mutation rates1

The Effect of Crossover and Mutation Rates

(PDGA)


Comparison of the performance

Comparison of the performance

1.0E+03

1.0E+02

0.3-0.1/L

1.0E+01

0.6-0.1/L

1.0E+00

1.0-0.1/L

Function value

0.3- 1/L

1.0E-01

0.6- 1/L

1.0E-02

1.0- 1/L

0.3-10/L

1.0E-03

0.6-10/L

1.0E-14

1.0E-04

1.0-10/L

1.0E-15

1.0E-05

SPGA

PDGA

SPGA

PDGA

SPGA

PDGA

SPGA

PDGA

Rastrigin Schwefel Griewank Rosenbrock

(SPGA and PDGA)

Pop. Size 180


Pdga de distributed environment

PDGA/DE (Distributed Environment)

PDGA/DE

(Distributed Environment)

Different crossover rates

Different mutation rates

PDGA/CE

(Constant Environment)

A Constant crossover rate

A Constant mutation rate

Mutation rate

Crossover rate


Effectiveness of pdga de

Effectiveness of PDGA/DE

Pop. Size 180


Speedup

Speedup

1000 generations

same quality of solutions

(at 1000 generations in PDGA/DE)

Pop. Size = 450

Number of Subpopulations = 9 (9PEs)

PDGA/DE vs. SPGA (with the best combination)

Ideal speedup

(1) 8.6(similar to the ideal speedup)

(2) between 22 and 25 (except for the Rosenbrock function)

PDGA/DE provides solution 2.6 to 2.9 times faster than SPGA


Conclusions

Conclusions

  • The optimum crossover and mutation rates vary according to the population size and the problem to be solved.

  • A parallel distributed GA with distributed environment(PDGA/DE) is proposed, and the superiority of this scheme is experimentally proved.

  • PDGA/DE is the fastest way to gain the best solution under uncertainty of the appropriate crossover and mutation rates.


  • Login