Loading in 5 sec....

A Short Course in Applied Mathematics 2 February 2004 – 7 February 2004 N ∞M∞T Series Two Course Canisius College, Buffalo, NYPowerPoint Presentation

A Short Course in Applied Mathematics 2 February 2004 – 7 February 2004 N ∞M∞T Series Two Course Canisius College, Buffalo, NY

- 456 Views
- Updated On :

Computational Methods for Design Lecture 5 - Design and Optimization Problems John A. Burns C enter for O ptimal D esign A nd C ontrol I nterdisciplinary C enter for A pplied M athematics Virginia Polytechnic Institute and State University Blacksburg, Virginia 24061-0531

Related searches for Lecture 5 - Design and Optimization Problems

Download Presentation
## PowerPoint Slideshow about 'Lecture 5 - Design and Optimization Problems' - JasminFlorian

**An Image/Link below is provided (as is) to download presentation**

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Computational Methods for DesignLecture 5 - Design and Optimization ProblemsJohn A. BurnsCenterforOptimalDesignAndControlInterdisciplinaryCenterforAppliedMathematicsVirginia Polytechnic Institute and State UniversityBlacksburg, Virginia 24061-0531

A Short Course in Applied Mathematics

2 February 2004 – 7 February 2004

N∞M∞T Series Two Course

Canisius College, Buffalo, NY

OPTIMAL DESIGN PROBLEM: Find the parameter 1 < q0, to

minimize the cost function

q

q

q

q

(S)

q

q,

Given data , 0 < x < 1the goal is to match by

solving the following

1D Model ProblemLET 1 < q < and consider the boundary value problem

q

q

q

q

q

(S)

q,

q

q

q

Model Problem #1SENSITIVITY

The sensitivity equation fors(x, q) = qw(x , q)in the

“physical” domain(q) = (0,q) is given by

Can be made “rigorous” by the method of mappings.

MORE ABOUT THIS NEAR THE END

q

q

q

CONTINUOUS

SENSITIVITY

q

q

q

q

q

DISCRETE

SENSITIVITY

h

h

h

h

q

q

q

q

q

Typical Cost FunctionWHERE w( x , q )USUALLY SATISFIES A DIFFERENTIAL EQUATION AND q IS A PARAMETER (OR VECTOR OF PARAMETERS)

THE CHAIN RULE PRODUCES

OR (Reality) USING NUMERICAL SOLUTIONS

q

TYPICAL APPROACHES TO COMPUTE

q=q0

(I) BY FINITE DIFFERENCES

h

h

q0

q

q0

h

q0

q

(II) BYDISCRETESENSITIVITIES

h

h

h

h

q0

q0

q0

q0

q0

Computing GradientsFINITE DIFFERENCES

- REQUIRES THE EXISTENCE OF THE
- DISCRETE SENSITIVITY

- REQUIRES 2 NON-LINEAR
- SOLVES

- IF SHAPE IS A DESIGN
- VARIABLE, FD REQUIRES 2
- MESH GENERATIONS

- IF SHAPE IS A DESIGN VARIABLE,
- THE DISCRETE SENSITIVITY LEADS TO
- MESH DERIVATIVES COMPUTATIONS

WHAT IS THE “CONTINUOUS / HYBRID”

SENSITIVITY EQUATION METHOD? --- SEM

h

h

q0

q0

q0

Computing Gradientsh, k

APPROXIMATE

w h(x) = Finite Element Approximation

x

x=0

x=q

x=1

NUMERICAL APPROXIMATION

h

(S)

h

h

h

h

q,

q

A Sensitivity Equation MethodFORq> 1 ANDh=q/(N+1) CONSIDER (FORMAL)

DISCRETE STATE EQUATION

(S)

h

h

q,

q

h

q

q

h

(S)

h

h

h

h

q,

q

A Sensitivity Equation Method- IMPORTANT OBSERVATIONS
- The sensitivity equations are linear
- The sensitivity equation “solver” can be constructed independently of the forward solver -- SENSE™
- When done correctly “mesh gradients” are not required

q,

q

(S)

h

h

q

q

s(x)= qw(x,q)

(S)

h

s h,k(x) = Finite Element Approximation of

x

x=0

x=q

x=1

2nd NUMERICAL APPROXIMATION

h,k

h,k

q

q

A Sensitivity Equation MethodFOR q> 1 ANDk= q/(M+1) CONSIDER (FORMAL)

h,k

h

q

q

q

q

h

k

h

q

q

h

k

h

k

a trust region method should (might?) converge.

When the error

is small, then

h

q

q

h

k

R. G. Carter, “On the Global Convergence of Trust-Region Algorithms Using Inexact Gradient Information”, SIAM J. Num. Anal., Vol 28 (1991), 251-265.

J. T. Borggaard, “The Sensitivity Equation Method for Optimal Design”, Ph.D. Thesis, Virginia Tech, Blacksburg, VA, 1995.

J. T. Borggaard and J. A. Burns, “A PDE Sensitivity Equation Method for Optimal Aerodynamic Design”, Journal of Computational Physics, Vol.136 (1997), 366-384.

Convergence IssuesTHEOREM. The finite element scheme is asymptotically consistent.

IDEA:

Convergence Issues

N=16, M=32

q

q

h

h

NOT CONVERGENT

Convergence IssuesTHE CASE k = h is often used, but may not be “good enough”

THE CASE k = 2h offers flexibility and

h

2h

q

q

h

convergence.

Timing IssuesBut, what about timings?

Approximately 96 .6% of cpu time spent in function evaluations

Approximately 02 .4% of cpu time spent in gradient evaluations

480 CPU HRS ~3 WEEKS

Mathematics Impacts “Practically”UNDERSTANDING THE PROPER MATHEMATICAL FRAMEWORK CAN BE EXPLOITED TO PRODUCE BETTER SCIENTIFIC COMPUTING TOOLS

- A REAL JET ENGINE WITH 20 DESIGN VARIABLES
- PREVIOUS ENGINEERING DESIGN METHODOLOGY REQUIRED 8400 CPU HRS ~ 1YEAR
- USING A HYBRID SEM DEVELOPED AT VA TECH AS IMPLEMENTED BY AEROSOFT IN SENSE™REDUCED THE DESIGN CYCLE TIME FROM ...

8400 CPU HRS ~ 1YEAR TO

NEW MATHEMATICSWAS THEENABLING TECHNOLOGY

General Comments

- THERE ARE MANY VARIATIONS THAT CAN IMPROVE THE BASIC IDEA
- COMBINING AUTOMATIC DIFFERENTIATION AND SEM
- SMOOTHING AND GRADIENT PROJECTIONS
- ADAPTIVE GRID GENERATION

- THE ORDER OF THINGS MATTER
- DIFFERENTIATE-THEN-APPROXIMATE
- DERIVE SENSITIVITY EQUATION BEFORE MAPPING TO A “COMPUTATIONAL DOMAIN”
- DOES NOT REQUIRE MESH DERIVATIVES
- REQUIRES A MORE SOPHISTICATED MATHEMATICAL FRAMEWORK
- NEEDS A “DIFFERENT THEORY”

J. A. Burns and L. G. Stanley, “A Note on the Use of Transformations in Sensitivity

Computations for Elliptic Systems”, Journal of Mathematical & Computer Modeling,

Vol. 33, pp. 101-114, 2001.

OPTIMAL DESIGN PROBLEM: Find the parameter 0 < q0< 1, to minimize

the cost function

q

(S)

q

q

q

q,

q

where

MODEL PROBLEM #2LET 1 < q < and consider the boundary value problem

DERIVE THE SENSITIVITY EQUATION

q ,

q

(S)

q,

q

q

1

x

0

q

0

1

= (0,1)

(q) = (0,q)

MODEL PROBLEM #2The sensitivity equation for s(x, q) = qw(x , q) in the

“physical” domain (q) = (0,q) is given by

APPROXIMATIONS and CHANGE OF VARIABLES

(METHOD OF MAPPINGS)

= T(x,q) = x/q

q

q

q

-q2

q

MODEL PROBLEM #2Map (0,q) to (0,1) by = T(x,q) = x/q and note that the

inverse mapping M( ,q) = q maps (0,1) to (0, q).

Define

z( ,q) = w(M( ,q), q) = w(q , q) - transformed state

p( , q) = q z( ,q) - sensitivity of the transformed state

and

r ( , q) = s(M( ,q), q) = s(q, q) - transformed sensitivity.

M(S)

M(S)

q

q

q

MODEL PROBLEM #2To compute s(x, q) one has two choices

Solve M( S) for r( , q) and transform back to get

(1) s(x, q) = r( , q) = r(T(x,q), q) = r(x/q , q)

Solve M(S) for p( , q) and transform back to get

(2) s(x, q) = p(x/q , q) - z(x/q , q)[ M (x/q , q)]-1[qM (x/q , q)]

MESH DERIVATIVE

w h(x) = Finite Element Approximation

x

x=0

x=q

x=1

NUMERICAL APPROXIMATION

h

(S)

h

h

h

q,

q

q,

(S)

q

q

MODEL PROBLEM #2FOR q> 1 AND h=q/(N+1) CONSIDER (FORMAL)

h

h

h

s(x)= qw(x,q)

(S)

h

s h,k(x) = Finite Element Approximation of

x

x=0

x=q

x=1

q,

h,k

2nd NUMERICAL APPROXIMATION

(S)

h,k

q

q

q

q

MODEL PROBLEM #2FOR q> 1 ANDk= q/(M+1) CONSIDER (FORMAL)

MODEL PROBLEM #2

H1 - ERROR FOR w(x ,q )

N = 03

-0.05

N = 05

N = 09

-0.1

-0.15

-0.2

-0.25

-0.3

-0.35

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

MODEL PROBLEM #2q [z( ,q)] = p( ,q )

M by (1)

s(x ,q )

0.6

[z(x/q , q)]

0.5

[zh(x/q , q)]

Finite Element Approximation

of the Spatial Derivative

0.4

0.3

0.2

0.1

0

-0.1

-0.2

0

0.5

1

1.5

MODEL PROBLEM #2(2) s(x, q) = p(x/q , q) - z(x/q , q)[ M (x/q , q)]-1[q M (x/q , q)]

1

= 2

q

q

= 1

q

0

q

()

q

q

q

q

q

q

q

q

1D Interface ProblemELLIPTIC PROCESS MODEL - 2 MATERIALS

CONTINUITY

OPTIMAL DESIGN PROBLEM: Find the parameter 0 < q0< 1, to minimize

the cost function

q

q

q

q

q

q

q

q

q

OR ...

q

q

q

1D Interface Problemq

q

q

q

q

q

q

q

q

1D Interface ProblemTHE SOLUTION AND SENSITIVITY IS GIVEN BY

HOW SMOOTH ISs(x, q ) = q w(x , q)?

s( · , q ) H1() ?

PLOT OF w(x, q) AT q = .5

PLOT OF SENSITIVITY s(x,q) AT q = .5

1

0.2

0.9

0.8

0.1

0.7

0.6

0

0.5

-0.1

0.4

0.3

-0.2

0.2

-0.3

0.1

0

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

-0.4

-0.5

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

1D Interface Problems( · , q ) H1()

q

q

q

()

q

q

q

q

(C)

(J)

1D Interface Problem- HOWEVER, THE SENSITIVITY EQUATION IS GIVEN BY THE BOUNDARY VALUE PROBLEM

- HOW DID WE DERIVE THIS SYSTEM?
- WHAT DO WE MEAN BY A SOLUTION?
- CAN THIS BE MADE RIGOROUS?

q

LET

q

q

q

q

q

q

q

q

TAKE THE TOTAL DERIVATIVE OF

q

q

q

q

q

q

q

q

q

q

q

q

q- q

q- q

q+ q

q+ q

q q

q q

q q

q q

Formal DerivationJUMP

q

q

q

q

q

q

q

q

q

q

in [W (q)]’

?

()

Formal DerivationLIKEWISE ...

WEAKEST FORM OF THE ELLIPTIC PROBLEM

Sensitivity Computations

Petrov-Galerkin FE Method (Burns, Lin & STanley - 03)

2D Sensitivity Computations

Petrov-Galerkin FE Method (Burns, Lin & STanley - 03)

!! WORKS IN 2D !!

FOR COMPLEX GEOMETRY

NUMERICAL METHODS

Numerical Methods Matter

DIFFERENTIATE THEEQUATIONWITH RESPECT TOq

Numerical Methods Matter

INTERCHANGE THE ORDER OF DIFFERENTIATION

Numerical Methods Matter

Numerical Methods Matter

FORWARD EULER

Why Sensitivities?

- USEFUL IN OPTIMIZATION BASED DESIGN

- SENSITIVITIES HAVE MANY OTHER USES
- PRIORITIZE DESIGN & CONTROL VARIABLES
- EVALUATE DESIGNS & CONTROL LAWS
- NON- OPTIMIZATION BASED DESIGN
- FAST SOLVERS
- ANALYZE UNCERTAINTIES
- PREDICT “FAILURE” (FLOW SEPARATION, ETC.)

MAY REQUIRE COMPLEX

MATHEMATICAL THEORIES

-------

DIFFERENTIATION OF

SET-VALUED FUNCTIONS

- SOME OBSERVATIONS
- DO NUMERICS CAREFULLY
- “ORDER’’ MATTERS

Download Presentation

Connecting to Server..