1 / 20

C&O 355 Mathematical Programming Fall 2010 Lecture 20

C&O 355 Mathematical Programming Fall 2010 Lecture 20. N. Harvey. TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box .: A A A A A A A A A A. The “Simplex Method”.

burt
Download Presentation

C&O 355 Mathematical Programming Fall 2010 Lecture 20

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. C&O 355Mathematical ProgrammingFall 2010Lecture 20 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA

  2. The “Simplex Method” • “The obvious idea of moving along edges from one vertex of a convex polygon to the next” [Dantzig, 1963] ObjectiveFunction End Here Start Here Image: http://torantula.blogspot.com/

  3. The “Simplex Method” • “The obvious idea of moving along edges from one vertex of a convex polygon to the next” [Dantzig, 1963] Polyhedron: • Algorithm • Let x be any vertex of P • For each neighbor y of x • If cTy>cTx then • Set x=y and go to start • Halt LP: • Remarks • The name sounds fancy, but is meaningless. • In practice, very fast. Used in all LP software. • In theory, we don’t know whether it’s fast or not.(Because we don’t understand the diameter of polyhedra, i.e., Hirsch Conjecture) This is a simplex

  4. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices? • How can I find a starting vertex? • What are the “neighboring” vertices? • Does the algorithm terminate? • Does it produce the right answer? • Algorithm • Let x be any vertex of P • For each neighbor y of x • If cTy>cTx then • Set x=y and go to start • Halt Polyhedron: LP:

  5. Issue #1What if there are no vertices? • Not all polyhedrons have vertices! • Recall: Any polyhedron that does not contain a line has at least one vertex. • A fix: Instead of max { cTx : Ax·b }we could solve max { cT(u-v) : A(u-v)+w=b, u,v,w¸0 }.These LPs are equivalent. The feasible region of the new LP contains no line. • Summary: Can assume we’re solving an LP with a vertex. x2 x2· 2 x2¸0 x1

  6. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices?Can modify polyhedron so that it has a vertex. • How can I find a starting vertex? • What are the “neighboring” vertices? • Does the algorithm terminate? • Does it produce the right answer?

  7. Issue #2How can I find a starting vertex? • This is non-trivial! As shown in Lecture 3, maximizing the LP is equivalent to finding a feasible point for: • So, in general, finding a feasible point is not easy. • A fix: • The problem “find a feasible point for my LP” can be solved by a new LP. How does this help?!? • The new LP has an obvious feasible point!So we solve the new LP, get feasible point for old LP. • Once you have a feasible point, it’s easy to find a vertex: • Lecture 10: Any LP whose feasible region contains no line has an optimal solution at a vertex. • That proof actually gives an algorithm to find a vertex.

  8. Finding a starting point • Consider LP max { cTx : x2P } where P={ x : Ax=b, x¸0 } • We’ll find a feasible point by solving a new LP! • Note: c is irrelevant. We can introduce a new objective function • WLOG, b¸0 (Can multiply constraints by -1) • Allow “Ax=b” constraint to be violated via “artificial variables”: Q = { (x,y) : Ax+y=b, x¸0, y¸0 } • Note: (x,0)2Q , x2P. Can we find such a point? • Solve the new LP min { §iyi : (x,y)2Q } • If the optimal value is 0, then x2P. If not, P is empty! • How do we find feasible point for the new LP? • (x,y)=(0,b) is a trivial solution!

  9. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices?Can modify polyhedron so that it has a vertex. • How can I find a starting vertex?Can find a feasible point by solving a different LP.Can move from that feasible point towards a vertex. • What are the “neighboring” vertices? • Does the algorithm terminate? • Does it produce the right answer?

  10. Issue #4Does the algorithm terminate? • This is easy! • In every iteration, the algorithm sets x to a new vertex. • Note that the objective function strictly improves by moving to the new vertex. • So the algorithm cannot have visited that vertex before. • Recall from Lecture 10:Every polyhedron has only finitely many vertices. • So the algorithm must terminate after finitely many steps.

  11. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices?Can modify polyhedron so that it has a vertex. • How can I find a starting vertex?Can find a feasible point by solving a different LP.Can move from that feasible point towards a vertex. • What are the “neighboring” vertices? • Does the algorithm terminate?Yes: objective function increases only finitely many times. • Does it produce the right answer?

  12. Edges From Lecture 11: 0-face(vertex) 1-face(edge) Image: http://torantula.blogspot.com/ • Summary: Two vertices are neigboring if the constraints that are tight at both vertices have rank n-1.

  13. Issue #3What are the “neighboring” vertices? • Consider a vertex x.It is also a BFS, so the tight constraints at x have rank n. • Choose a subset of these constraints of rank n-1.Consider the set of points for which this subset of constraints are all tight. This is an edge.(By Asst 3, Question 3) • Uh oh! If there are t tight constraints at x, then the number of such subsets could be . Enumerating all of these subsets could be very slow. • A fix: • Add very small “noise” to every entry of the matrix A defining the constraints. • Then every vertex has exactly n tight constraints,and at most n edges leaving it.

  14. Issue #3What are the “neighboring” vertices? • A fix: • Add very small “noise” to every entry of the matrix A defining the constraints. • Then every vertex has exactly n tight constraints,and at most n edges leaving it. • Example: • Want only 3 edges leaving x,but there are 5. x

  15. Issue #3What are the “neighboring” vertices? • A fix: • Add very small “noise” to every entry of the matrix A defining the constraints. • Then every vertex has exactly n tight constraints,and at most n edges leaving it. • Example: • Want only 3 edges leaving x,but there are 5. • If we perturb the constraintsslightly, every vertex has only3 tight constraints and 3 edges. x

  16. Issue #3What are the “neighboring” vertices? • A Fix: • Add very small “noise” to every entry of thematrix A defining the constraints. • Then every vertex has exactly n tight constraints,and at most n edges leaving it. • Finding the neighbors:For each edge leaving the vertex • Move along edge while remaining in feasible region • When a new constraint becomes tight,we’ve arrived at a neighboring vertex • If no constraint becomes tight, it’s an unbounded edge • Check if the objective function increases when moving along the edge. If so, LP is unbounded.

  17. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices?Can modify polyhedron so that it has a vertex. • How can I find a starting vertex?Can find a feasible point by solving a different LP.Can move from that feasible point towards a vertex. • What are the “neighboring” vertices?Add noise to constraints so that only each vertex has few edges. Find edges by choosing n-1 tight constraints. • Does the algorithm terminate?Yes: objective function increases only finitely many times. • Does it produce the right answer?

  18. Issue #5Does algorithm produce the right answer? • Yes!If you cannot increase the objective function by moving along any edge leaving x, then x must be optimal. • That is very intuitive, but formalizing it takes some work:See Notes for Lecture 20.

  19. Pitfalls • The simplex method is very simple… • …if we can handle a few issues • What if there are no vertices?Can modify polyhedron so that it has a vertex. • How can I find a starting vertex?Can find a feasible point by solving a different LP.Can move from that feasible point towards a vertex. • What are the “neighboring” vertices?Add noise to constraints so that only each vertex has few edges. Find edges by choosing n-1 tight constraints. • Does the algorithm terminate?Yes: objective function increases only finitely many times. • Does it produce the right answer? • Yes: if no edge increases objective function, x is optimal.

  20. Summary • “The obvious idea of moving along edges from one vertex of a convex polygon to the next” [Dantzig, 1963] • The idea is very simple • There are many pitfalls which complicate things. • Main idea to handle complications is to modify Pso that it becomes “nice” in various ways. • Finding neighbors is conceptually simple, but to formalize it, the notation gets a bit messy. • We used Farkas’ Lemma to prove optimality. • Algorithm • Let x be any vertex of P • For each neighbor y of x • If cTy>cTx then • Set x=y and go to start • Halt

More Related