Download
slide1 n.
Skip this Video
Loading SlideShow in 5 Seconds..
@ andy_pavlo PowerPoint Presentation
Download Presentation
@ andy_pavlo

@ andy_pavlo

95 Views Download Presentation
Download Presentation

@ andy_pavlo

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Making Fast Databases FASTER @andy_pavlo

  2. Fast + Cheap If a system is already fast, can we make it faster without giving up ACID?

  3. Main Memory • Parallel • Shared-Nothing Transaction Processing

  4. Stored Procedure Execution Procedure Name Input Parameters Transaction Result Client Application

  5. TPC-C NewOrder

  6. Optimization #1: Partition database to reduce the number of distributed txns. Skew-Aware Automatic Database Partitioning in Shared-Nothing, Main Memory OLTP SystemsIn Submission

  7. CUSTOMER ITEM CUSTOMER ORDERS CUSTOMER CUSTOMER CUSTOMER ORDERS ORDERS ORDERS ITEM ITEM ITEM

  8. DDL CUSTOMER NewOrder SELECT * FROM WAREHOUSE WHERE W_ID = 10; SELECT * FROM DISTRICT WHERE D_W_ID = 10 AND D_ID =9; INSERT INTO ORDERS (O_W_ID, O_D_ID, O_C_ID,…) VALUES(10, 9, 12345,…); ⋮ SELECT * FROM WAREHOUSE WHERE W_ID = 10; SELECT * FROM DISTRICT D_W_ID = 10 AND D_ID =9; INSERT INTO ORDERS (O_W_ID, O_D_ID, O_C_ID) VALUES (10, 9, 12345); ⋮ SELECT * FROM WAREHOUSE WHERE W_ID = 10; INSERT INTO ORDERS (O_W_ID, O_D_ID, O_C_ID) VALUES (10, 9, 12345); ⋮ ITEM DDL SELECT * FROM WAREHOUSE WHERE W_ID = 10; INSERT INTO ORDERS (O_W_ID, O_D_ID, O_C_ID) VALUES (10, 9, 12345); ⋮ Schema ORDERS DTxn Estimator Skew Estimator ------- -------------- Workload Large-Neighorhood Search Algorithm … CUSTOMER CUSTOMER CUSTOMER CUSTOMER ORDERS ORDERS ORDERS ORDERS ITEM ITEM ITEM ITEM

  9. TATP TPC-C

  10. ? ? Client Application ?

  11. Optimization #2: Predict what txns will do before they execute. On Predictive Modeling for OptimizingTransaction Execution in Parallel OLTP Systemsin PVLDB, vol 5. issue 2, October 2011

  12. Client Application

  13. Houdini Assume Single-Partitioned (txn/s) TATP TPC-C AuctionMark +57% +126% +117%

  14. Conclusion: Achieving fast performance ismore than just using only RAM. Future Work: Reduce distributed txn overhead through creative scheduling.

  15. h-store hstore.cs.brown.edu github.com/apavlo/h-store

  16. Help is Available +1- 617-258-6643 Graduate Student Abuse HotlineAvailable24/7 Collect Calls Accepted