1 / 13

CS492: Special Topics on Distributed Algorithms and Systems Fall 2008

CS492: Special Topics on Distributed Algorithms and Systems Fall 2008. Lab 3: Final Term Project. Final Term Project. Goal In-depth study of distributed algorithms and systems

randy
Download Presentation

CS492: Special Topics on Distributed Algorithms and Systems Fall 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CS492: Special Topics onDistributed Algorithms and SystemsFall 2008 Lab 3: Final Term Project

  2. Final Term Project • Goal • In-depth study of distributed algorithms and systems • Each team chooses a topic of interest related to distributed systems or algorithms or one from example projects • Each team will submit a term paper which includes: • Introduction and Motivation • Problem Definition • Related Work • Your Solution and Evaluation • Conclusions • Each team will have two presentations • First presentation should include: motivation, problem definition, and related work • Final Presentation at the end of semester

  3. Evaluation Analysis Simulation Emulation Implementation

  4. Project Ideas Storage Management PageRank in Large Dataset PageRankin Dynamic Dataset Paxos Project

  5. 1. Storage Management Many students faced with error caused by not enough disk storage while working on Lab 2. Total amount of storage of 6 nodes are sufficiently large to store all data including input, output, and intermediate data. How can we utilize storage effectively?

  6. 2. PageRank in Large Dataset In Lab 2, you worked with about 2,000,000 documents. Suppose you have 10,000 times more documents. What are the expected problems using PageRank algorithm and how can you solve those problems?

  7. 3. PageRankin Dynamic Dataset Web documents are created and removed as time goes. Computing PageRanktakes a large amount of time. How can we compute PageRankefficiently when graphs change all the time?

  8. 4. PaxosProject • What is “consensus”? • The process of agreeing on one result among a group of process (or a group of state machine) • What is Paxos? • Protocols for solving consensus in a network of unreliable processors • Paxos in wikipedia

  9. Various PaxosProtocols • A family of Paxos protocols • Basic, Multi, Cheap, Fast, Generalized Paxos • A number of optimization skills • Reduce the number of messages between processors • Reduce the number of calculations in a process

  10. Applications Using Paxos (I) • Google Chubby • Distributed lock service to keep replicas consistent • Used in Google Analytics and other products • http://labs.google.com/papers/chubby.html

  11. Applications Using Paxos (II) • IBM SAN Volume Controller • General-purpose fault-tolerant virtual machine • Runs the configuration and control component of the storage virtualization services offered by the cluster • IBM SAN volume controller

  12. Paxos Project • Project Objectives • Study the family of Paxos algorithms • Choose aspecific version of Paxos protocol and optimization skills • Design appropriate services or systems and implement it using the Paxosalgorithm • You have to simulate or make some failure conditions and prove the system’s fault-tolerance • Experiment over PlanetLab?

  13. Schedule 10/30 Thu – Lab 2 review by TAs Class on Chapters 2 & 3 Individual team meetings Term project presentation #1 Class on Chapters 9 and 10 Individual team meetings (tentative) Class on Chapters 9 and 10 (tentative) Term project presentation #2 (tentative)

More Related