370 likes | 380 Views
Distributed Systems. From Wiki A distributed system is a model in which components located on networked computers communicate and coordinate their actions by passing messages. A growing number of real systems are distributed Web Distributed file systems: GFS, NFS, Zookeeper…
E N D
DistributedSystems • FromWiki • Adistributedsystemisamodelinwhichcomponentslocatedonnetworkedcomputerscommunicateandcoordinatetheiractionsbypassingmessages. • Agrowingnumberofrealsystemsaredistributed • Web • Distributedfilesystems:GFS,NFS,Zookeeper… • Distributeddatabases:MySQL • Cloud • Blockchain • …
DistributedSystemsandComputing • Cloudcomputing • Bigdata • Blockchains • Scalablewebservices? • Highperformancecomputing • Distributedsystems:Thelarge-scaleinfrastructuresystemsthataremakingthesepossible
ThisCourse • AdvancedTopicsinDistributedSystems • Overviewoftheconceptsandprinciples • Formalizingtheideasanddesign • Researchareasandtrends • Youwillhaveagoodunderstandingofbothtechnicalsidesandtheoreticalsidesofmostdistributedsystemsrelatedtopics
ClassInfo • OfficeHour • MyOffice:ITE426 • Tue3-4:30pm,Fri2-4pm • Makeanappointmentotherwise • Emailisthebestwaytoreachme • sduan@umbc.edu • Classwebsite: • http://sduan.informationsystems.umbc.edu/classes/IS800/IS800-Spring2019.html
Classwebsitehttp://sduan.informationsystems.umbc.edu/classes/IS800/IS800-Spring2019.htmlClasswebsitehttp://sduan.informationsystems.umbc.edu/classes/IS800/IS800-Spring2019.html • Google“SisiDuan”->mywebsite->Teaching->IS698/800
Grading • ClassParticipation(5%) • Inclassdiscussion • PaperReview(30%) • Project(40%) • InClassLecture(25%)
ClassProject • Chooseanytopiconyourownrelatedtodistributedsystems • Comeupwithyourownorchoosefromthelistoftopics • Teamof1-2people • Aresearchproject • Mustadvancecollectiveknowledgeinsomerelevantnewway • Mustcontainauniquecontributionthatisnotincludedinanyotherofyourpastorpresentprojects
ClassProjectSteps • Formulatetheproblem • Literaturereview(Researchandunderstandrelatedworks,7-10papers) • Proposeanewapproachandformulateyourhypothesis • (Optional)Implementpartsofyourapproachthatarevitaltoverifyingyourhypothesis • (Optional)Evaluateyourimplementationinthecontextofyourhypothesis • Writeupandpresentyourresults
ClassProjectSubmissions • Deliverable1(10%) • Teamformation,projecttopic,roughplan • Deliverable2(20%) • Progress(literaturereview) • ProgressPresentation(20%,beforespringbreak) • FinalReport(25%) • Presentation(25%,lastweekoftheclass) • Moredetailslater
PaperReview • Youareexpectedtoreviewupto1paperperweek,whichwillbecoveredinclass • Thelistwillbesharedonthewebsiteunder“Deadlines”
PaperReviewSubmissions • Beforetheclass: • Youareexpectedtowriteareviewaccordingtothetemplate • Feelfreetoaddothercontents/detailsandadjustthetemplateaccordingtoyourunderstanding • Aftertheclass: • Youareexpectedtoaddcommentsandaddnewreviewstotheend • Submitthe review by the end of every Monday • New comments can be submitted together with the next review submission
InClassLecture • Inthesecondhalfofthesemester • Onestudent-leadpresentationperclass • Oneprimarypaperpresentation(50minutesintotal) • Thelistofprimarypapersandpresentationtimewillbeprovidedlaterinclass • Bidforyourpresentation
InClassLecture • Primarypaperpresentation(50minutes) • 40minuteshigh-qualitypresentationofthetechnicaldetails • Youcanfindotherresources/relatedworkstosupportyourpresentation • Youcanpresentyourowncommentstothepaper • 10minutesdiscussionledbythepresenter • Gradeisbasedonbothpresentationqualityanddiscussionthatfollows • Anonymousreviewswillbeprovidedbyotherstudents
Tipstosucceed • Planaheadoftime • Presentationsandlectures • Rehearseandgetwellprepared
Why? • Learninghowtodoresearchisgoodforyourcareer,nomatterwhatyourcareeris. • Reading(buildingknowledge) • Organizeyourknowledge,identifyyourinterests • Developinganidea • Putitintopractice • Presentation(bothwrittenandoralpresentations)–howtoexpressyourideas
Howtosucceed? • Howtosucceedingraduateschool:aguideforstudentsandadvisors.MariedesJardins.ACMStudentMagazine,1995. • Howtoreadapaper?S.Keshav.UniversityofWaterloo.2016. • Howtogiveatalk?MargoI.Seltzer.HarvardUniversity,1994. • Howtohaveabadcareerinresearch/academia.DavidPatterson.UCBerkerley.1997.
HowtoSucceedinGraduateSchool whichappliestoanycareerimo
HowtoSucceedinGraduateSchool • Graduateschool • Veryunstructuredenvironment • It’s even hard to know exactly what it is you are supposed to be learning • No deadlines for anything, unlike coursework.
HowtoSucceedinGraduateSchool • Daily Grind • Keeping a journal of your research activities and ideas • Write down speculations, interesting problems, possible solutions, random ideas, references, notes on papers, outline of papers to write • Read back periodically • Readpapersselectively • Makesureapaperisworthreadingbeforereadingit • Understandthemotivationbehindthepaper
HowtoSucceedinGraduateSchool • Staymotivated • Settingupdaily,weekly,andmonthlygoals(whichreallyworksforme) • Breakingdowneveryprojectintosmallerpieces • Divide-and-conquer
HowtoSucceedinGraduateSchool • Findinganidea(foryourprojectorthesis) • Futureworksectionofpapersyouareinterestedin • Startfromdevelopingandimplementinganextensiontoanexistingsystemortechnique • Thetopicshouldbeinterestingtoyou,youradvisor,andtheresearchcommunity • Stayawareofrelatedresearch • Pickanarrow,welldefinedtopic • Agoodtopicshouldbetryingtosolvearealproblem,notatoyproblem • Solidtheoreticalwork,goodempiricalresults,orpreferablyboth • Writeanoutlineofproblem,possiblesolutionsifyouhaveany
HowtoSucceedinGraduateSchool • Writingthesis(orprojectreport) • Divideandconquer • Haveanoutlineanddefinesomesmalltasks,e.g.,finishonesectioneveryday • Youcanwriteatacoarsegranularityandsuccessivelyrefineyourthesis • Don’tfeelobligatedtowriteitperfectlythefirsttime • Rememberthatyouraudienceisalmostguaranteedtobelessfamiliarwithyoursubjectthanyouare
HowtoSucceedinGraduateSchool • Otherusefultips • Gettingfeedbackfromotherpeers,researchers,professorsforyourresearch • Networkingatconferencesandbecomingpartoftheresearchcommunity • Publishingpapers(andsetupgoalsforthis) • …
HowtoReadaPaper? • Atypicalresearcherwilllikelyspendhundredsofhourseveryyearreadingpapers • Learningefficientlyreadapaperisataughtskill • “For many years I have used a simple ‘three-pass’ approach to prevent me from drowning in the details of a paper be- fore getting a bird’s-eye-view. It allows me to estimate the amount of time required to review a set of papers. Moreover, I can adjust the depth of paper evaluation depending on my needs and how much time I have. “
Thethree-passapproach • Eachpasshasadifferentgoal • Thefirstpass • Generalideaaboutthepaper • Thesecondpass • Graspthepaper’scontent,butnotitsdetails • Thethirdpass • Helpyouunderstandthepaperindepth
Thethree-passapproach • Thefirstpass • Carefullyreadtitle,abstract,andintroduction • Readheadings • Glancethetheoreticalfoundations • Readtheconclusions • Answerthesequestions • Whattypeofpaperisthis?Analysis,researchprototype,evaluation? • Context:whataretherelevantpapers?(markthoserelatedworkyoufeelinterested) • Correctness:Dotheassumptionsappeartobevalid? • Contributions? • Well-written? • Youcanchoosewhetheryouwantthesecondandthethirdpassalready • Mostreviewersonlyhaveonepassoverit
Thethree-passapproach • Thesecondpass • Lookcarefullyatthefigures,diagrams,andotherillustrations • Dotheymatchtheconclusionstheymadeinothersections? • Lookforrelevantunreadreferencesforfurtherreading(Idothisallthetimeandfinditusefulforliteraturereview) • Uptoanhourforanexperiencedreader • Afterthispass • Youshouldbeabletosummarizethemainthrustofthepaper(Mysuggestion:trytosummarizeyourselfwithoutthinkingaboutthethosewritteninthepaper.Thenyoucancomparewiththem.) • It’scommontounderstandthepaperafterthesecondpass
Thethree-passapproach • Thethirdpass • Fullyunderstandthepaper • Attempttovirtuallyre-implementthepaper • Trytore-createtheworkyourself • Mysuggestion:trytoproveyourself(ifapplicable),howyouwillemphasizethecontributionsifyouweretheauthor • Trytojotdownideasforfuturework • Maytakemanyhoursforbeginnersandmorethananhourortwoevenforanexperiencedreader.
Howtodoliteraturereview • Usegooglescholartosearchforwell-chosenkeywordsandfindhighlycitedpapers(youcanevenstartfromsurveypapers) • Findsharedcitationsandrepeatedauthornamesinthereferences • Ifindthisextremelyuseful.ThereareafewresearchersIalwaysfollowevenuptonow. • Gotothewebsitefortopconferencesandlookthroughrecentproceedings
MyTips • FrommyPhDadvisor:Whenyoureadapaper,lookforsomethingthathasnotbeendone • Findyourownwaytomanagingyourknowledge • Makesureyouunderstandwellenoughbeforeyouproposeanynewideas • Trytosummarizeotherpeople’scontributionsyourself,thenitwillbeeasyforyoutomake/judgeyourowncontributions • Makeanexpectation/scheduleforyourselfduringreading.Don’twasteyourtime!
Why? • Learninghowtodoresearchisgoodforyourcareer,nomatterwhatyourcareeris. • Reading(buildingknowledge)–PaperReviewsandProject • Organizeyourknowledge,identifyyourinterests–Project,lecture • Developinganidea--Project • Putitintopractice--Project • Presentation(bothwrittenandoralpresentations)–howtoexpressyourideas–Projectpresentationandlecture
MyTips • Whatyoudoandwhyyoudoitismoreimportantthanhowyoudoit • Agoodresearchtalkshouldmakepeoplewanttoreadyourreport/paperandtalktoyouafteryourtalk • Practicepracticepractice(writedowneverythingyouplantotalkaboutifneeded) • Haveotherpeoplegiveyoufeedback
MyTips • Begoodatmakingcomplexthingssimple • Youshoulddeliveryourideainahighlyorganizedwaysothatpeoplecaneasilyfollowyouridea/thoughts • Experiencedresearcherscanalmostknowwhatyouhavedoneafterthefirstpass! • Begoodatmakingsimplethingscomplex • Formalizeyourideas,assumptions,models,etc. • Insteadofsaying:theproposedworkisnovel,saysomethingelse!E.g.,ourworksadvancesthestate-of-the-artworksby0.5%accuracy.Furthermore,tothebestofourknowledge,itisthefirstknownworkthatutilizesXXXinXXX.