2009
170 likes | 416 Views
????. ????????????. ????. ????????????????????????????????????NFS, AFS, LustreGFS?????OpenMP, MPI(??????)MapReduceDryad(??????). ????(?). MapReduce?????????PageRank?????Canopy Clustering????????BigTableChubby. ????. ??0Hadoop?????,????????1MapReduce????:?????????????:????????
2009
E N D
Presentation Transcript
1. ???????????????? ????????????
2009??
2. ???? ????
??
??
????
3. ???? ????????
??????????
?????
??????
???????
NFS, AFS, Lustre
GFS
?????
OpenMP, MPI(??????)
MapReduce
Dryad(??????)
4. ????(?) MapReduce????
?????PageRank
?????Canopy Clustering??
??????
BigTable
Chubby
5. ???? ??0
Hadoop?????,??????
??1
MapReduce????:??????????
???:??????
??2
MapReduce??:PageRank??
???:Wikipedia??(??????)
??3
MapReduce??:????
???:Netflix??
????????????
6. ???? http://code.google.com/edu/
Google????????,??parallel????????????????
http://hadoop.apache.org/
Hadoop?????
http://developer.yahoo.com/hadoop/tutorial/
Yahoo?hadoop????,????????????????
Hadoop ????(???????hadoop???,??????????????)
http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29
http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Multi-Node_Cluster%29
http://net.pku.edu.cn/~course/cs402/2008/resource.html
7. ??????? ???????????
??????2007course???
????
8. ???? ????:20?,???????,4G??,?????,250G????
??,????
??:15?
??,????????,??,Java
??:5?
???:??,??????????,???????,MapReduce????,??????,??hadoop???????MapReduce??
???:??,??PageRank????Canopy Clustering??,???????1,2,3,????????????
???~???:?????,??,??????????,??????????
9. ????????? ??:2~3??????
??????,????
NBody???,???????
??????????
10. Course Example: 2007
11. Staff Kang Chen Instructor
ck99@mails.tsinghua.edu.cn
Dahai Li Project Lead
dahaili@google.com
Kai Wang Project Lead
kaiwang@google.com
Yubing Yin Teaching Assistant
burningice9@gmail.com
12. Thanks to: Kuang Chen
Christophe Bisciglia
Albert Wong
Hannah Tang
13. Goals and Expectations 5 Lectures
Readings
Homework + discussion
4 Labs
Final projects
Final project proposal
Project reports
Project review @ Google
14. Course Information
15. Timetable
16. Lecture and Labs
17. ??