1 / 27

Big Data Technologies and the Evolution of NoSQL

Big Data Technologies and the Evolution of NoSQL. Dwight Merriman dwight@10gen.com. Why #1 : the Imperitive to Scale (horizontally). http://en.wikipedia.org/wiki/Moore's_law. cloud, virtualization. commodity. power/cooling. data explosion.

dean
Download Presentation

Big Data Technologies and the Evolution of NoSQL

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Big Data Technologies and the Evolution of NoSQL Dwight Merriman dwight@10gen.com

  2. Why #1 : the Imperitive to Scale (horizontally)

  3. http://en.wikipedia.org/wiki/Moore's_law

  4. cloud, virtualization commodity power/cooling data explosion http://www.globalnerdy.com/2007/09/07/multicore-musings/

  5. Computers are faster,but scaling is harder

  6. UI compute data processing / ETL caching database / datastore network not just the database

  7. UI √ compute data processing / ETL caching √ database / datastore network √

  8. what’s hard?

  9. joins?

  10. ` { _id : ObjectId("4e2e3f92268cdda473b628f6"), title : “Too Big to Fail”, when : Date(“2011-07-26”), author : “joe”, text : “blah”, tags : [“business”, “news”, “north america”], votes : 3, voters : [“dmerr”, “sj”, “jane” ], comments : [ { by : “tim157”, text : “great story” }, { by : “gora”, text : “i don’t think so” }, { by : “dmerr”, text : “also check out...” } ] }

  11. transactions?

  12. NoSQL = Non-relational next generation operation data stores and databases no joins + light transactional semantics = horizontally scalable architectures

  13. Why #2 : dealing with “weird” data

  14. legal SFA CMS customer preferences, behavior, relationships organizational knowledge team (human) process information EMR

  15. no joins + light transactional semantics -> new data models

  16. { _id : ObjectId("4e2e3f92268cdda473b628f6"), title : “Too Big to Fail”, when : Date(“2011-07-26”), author : “joe”, text : “blah”, tags : [“business”, “news”, “north america”], votes : 3, voters : [“dmerr”, “sj”, “jane” ], comments : [ { by : “tim157”, text : “great story” }, { by : “gora”, text : “i don’t think so” }, { by : “dmerr”, text : “also check out...” } ] } db.posts.find( { author : “joe” } ).sort({when:1}) db.posts.find( {tags:”news”,votes:{$gt:100} ) db.posts.find( { “comments.by” : “gora” } ) db.posts.ensureIndex({“comments.by”:1})

  17. Why #3 : (software development) Agility

  18. { _id : ObjectId("4e2e3f92268cdda473b628f6"), title : “Too Big to Fail”, when : Date(“2011-07-26”), author : “joe”, text : “blah”, tags : [“business”, “news”, “north america”], votes : 3, voters : [“dmerr”, “sj”, “jane” ], comments : [ { by : “tim157”, text : “great story” }, { by : “gora”, text : “i don’t think so” }, { by : “dmerr”, text : “also check out...” } ] } db.posts.find( { author : “joe” } ).sort({when:1}) db.posts.find( { “comments.by” : “gora” } )

  19. Future Landscape

  20. the db space 2000 - 2010

  21. NoSQL = Non-relational next generation operation data stores and databases Benefits : - scale - leverage the vast swathes of semi-structured data - agility, nimbleness

More Related