1 / 9

An Introduction to Apache HBase

What is Apache HBase in terms of big data and Hadoop ? How does it relate to the other Hadoop tools ?

semtechs
Download Presentation

An Introduction to Apache HBase

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Apache Hadoop HBase • What is it ? • Why use it ? • Architecture • Storage • Related Projects

  2. Hbase – What is it ? • A Hadoop Data Store • A noSQL store for big data • It is Open Source, written in Java • It is a distributed database • Automatic sharding, table data spread over cluster • Automatic region server fail over

  3. Hbase – Why / When use it ? • Data in billions of rows • Complex data • High volume of I/O • High level of data nodes, 5 + • No need for extra RDBMS functions i.e. transactions

  4. HBase – Architecture Where does Hbase sit in relation to Hadoop ?

  5. HBase – Architecture • HBase is a data store • Uses Hadoop for distributed storage • Data stored across region servers • Region server data spread across HDFS data nodes • A write ahead log (WAL) is used to record changes

  6. HBase – Storage • What is the architecture ?

  7. HBase – Storage • Client makes call i.e. put • Request RPC'ed as key value to Region server • Key Value routed to region for row • Data is written to WAL • Data written to region memStore • If region server cashes WAL can be used to recover data

  8. HBase – Related Projects • Apache Flume – move large data sets to Hadoop • Apache Sqoop – cmd line, move rdbms data to Hadoop • Apache Hbase – Non relational database • Apache Pig – analyse large data sets • Apache Oozie – work flow scheduler • Apache Mahout – machine learning and data mining • Apache Hue – Hadoop user interface • Apache Zoo Keeper – configuration / build

  9. Contact Us • Feel free to contact us at • www.semtech-solutions.co.nz • info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems

More Related