slide1
Download
Skip this Video
Download Presentation
HBase Tracing

Loading in 2 Seconds...

play fullscreen
1 / 15

HBase Tracing - PowerPoint PPT Presentation


  • 286 Views
  • Uploaded on

HBase Tracing. Elliott Clark. Who Am I. Elliott Clark [email protected] HBase PMC HBase Committer HTrace Mantainer Cloudera Engineer CDH Distribution. What’s Going on During Failovers. Motivation. Want to improve MTTR First need to know what’s going on Google’s Dapper. Options.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'HBase Tracing' - alice


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1
HBase Tracing

Elliott Clark

who am i
Who Am I
  • Elliott Clark
  • HBase PMC
  • HBase Committer
  • HTrace Mantainer
  • Cloudera Engineer
    • CDH Distribution
motivation
Motivation
  • Want to improve MTTR
  • First need to know what’s going on
  • Google’s Dapper
options
Options
  • Log all the things
    • We already do that.
    • Our logs are way too verbose as it is.
    • Hard to combine multiple logs
      • HRegionServer
      • HMaster
      • Client
  • Guess
  • Zipkin
  • Not Invented Here
slide6
Spoiler:
  • Guessing Didn’t Win
about zipkin
About Zipkin
  • Created by Twitter
    • Thanks
  • Modeled after Dapper
  • Scala
  • Finagle
    • Functional
    • Netty
    • Non-blocking
  • Thrift
  • Cool UI
  • Pluggable Storage Backend
dapper s terminology
Dapper’s Terminology
  • Span
    • Segment of a remote call
    • Contains Annotations
    • Has a parent trace
    • Can have multiple children spans
    • Can have multiple annotations
  • Annotations
  • Trace
    • Grouping of spans
slide10
Implementation

Hooking up Zipkin, HTrace, and HBase

zipkin hbase storage
Zipkin HBase Storage
  • Replaces need for Cassandra
  • Functional
  • Created a non-blocking client shim
  • Fixed Key Length
    • ID’s are long
    • Mapping table
      • ID -> Name
      • Name -> ID
      • Inspiration from OpenTSDB
  • Open source on Github
htrace
HTrace
  • Way to instrument Java Code
  • Used In HBase trunk
  • Coming to an install near you in 0.96.0
  • Pluggable where it emits Spans
    • To a file
    • To sys.out
htrace and zipkin
HTrace and Zipkin
  • Modularize HTrace
  • Create htrace-zipkin
  • Create ZipkinSpanReceiver
    • Receives spans from HTrace instrumented code
    • Converts to Thrift objects
    • Sends to Zipkin
      • Background Flush
      • Batching
slide14
Demo

Let’s hope this works.

ad