'Hadoop streaming' presentation slideshows

Yahoo Audience Expansion: Migration from Hadoop Streaming to Spark

Yahoo Audience Expansion: Migration from Hadoop Streaming to Spark . Gavin Li, Jaebong Kim, Andy Feng Yahoo. Agenda. Audience Expansion Spark Application Spark scalability: problems and our solutions Performance tuning. How we built audience expansion on Spark . audience expansion.

606 views • 37 slides

Python In The Cloud

Python In The Cloud. PyHou MeetUp , Dec 17 th 2013 Chris McCafferty, SunGard Consulting Services. Overview. What is the Cloud? What is Big Data? Big Data Sources Python and Amazon Web Services Python and Hadoop Other Pythonic Cloud providers Wrap-up. What Is The Cloud.

418 views • 25 slides

MARISSA: MApReduce Implementation for Streaming Science Applications

344 views • 25 slides

Other Map-Reduce ( ish ) Frameworks

Other Map-Reduce ( ish ) Frameworks. William Cohen. Y:Y= Hadoop+X or Hadoop ~=Y. What else are people using? instead of Hadoop on top of Hadoop. Issues with Hadoop. Too much typing programs are not concise Too low level missing abstractions hard to specify a workflow

305 views • 16 slides

Hadoop Streaming

Hadoop Streaming. Hadoop Streaming. Hadoop streaming is a utility that comes with the Hadoop distribution The utility allows you to create and run map/reduce jobs with any executable or script as the mapper and/or the reducer C, Python, Java, Ruby, C#, perl , shell commands

610 views • 12 slides