pyspark n.
Skip this Video
Loading SlideShow in 5 Seconds..
PySpark Dataframes Tutorial | Introduction to PySpark Dataframes API | PySpark Training | Edureka PowerPoint Presentation
Download Presentation
PySpark Dataframes Tutorial | Introduction to PySpark Dataframes API | PySpark Training | Edureka

Loading in 2 Seconds...

play fullscreen
1 / 15

PySpark Dataframes Tutorial | Introduction to PySpark Dataframes API | PySpark Training | Edureka - PowerPoint PPT Presentation


  • 40 Views
  • Uploaded on

** PySpark Certification Training: https://www.edureka.co/pyspark-certification-training **
This Edureka video will provide you with a comprehensive and detailed knowledge of Dataframes, and how to use Dataframes in PySpark. Below are the topics covered in the video:

1. Need for Dataframes
2. What are Dataframes
3. Dataframes Features
4. Sources of Dataframes
5. Hands On - Pyspark Dataframes

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
    Presentation Transcript
    pyspark

    PySpark

    Dataframe Tutorial

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    today s training topics today s training topics

    Today’s Training Topics

    Today’s Training Topics

    Need for Dataframes

    What are Dataframes

    Dataframes Features

    Sources of Dataframes

    Demo

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    why do we need why do we need dataframes

    Why do we need

    Why do we need Dataframes

    Dataframes? ?

    Processing Structured

    And Semi-Structured Data

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    why do we need why do we need dataframes 1

    Why do we need

    Why do we need Dataframes

    Dataframes? ?

    Handling Petabytes

    of Data

    Processing Structured

    And Semi-Structured Data

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    why do we need why do we need dataframes 2

    Why do we need

    Why do we need Dataframes

    Dataframes? ?

    Handling Petabytes

    of Data

    Processing Structured

    And Semi-Structured Data

    Wide Range of Data

    Formats and Sources

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    why do we need why do we need dataframes 3

    Why do we need

    Why do we need Dataframes

    Dataframes? ?

    Handling Petabytes

    of Data

    Support for Multiple

    Languages

    Processing Structured

    And Semi-Structured Data

    Wide Range of Data

    Formats and Sources

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    what are what are dataframes dataframes

    What are

    What are Dataframes

    Dataframes? ?

    2d labelled

    Data

    Structure

    Similar to

    SQL

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    features of features of dataframes

    Features of

    Features of Dataframes

    Dataframes

    Lazy

    EVALs

    Distributed

    Immutable

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    creating a dataframe sources creating a dataframe

    Creating a Dataframe(Sources)

    Creating a Dataframe(Sources)

    Dataframe

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    important classes important classes

    Important Classes

    Important Classes

    • pyspark.sql.SQLContext

    • pyspark.sql.DataFrame

    • pyspark.sql.Column

    • pyspark.sql.Row

    • pyspark.sql.GroupedData

    • pyspark.sql.DataFrameNaFunctions

    • pyspark.sql.DataFrameStatFunctions

    • pyspark.sql.functions

    • pyspark.sql.types

    • pyspark.sql.Window

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    creating dataframes demo

    CREATING DATAFRAMES DEMO

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    fifa world cup fifa world cup use case

    FIFA WORLD CUP

    FIFA WORLD CUP – – USE CASE

    USE CASE

    FIFA world Cup Use Case

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training

    superheros use case

    SUPERHEROS Use Case

    PYSPARK CERTIFICATION TRAINING

    www.edureka.co/pyspark-certification-training