Statistical Methods II

1 / 21

Statistical Methods II - PowerPoint PPT Presentation

Statistical Methods II. Notes on SQL. SQL Programming. Employers increasingly tell us that they look for 2 things on a resume: SAS and SQL. You have learned A LOT of SAS…but lets focus our attention on SQL. In these notes you will learn: What SQL is Why it is used

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

PowerPoint Slideshow about ' Statistical Methods II' - connor-howard

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Statistical Methods II

Notes on SQL

SQL Programming

Employers increasingly tell us that they look for 2 things on a resume: SAS and SQL.

You have learned A LOT of SAS…but lets focus our attention on SQL.

In these notes you will learn:

• What SQL is
• Why it is used
• The basics of SQL syntax

And, we will go through a few REALLY fun and exciting examples.

SQL Programming

What is SQL?

SQL stands for “Structured Query Language”. It was designed as a language to manage data in relational database management systems (DBMS).

The SQL language is sub-divided into several language elements, including:

• Queries, which retrieve the data based on specific criteria. This is the most important element of SQL.
• Clauses, which are constituent components of statements and queries.
• Expressions, which can produce either scalar values or tables consisting of columns and rows of data.
• Statements, which may have a persistent effect on schemas and data, or which may control transactions, program flow, connections, sessions, or diagnostics.
• SQL statements also include the semicolon statement terminator. Though not required on every platform, it is defined as a standard part of the SQL grammar.
SQL Programming
• Why is PROC SQL better than Data steps?
• The syntax is transferable to other SQL software packages
• You can join up to 250 SAS tables
• No need to sort any of the input tables
• Simplified syntax than in a normal SAS Data step
• When is Proc SQL not better than Data steps?
• Uses more memory than any regular data/procedure steps
• Could take longer than other procedures when working with very large contributing tables
• Logic flow becomes harder to implement
SQL Programming

Why do we use SQL?

SQL is used primarily to:

• Retrieve data from and manipulate tables/datasets
• Add or modify data values in a table/datasets
• Add, modify, or drop columns in a table/datasets
• Create tables and views
• Join/Merge multiple tables (whether or not they contain columns
• with the same name)
• Generate reports.
SQL Programming

Why do we use SQL?

You probably noticed that the previous list includes a lot of things that we do with DATA statements in SAS. In many cases, SQL is a better alternative to DATA statements in SAS – it is more efficient.

Clarification regarding SQL in SAS…

We use SQL like Data Statements in SAS…NOT like (most) Proc Statements. SQL is used to extract data, merge data and create variables…not to analyze data.

Lets take a look…

SQL Programming

Consider the Pennstate1 dataset. Lets say that you needed to:

• Only retain sex, earpierces, tattoos, height, height choice, looks and friends variables.
• Sort by sex.
• Delete observations with more than 4 earpierces.
• Create a new variable called HeightDifference which is the difference between their current height and their Height Choice.
• Create a new dataset called “Modeling” from the above requirements.
SQL Programming

My guess is that at this point, you would use a DATA step and your code would look something like this:

Data Modeling (keep = sex earprces tattoo height htchoice looks friends);

set jlp.pennstate2;

where earprces <4;

Heightdiff = Htchoice-Height;

run;

Proc sort data=modeling;

by Sex;

run;

This code would run and produce what you need.

SQL Programming

Here is what this same requirement would look like using Proc SQL:

proc sql;

create table work.modeling as

Select sex,earprces,tattoo,height,htchoice,looks,friends,

Htchoice-Height as HeightDiff

from jlp.pennstate2

where earprces<4

order by sex;

quit;

SQL Programming

Lets pull this apart:

• proc sql;

• create table work.modeling as

SQL Programming
• Select sex,earprces,tattoo,height,htchoice,looks,friends,

• Htchoice-Height as HeightDiff

• from jlp.pennstate2

.

SQL Programming
• where earprces<4

• order by sex;

• quit;

SQL Programming

Lets look at another example…lets focus on categorizing a variable. Consider the UCDAVIS1 dataset.

• Create a new dataset called UCTEST.
• Only retain GPA, SEAT, SEX and ALCOHOL.
• Create a new variable “GPACAT” which is a categorization of the GPA variable…where <2 is low, <3 is medium and <4 is high.

How would we do this without using SQL and using SQL…

SQL Programming

Using a Data step, your code probably looks like this:

Data UCTEST (keep = GPA GPACAT SEX ALCOHOL);

set jlp.ucdavis1;

Format GPACAT \$CHAR7.;

If GPA = . then GPACAT =" ";

else if GPA <=2 then GPACAT = "LOW";

else if GPA <=3 then GPACAT = "MEDIUM";

else GPACAT = "HIGH";

Run;

Proc print data=UCTEST;

Run;

 Why do we need this format statement?

SQL Programming

Using SQL, your code probably looks like this:

PROC SQL;

CREATE TABLE work.UCTEST AS

SELECT GPA,Sex,alcohol,

CASE

WHEN GPA = . THEN ' ‘

WHEN GPA<=2.0 THEN 'LOW‘

WHEN GPA<=3.0 THEN 'MEDIUM‘

ELSE 'HIGH‘

END AS GPACAT

FROM jlp.ucdavis1;

QUIT;

SQL Programming

Lets look at another example...lets focus on creating a new quantitative variable using a mathematical operator.

Consider the UCDAVIS1 dataset again.

• Create a new dataset called UCTEST1.
• Create a new variable that is called “Leisure” which is the amount of TV time plus the amount of Computer time.
• Create a new variable that is 2x the sleep variable.
• Only retain those sitting in the front and the back.
• Sort the data by seat.

How would we do this without using SQL and using SQL…

SQL Programming

Using a Data step, your code probably looks like this:

Data UCTEST1 (keep = TV Computer Sleepx2 Seat Leisure);

set jlp.ucdavis1;

Leisure = (TV + Computer);

Sleepx2 = Sleep*2;

If seat = "Middle" then delete;

Run;

Proc sort data = UCTEST1;

by seat;

Run;

SQL Programming

Using SQL, your code probably looks like this:

PROC SQL;

CREATE TABLE work.TEST AS

SELECT TV, Computer, Sleep, Seat,(TV + Computer) AS Leisure

FROM jlp.ucdavis1

WHERE SEAT IN ('Front', 'Back')

ORDER BY SEAT;

QUIT;

SQL Programming

*The general form of PROC SQL includes the following:

PROC SQL;

SELECT

CREATE TABLE...AS

FROM

WHERE 3.0>

ORDER BY ;

CASE

WHEN

END AS ;

QUIT;

SQL Programming – Summary Statistics:

The above table can found here

http://www.tau.ac.il/cc/pages/docs/sas8/proc/zsumfunc.htm