Years of psychometric and research advances in school psychology l.jpg
Advertisement
This presentation is the property of its rightful owner.
1 / 77

School Psychology PowerPoint PPT Presentation

School Psychology

Download Presentation

School Psychology

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Years of psychometric and research advances in school psychology l.jpg

NASP 2001

Years of Psychometric and Research Advances in School Psychology

Fifty

Richard W. Woodcock

April 19, 2001


Three strands l.jpg

Fifty years of …

Cognitive theory and assessment

Three Strands


Three strands3 l.jpg

Fifty years of …

Cognitive theory and assessment

Psychometrics and test development

Three Strands


Three strands4 l.jpg

Fifty years of …

Cognitive theory and assessment

Psychometrics and test development

Research techniques and tools

Three Strands


Slide5 l.jpg

Path of Progress

Better Better Better Better

Cognitive CognitiveInform- Instructional

Theory Tests tion Planning


Guiding principle l.jpg

The primary purpose for testing should be to find out more about the problem, not to get an IQ.

Guiding Principle


Slide7 l.jpg

Conceptualizations of Intelligence

Single

General

Ability


Slide10 l.jpg

Conceptualizations of Intelligence

Single

General

Ability

Pair

of

Abilities


Slide16 l.jpg

Conceptualizations of Intelligence

Single

General

Ability

Pair

of

Abilities

Incomplete Set of

Broad

Abilities


Slide21 l.jpg

Conceptualizations of Intelligence

Single

General

Ability

Pair

of

Abilities

Incomplete Set of

Broad

Abilities

“Complete”

Set of

Broad

Abilities


Slide22 l.jpg

Nine Broad CHC Factors

  • Stores of Acquired Knowledge

  • Comprehension-Knowledge (Gc)

  • Reading-Writing (Grw)

  • Mathematics (Gq)


Slide23 l.jpg

Nine Broad CHC Factors

  • Stores of Acquired Knowledge

  • Comprehension-Knowledge (Gc)

  • Reading-Writing (Grw)

  • Mathematics (Gq)

  • Thinking Abilities

  • Long-Term Retrieval (Glr)

  • Visual-Spatial Thinking (Gv)

  • Auditory Processing (Ga)

  • Fluid Reasoning (Gf)


Slide24 l.jpg

Nine Broad CHC Factors

  • Stores of Acquired Knowledge

  • Comprehension-Knowledge (Gc)

  • Reading-Writing (Grw)

  • Mathematics (Gq)

  • Thinking Abilities

  • Long-Term Retrieval (Glr)

  • Visual-Spatial Thinking (Gv)

  • Auditory Processing (Ga)

  • Fluid Reasoning (Gf)

  • Cognitive Efficiency

  • Processing Speed (Gs)

  • Short-Term Memory (Gsm)


Slide31 l.jpg

Conceptualizations of Intelligence

Single

General

Ability

Pair

of

Abilities

Incomplete Set of

Broad

Abilities

“Complete”

Set of

Broad

Abilities

Narrow

Abilities

Underlying

Broad

Abilities


Slide32 l.jpg

Examples of Narrow Abilities

Comprehension-Knowledge (Gc)

Language development (LD)

General information (K0)

Listening ability (LS)


Slide33 l.jpg

Examples of Narrow Abilities

Comprehension-Knowledge (Gc)

Language development (LD)

General information (K0)

Listening ability (LS)

Long-Term Retrieval (Glr)

Associative memory (MA)

Meaningful memory (MM)

Naming facility (NA)


Slide34 l.jpg

Examples of Narrow Abilities

Comprehension-Knowledge (Gc)

Language development (LD)

General information (K0)

Listening ability (LS)

Long-Term Retrieval (Glr)

Associative memory (MA)

Meaningful memory (MM)

Naming facility (NA)

Short-Term Memory (Gsm)

Working memory (WM)

Memory span (MS)


Slide36 l.jpg

6

5

CONCEPTUALIZATION LEVEL

4

3

2

1

0

1910

1920

1930

1940

1950

1960

1970

1980

1990

2000

2010

YEAR OF PUBLICATION

Trend of Conceptualizations


Slide37 l.jpg

The Good News …

Tests of the future will be more informative.


Slide38 l.jpg

… and the Bad News

Tests of the future will be more informative.

Tests of the future will be more complex as test developers close the gap between cognitive theory and practice.


Slide39 l.jpg

CHC Cognitive Performance Model

Stores of

Acquired Knowledge

(Gc. Gq, Grw)

Thinking Abilities

(Glr, Gv, Ga, Gf)

Cognitive/Academic

PERFORMANCE

Cognitive Efficiency

(Gs.Gsm)


Slide40 l.jpg

CHC Cognitive Performance Model

Stores of

Acquired Knowledge

(Gc. Gq, Grw)

Thinking Abilities

(Glr, Gv, Ga, Gf)

Cognitive/Academic

PERFORMANCE

Cognitive Efficiency

(Gs.Gsm)

Facilitator-Inhibitors

(Internal, External)


Slide41 l.jpg

Two Concomitant Developments

Joint factor analysis studies

Cross-battery assessment


Slide42 l.jpg

Institute for Applied Psychometrics

www.IAPsych.com

Join the Cattell-Horn-Carroll (CHC) Discussion Listserv at….

  • At IAP home page click on

  • “Join one of IAP listservs”

  • On listserv page, enter your email address

  • in the box provided and then click the

  • ‘Join List' button

  • Follow instructions as provided

  • Enjoy


Slide43 l.jpg

Psychometrics & Test Development

  • 1. The Test Standards

  • 2. Rasch model analysis

  • 3. Co-norming of cognitive and achievement tests


Slide44 l.jpg

Psychometrics & Test Development

  • 1. The Test Standards


Slide45 l.jpg

Test Standards

1954: Technical Recommendations for Psychological Tests and Diagnostic Techniques


Slide46 l.jpg

Test Standards

1954: Technical Recommendations for Psychological Tests and Diagnostic Techniques

1966, 1974, 1985, 1999: Standards for Educational and Psychological Testing


Slide47 l.jpg

Psychometrics & Test Development

  • 1. The Test Standards

  • 2. Rasch model analysis


Benefits from rasch modeling l.jpg

Sample-free calibration

Benefits from Rasch Modeling


Benefits from rasch modeling49 l.jpg

Sample-free calibration

Item-free measurement

Benefits from Rasch Modeling


Benefits from rasch modeling50 l.jpg

Sample-free calibration

Item-free measurement

Simplified equating of tests

Benefits from Rasch Modeling


Benefits from rasch modeling51 l.jpg

Sample-free calibration

Item-free measurement

Simplified equating of tests

Item difficulty and person ability are on same scale

Benefits from Rasch Modeling


Benefits from rasch modeling52 l.jpg

Sample-free calibration

Item-free measurement

Simplified equating of tests

Item difficulty and person ability are on same scale

Extends variety of interpretation options for test

Benefits from Rasch Modeling


Slide53 l.jpg

Psychometrics & Test Development

  • 1. The Test Standards

  • 2. Rasch model analysis

  • 3. Co-norming of cognitive and achievement tests


Slide54 l.jpg

  • Research Techniques and Tools

    • Computing equipment


Slide55 l.jpg

Research Techniques and Tools

1. Computing equipment

2. Statistical methods


Slide56 l.jpg

Computing Equipment

The thrill of being on the edge of technology 50 years ago!


Slide57 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve


Slide58 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators


Slide59 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators


Slide60 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators

  • Mainframe computers

    • 24K memory, punch cards


Slide61 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators

  • Mainframe computers

    • 24K memory, punch cards

  • Seven-step desktop computer


Slide62 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators

  • Mainframe computers

    • 24K memory, punch cards

  • Seven-step desktop computer

  • Programmable hand calculators


Slide63 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators

  • Mainframe computers

    • 24K memory, punch cards

  • Seven-step desktop computer

  • Programmable hand calculators

  • Desk and notebook computers


Slide64 l.jpg

Computing Equipment

  • Slide rule

  • Large graph paper

  • Flexible curve

  • Mechanical calculators

  • Electric calculators

  • Mainframe computers

    • 24K memory, punch cards

  • Seven-step desktop computer

  • Programmable hand calculators

  • Desk and notebook computers


Slide65 l.jpg

Research Techniques and Tools

1. Computing equipment

2. Statistical methods


Slide66 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance


Slide67 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis


Slide68 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis

  • Imputation of missing data

  • Bootstrapping (re-sampling)


Slide69 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis

  • Imputation of missing data

  • Bootstrapping (re-sampling)

  • Structural equation modeling

  • Confirmatory factor analysis


Slide70 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis

  • Imputation of missing data

  • Bootstrapping (re-sampling)

  • Structural equation modeling

  • Confirmatory factor analysis

  • Complex curve fitting programs


Slide71 l.jpg

Modern Curve Fitting


Slide72 l.jpg

Modern Curve Fitting

C21m W1A

X= Age (Months)

Y= RefW

Eqn# 6703 y=a+bx^(0.5)+cx+dx^(1.5)+ex^2+fx^(2.5)+gx^3+hx^(3.5)

r2=0.9949427700336424

r2adj=0.9948577745720229

StdErr=1.030369477534328

Fstat=13406.20131865417

a= 168.0310226803962

b= 120.7086341000681

c= -19.73055027984703

d= 1.828054845931321

e= -0.100400733326419

f= 0.003206717255504859

g= -5.479479098921161E-05

h= 3.861139075124612E-07


Slide73 l.jpg

Modern Curve Fitting


Slide74 l.jpg

Modern Curve Fitting

X= Age (Months) Y= RefW

Eqn# 6870 Chebyshev=>Std Polynomial Order 20

r2=0.9999241264424508

r2adj=0.9999109583043638

StdErr=0.4094307628464526

Fstat=80390.8155662631

  y=256.4311688688844+x*(13.10496360877917+

x*(-0.5427430174673811+x*(0.01376937474584163+

x*(-0.0002168265655293270+x*(2.276713085026848E-06+

x*(-1.682507845015114E-08+x*(9.094579707795152E-11+

x*(-3.696623253703684E-13+x*(1.152407982080169E-15+

x*(-2.793128999308678E-18+x*(5.308052230358075E-21+

x*(-7.939678320586450E-24+x*(9.340340309762284E-27+

x*(-8.591743335417776E-30+x*(6.105292803850054E-33+

x*(-3.282606641401848E-36+x*(1.290343815843724E-39+

x*(-3.496414979019896E-43+x*(5.834823682547657E-47+

x*-4.518103329325873E-51))))))))))))))))))); return(y);


Slide75 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis

  • Imputation of missing data

  • Bootstrapping (re-sampling)

  • Structural equation modeling

  • Confirmatory factor analysis

  • Complex curve fitting programs

  • Data mining


Slide76 l.jpg

Statistical Methods

  • Exploratory factor analysis

  • Analysis of variance

  • Multiple regression analysis

  • Imputation of missing data

  • Bootstrapping (re-sampling)

  • Structural equation modeling

  • Confirmatory factor analysis

  • Complex curve fitting programs

  • Data mining


Slide77 l.jpg

What’s next?


  • Login