Loading in 2 Seconds...
Loading in 2 Seconds...
Social Welfare 580 Advanced Research Methods & Design. Measurement Instrument Design Psychometrics. Dr. Caprice Hollins, the director of equity and race relations for Seattle Public Schools.
Measurement Instrument Design Psychometrics
“We know that cultural competence is an important aspect of being an effective teacher, but how do you measure that?”
“Thus, no research has shown that teacher’s cultural competence is associated with better student learning.”
a fundamentalist “map” of permissible analyses
unique measurement variance
common measurement variance
Does the measure give consistent results?
Is the measure assessing what it claims?
Karl G. HillPrincipal Investigator
J. David HawkinsInvestigator
Richard F. CatalanoInvestigator
Jennifer BaileyResearch Analyst
Sabrina OesterleResearch Analyst
Maria Roper-CaldbeckData Collection Supervisor
Karen SegarData Manager
Amber TabaresGraduate Research Assistant
Erica BourgetProgram Coordinator
95% retention in Waves 2 and 3
Research the literature to determine how your constructs have been measured before.
Try to use established measures when possible.
reliability & validity info
Obtain copies for pretesting
Alter the assessments only if absolutely necessary.
Identify and define the constructs you want to measure
The database links measures of pregnancy outcomes to descriptions of maternity care services (from Medicaid payment records for Medicaid clients in Washington State) and background information on the mother's health and socio-demographic status (from birth and death certificates for all Washington residents).
These guidelines should be kept in mind in selecting pre-existing measures:
broad qualitative studies
theory /research /existing measures
item and scale construction
pretesting &reliability &validity analyses
Bonding to prosocial others
Family & Classroom Management
Skills for interaction
Position in the social structure: race, SES, age, gender
Individual constitutional factors
Bonding to antisocial others
Belief in antisocial values
( +, -
( - )
( + )
Social Development Model
Construct alpha 1 2 3
1 Work Opportunities .77 -
2 Work Involvement .66 .45 -
3 Work Rewards .80 .57 .47 -
Child’s Game (5 minutes): Parent is asked to play with child, following the child’s lead.
Caregiver’s Game(5 minutes): Parent is asked to have the child follow what they want to play with.
Prosocial Guidelines 0.84 -0.47**
Prosocial Opportunities 0.82 -0.29+
Dyad Involvement In The Activity 0.78 -0.30*
Child Prosocial Involvement 0.86 -0.24
Dyad Positive Involvement 0.92 -0.37*
Consequences For Prosoc. Invol. 0.82 -0.27+
Bonding 0.82 -0.22
Followed Directions 0.64 -0.35*
Parent Problem-solving Skills 0.83 -0.35*
Child Problem-solving Skills 0.74 -0.32*
Dyad Problem-solving Skills 0.85 -0.44**
Low Skilled Parenting 0.74 0.51***
Corr. with Parent
Macro-Code Scale alpha Binge Drinking