Pilot candidate selection method pcsm program status 16 may 2006
This presentation is the property of its rightful owner.
Sponsored Links
1 / 44

Pilot Candidate Selection Method (PCSM) Program Status 16 May 2006 PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Pilot Candidate Selection Method (PCSM) Program Status 16 May 2006. Dr. Thomas R. Carretta Air Force Research Laboratory Wright-Patterson AFB, OH [email protected] Pilot Candidate Selection Method. Psychomotor Cognitive Attitudes. PCSM is a regression- weighted pilot

Download Presentation

Pilot Candidate Selection Method (PCSM) Program Status 16 May 2006

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Pilot candidate selection method pcsm program status 16 may 2006

Pilot Candidate Selection Method (PCSM)Program Status16 May 2006

Dr. Thomas R. Carretta

Air Force Research Laboratory

Wright-Patterson AFB, OH

[email protected]

Pilot candidate selection method

Pilot Candidate Selection Method

  • Psychomotor

  • Cognitive

  • Attitudes

  • PCSM is a regression-

  • weighted pilot

  • aptitude composite

  • Operationally

  • implemented by

  • USAF in 1993

Air Force Officer

Qualifying Test



  • Cognitive ability

  • Aviation-related

  • knowledge

Basic Attributes Test

Previous Flying Experience

T 37 outcome by pcsm quartile

T-37 Outcome by PCSM Quartile

64.1% Grad

89.3% Grad

N = 1,268

Grad %: 58.5% 69.7% 81.8% 92.1%

Pcsm changes

PCSM Changes

  • All three PSCM components are undergoing change

  • Air Force Officer Qualifying Test

    • July 2005: Form S implemented; dropped 5 of 16 subtests and created new composites

  • Basic Attributes Test

    • July 2006: Scheduled to be phased out and replaced with the Test of Basic Aviation Skills (TBAS)

  • Flying Experience

    • Flight screening program has undergone several changes since 1993

Afoqt forms o p 1 p 2 q 1 q 2

AFOQT (Forms O, P1/P2, &Q1/Q2)

  • Paper-and-pencil test

  • Approximately 380 items in 16 subtests are combined into 5 composites:

    • Verbal

    • Quantitative

    • Academic Aptitude (Verbal + Quantitative)

    • Pilot

    • Navigator/Technical

  • 1978 norms based on active duty population

  • New form implemented approximately every 8 years

Afoqt forms o p 1 p 2 q 1 q 21

AFOQT (Forms O, P1/P2, & Q1/Q2)

Afoqt what is measured

AFOQT: What is Measured?

Afoqt what is measured1

AFOQT: What is Measured?

  • Confirmatory factor analysis:

    • Like other cognitive tests, AFOQT has a hierarchical structure

    • Higher-order factor is g

    • 5 lower-order factors:

      • Verbal

      • Math

      • Spatial

      • Aviation Knowledge

      • Perceptual Speed

67% of the common

(explained) variance

is due to g

Afoqt what is predictive

AFOQT: What is Predictive?

  • Olea & Ree (1994) examined the predictiveness of g, specific ability, and specific knowledge from the AFOQT for pilot trainees (N = 1,867 to 3,942)

    • Predictors were unrotated principle components from AFOQT

    • Training criteria included academic grades, check flight grades, an overall performance composite, and a passing/failing score

    • g was the best predictor for all pilot training criteria. The average validity of g was .31

    • Specific knowledge (IC & AI tests) showed incremental validity beyond g of .098

    • Specific ability (verbal, math, spatial, perceptual speed) showed little increment to g,about .02

Afoqt form s


  • Goals:

    • Reduce test administration time

    • Maintain composite score reliability and validity

    • Retain previous factor structure (verbal, quantitative, spatial, aviation knowledge, perceptual speed)

    • No adverse impact due to changes in battery

  • Results:

    • Dropped 5 subtests reducing administration time from 4.5 to 3 hours (RC, DI, MC, EM, SR)

    • Retained reliability and validity of composites as well as factor structure

    • Added Self-Description Inventory (SDI+) to assess personality factors (resultant test is 3.5 hours)

Afoqt form s reliability validity effects

AFOQT Form SReliability & Validity Effects

  • Intercorrelations between old and new Composites

    Form QForm R /S

    Verbal.97 .96

    Quant.97 .98

    Acad Apt.98 .98

    Pilot.97 .92

    Nav-Tech.98 .94

  • Little reliability or correlation loss caused by removing RC, DI, MC, EM, and SR

  • Validity of new Pilot composite versus T-37 performance was comparable to old Pilot composite

Afoqt form s1






Verbal AnalogiesVAXXX

Arithmetic ReasoningARXXXX

Word KnowledgeWKXX

Math KnowledgeMKXXXX

Instrument ComprehensionICX

Block CountingBCX

Table ReadingTRXX

Aviation InformationAIX

General ScienceGSX

Rotated BlocksRB

Hidden FiguresHF

Self-Description InventorySDI+

Afoqt form s self description inventory sdi

AFOQT Form SSelf-Description Inventory (SDI+)

  • Personality inventory based on Goldberg (1990) adjective clusters

    • 220 items consisting of trait descriptions (behavioral statements)

    • Captured Big Five personality dimensions and 2 additional factors – Service Orientation (SO) & Team Orientation (TO)

      • SO – organizational commitment

      • TO – preferences for working as member of a group or working alone

    • Subsequent factor analysis confirmed Big Five factors and Service Orientation factor

      • Team-Orientation factor not separate from other factors

  • Proposed to be used for career counseling

Basic attributes test bat

Basic Attributes Test (BAT)

  • Basic Attributes Test (BAT) measures:

    • Psychomotor

    • Cognitive

    • Personality/Attitudes

  • In operational use since 1993

    • 386-based computer

    • Test hardware can no longer be maintained

    • To be replaced by the Test of Basic Aviation Skills (TBAS)

Test of basic aviation skills tbas

Test of Basic Aviation Skills (TBAS)

  • Test of Basic Aviation Skills (TBAS) measures:

    • Psychomotor

    • Cognitive (spatial)

    • Multi-task performance

    • Memory

  • Unlike BAT, several TBAS subtests are related to one another

  • Scheduled for operational implementation in July 2006

Tbas status

TBAS Status

  • Preliminary TBAS-based PCSM scoring algorithm completed

    • A regression-weighted composite was developed using AFOQT, flying experience, & TBAS scores

    • TBAS scoring algorithm designed to counter test-taking strategies (e.g., concentrate on part of multiple-task test)

    • Predictive validity is comparable to BAT-based PCSM equation

  • Ongoing tasks

    • Development of test materials (e.g., operator’s manual, examinee information pamphlet)

    • Compliance with professional test standards (e.g., APA)

    • Deployment of test equipment

    • Development of long-term sustainment plan

Flying experience

Flying Experience

  • PCSM Flying Hour Code is an unequal interval scale based on examination of relation of previous flying hours with UPT performance

  • Code categories:

    • 0: 0 flying hours

    • 1: 1 to 5 flying hours

    • 2: 6 to 10 flying hours

    • 3: 11 to 20 flying hours

    • 4: 21 to 40 flying hours

    • 5: 41 to 60 flying hours

    • 6: 61 to 80 flying hours

    • 7: 81 to 100 flying hours

    • 8: 101 to 200 flying hours

    • 9: 201 and Up flying hours

Flying experience1

Flying Experience

  • Prior to 1994: Flight Screening Program

    • 15 to 20 hours in T-41

    • Conducted by USAF at USAFA and Hondo, TX

  • 1994-1997: Enhanced Flight Screening Program

    • 21 hours in T-3 (Slingsby Firefly) & included more aerobatic training

    • Conducted by USAF at USAFA and Hondo, TX

    • Discontinued following several uncommanded engine stoppages

  • 1997-1998: No flight screening program

  • 1998: Introductory Flight Training Program

    • Syllabus expanded to 40, then 50 hours

    • Taught at Civilian training schools

  • Present: Introductory Flight Screening Program

    • 25 hours conducted by contractor instructors

Future directions

Future Directions

  • TBAS-based PCSM post-implementation S&T issues

    • Subgroup differences

    • Test-retest performance

    • Extension of PCSM to other career fields (e.g., UAV operators)

  • Examine utility of AFOQT SDI+ for career counseling

  • Collaboration with the US Navy

    • TBAS and iTBAS (internet TBAS) comparability

    • Examine relations between USAF and USN officer commissioning & aircrew selection tests

      • Development of common test battery

    • Computer-administered AFOQT



Afoqt 1 verbal analogies

AFOQT1. Verbal Analogies

  • DIRECTIONS: This part of the test measures your ability to reason and

  • see relationships between words. You are to decide the answer that best

  • completes the analogy developed at the beginning of each question.

  • FINGER is to HAND as TOOTH is to _____.

  • a. tongue b. lips c. nose d. mouth e. molar

  • 2. RAQUET is to COURT as __________.

  • a. tractor is to field b. blossom is to bloom c. stalk is to prey

  • d. plan is to strategy e. moon is to planet

  • 3. FLY is to AIRPLANE as __________.

  • a. drive is to stake b. skate is to slide c. push is to fall

  • d. swim is to float e. rod is to hook

Afoqt 2 arithmetic reasoning

AFOQT 2. Arithmetic Reasoning

  • DIRECTIONS: This part of the test measures mathematical reasoning. It

  • is concerned with your ability to arrive at solutions to problems. Each

  • problem is followed by 5 possible answers. Decide which of the 5 answers

  • is most nearly correct.

  • If an aircraft travels at 564 miles per hour, how many miles did the

  • aircraft fly in 900 seconds?

  • a. 141 b. 226 c. 300 d. 451 e. 846

  • 2. A typist took 3 typing tests. The average typing speed on these tests

  • was 48 words per minute (WPM). If the typists speed on 2 of these tests

  • was 52 WPM, what was the speed on the third test in WPM?

  • a. 38 b. 40 c. 42 d. 44 e. 46

Afoqt 3 word knowledge

AFOQT3. Word Knowledge

  • DIRECTIONS: This part of the test measures verbal comprehension

  • involving your ability to understand written language. For each question,

  • choose the answer that means the same as the capitalized word.


  • a. crisp b. neatly dressed c. reddish d. colorful e. lively

  • 2. CEASE

  • a. start b. change c. continue d. stop e. fold


  • a. 2 days b. 1 week c. 2 weeks d. 1 month e. 2 months


  • a. pointed b. trivial c. oral d. lengthy e. raggedy

Afoqt 4 math knowledge

AFOQT4. Math Knowledge

  • DIRECTIONS: This part of the test measures your ability to use learned

  • mathematical relationships. Each problem is followed by 5 possible

  • answers. Decide which one of them is most nearly correct.

  • The first digit of the square root of 59463 is:

  • a. 1 b. 2 c. 3 d. 4 e. 5

  • The distance in miles around a circular course with a radius of 35

  • miles is (use  = 22/ 7):

  • a. 110 b. 156 c. 220 d. 440 e. 880

  • 3. Solve for x: 2x/ 7 = 2x2

  • a. 1/ 7 b. 2/ 7 c. 2 d. 7 e. 14

Afoqt 5 instrument comprehension

AFOQT 5. Instrument Comprehension

DIRECTIONS: This test measures your ability to determine the position of

an airplane in flight from reading instruments showing its compass

heading, amount of climb or dive, and degree of bank to right or left.

Afoqt 6 block counting

AFOQT6. Block Counting

DIRECTIONS: This is a test of your ability to “see into” a 3-dimensional

pile of blocks and determine how many pieces are touched by certain

numbered blocks. All of the blocks in a pile are the same size and shape.

Afoqt 7 table reading

AFOQT7. Table Reading

DIRECTIONS: This test measures your ability to read tables quickly and

accurately. In the table below, the X values are indicated at the top and the

Y values at the left. In this test, you are to find the table entry that

corresponds to a given set of row (X) and column (Y) values.

  • For X = 0 and Y = -1:

  • a. 29 b. 32 c. 33 d. 34 e. 35

  • For X = -3 and Y = -3:

  • a. 22 b. 23 c. 28 d. 29 e. 31

  • For X = -1 and Y = +2:

  • a. 25 b. 27 c. 29 d. 30 e. 31

  • For X = +3 and Y = 0:

  • a. 30 b. 34 c. 35 d. 37 e. 39

Afoqt 8 aviation information

AFOQT8. Aviation Information

  • DIRECTIONS: This part of the test measures your aviation knowledge.

  • Decide which of the choices best answers the question or completes the

  • statement.

  • If the elevator tabs on a plane are lowered, the plane will tend to:

  • a. nose up b. nose down c. pitch fore and aft d. go into a slow roll

  • e. wing over

  • 2. The pilot always advances the throttle during a:

  • a. nose dive b. landing c. turn d. spin e. climb

  • 3. The slipstream of an airplane will have the least effect on the plane’s direction

  • of flight when the plane’s:

  • a. stick is moved forward b. stick is moved backward c. stick is moved

  • sideways d. rudder bar is pressed with the left foot e. rudder bar is pressed

  • with the right foot

Afoqt 9 general science

AFOQT9. General Science

  • DIRECTIONS: This part of the test measures your knowledge in the area of

  • science. Decide which one of the choices best answers the question or

  • completes the statement.

  • An eclipse of the sun throws the shadow:

  • a. moon on the earth b. earth on the sun c. sun on the earth

  • d. earth on the moon e. moon on the sun

  • 2. Lack of iodine is often related to which of the following diseases?

  • a. Beriberi b. Scurvy c. Rickets d. Goiter e. Asthma

  • 3. After adding salt to water, the freezing point of the water is:

  • a. variable b. inverted c. unchanged d. raised e. lowered

Afoqt 10 rotated blocks

AFOQT10. Rotated Blocks

DIRECTIONS: This test measures your ability to visualize and manipulate

objects in space. In each item, you will be shown a picture of a block.

The problem is to find a second block that is identical to the first.

Afoqt 11 hidden figures

AFOQT11. Hidden Figures

DIRECTIONS: This part of the test measures your ability to locate a simple

geometric figure embedded in a complex drawing. Your task is to

determine which lettered figure (A, B, C, D, or E) is contained in each

numbered drawing.

Afoqt 12 self description inventory

AFOQT12. Self Description Inventory

DIRECTIONS: This inventory measures personal traits and attitudes. The inventory consists of a list of statements. The task is to read each statement carefully and decide how well each one describes you.

Look at the sample statement below.

S1. I enjoy reading poetry.

Decide if statement S1 is characteristic of you and indicate your agreement using the scale below.

A – Strongly Disagree

B – Moderately Disagree

C – Neither Agree nor Disagree

D – Moderately Agree

E – Strongly Agree

Bat 1 two hand coordination

BAT1. Two-Hand Coordination

  • Rotary pursuit tracking task

  • Target moves in a fixed, elliptical pattern at varying speeds

  • Task is to keep gunsight on target using control sticks

  • Test length ~10 minutes.

Bat 2 complex coordination

BAT2. Complex Coordination

  • Compensatory tracking task

  • Dual-axis control stick is used to keep the small cross centered on the large cross

  • Single-axis control stick is used to keep the rudder bar centered at the bottom of the screen

  • Test length ~10 minutes.

Bat 4 time sharing

BAT4. Time Sharing

  • Assesses control precision and reaction time

  • Combines a compensatory tracking task with a target identification (digit canceling) task

  • Test length ~30 minutes

Bat 3 item recognition

BAT3. Item Recognition

  • Assesses short-term memory

  • A string of 1 to 6 digits is presented quickly, removed, and replaced by a single digit

  • Examinee must determine if single digit presented was also present in the original string

  • Test length ~20 minutes

Bat 5 activities interest inventory

Assesses attitudes toward risk-taking

Examinee is presented with activity pair and asked to choose between the activities

Activity pairs differ in level of risk

Test length ~10 minutes

BAT5. Activities Interest Inventory

Tbas 1 uav directional orientation

TBAS1. UAV Directional Orientation

  • Assesses spatial orientation

  • Examinee must determine position of target relative to the UAV

    • The "tracker map” shows the examinee the location and heading of the UAV

  • Example “select the North parking lot”

Tbas 2 3 3 digit and 5 digit listening

TBAS2 & 3. 3-Digit and 5-Digit Listening

  • A string of letters and numbers is presented over headphones

  • Task is to squeeze the trigger when any of three (3) or five (5) pre-specified target numbers are presented

  • Test length = 60 seconds

Tbas 4 horizontal tracking

TBAS4. Horizontal Tracking

  • Compensatory tracking task

  • Use rudder pedals to keep the yellow box over a moving airplane target

  • Speed of the moving target increases during test

  • Test length = 60 seconds

Tbas 5 airplane tracking

TBAS 5.Airplane Tracking

  • Compensatory tracking task

  • Dual-axis joystick is used to keep the yellow sight over a moving airplane target

  • Test length = 60 seconds

Tbas 6 airplane horizontal tracking

TBAS6. Airplane & Horizontal Tracking

  • Compensatory tracking task

  • Combines Airplane Tracking Task and Horizontal Tracking Task

  • Time length = 120 seconds

Tbas 7 8 airplane horizontal tracking listening

TBAS7 & 8. Airplane & Horizontal Tracking & Listening

  • Compensatory tracking task and listening task

  • Combines Airplane Tracking Task and Horizontal Tracking Task with either 3-Digit Listening or 5-Digit Listening tasks

  • Time length = 180 seconds

Tbas 9 emergency scenario

TBAS9. Emergency Scenario

  • Compensatory tracking & memorization

  • Target digit listening is replaced with emergency scenarios task

    • Examinee must resolve “emergency situations” by entering code memorized earlier from test instructions

  • Login