United States Department of Transportation
i
The Validity of the Air Traffic Selection and Training (AT-SAT) Test Battery in Operational Use
-
2013-03-01
-
[PDF-482.10 KB]
Details:
-
Creators:
-
Corporate Creators:
-
Corporate Contributors:
-
Subject/TRT Terms:
-
Publication/ Report Number:
-
Resource Type:
-
Geographical Coverage:
-
Corporate Publisher:
-
Abstract:Applicants for the air traffic control specialist (ATCS) occupation from the general public and graduates from post-secondary institutions participating in the FAA’s Air Traffic Collegiate Training Initiative (AT-CTI) must take and pass the Air Traffic Selection and Training (AT-SAT) test battery as part of the selection process. Two concurrent, criterion-related validation studies demonstrated that AT-SAT was a valid predictor of ATCS job performance (American Institutes for Research, 2012; Ramos, Heil, & Manning, 2001a,b). However, the validity of AT-SAT in operational use has been questioned since implementation in 2002 (Barr, Brady, Koleszar, New, & Pounds, 2011; Department of Transportation Office of the Inspector General, 2010). The current study investigated the validity of AT-SAT in operational use. Method. AT-SAT and field training data for 1,950 air traffic controllers hired in fiscal years 2007 through 2009 were analyzed by correlation, cross-tabulation, and logistic regression with achievement of Certified Professional Controller (CPC) status as the criterion. Results. The correlation between AT-SAT and achievement of CPC status was .127 (n=1,950, p<.001). The correlation was .188 when corrected for direct restriction in range. A larger proportion of controllers in the “Well Qualified” score band (85-100) achieved CPC status than in the “Qualified” (70-84.99) band. The logistic regression model did not fit the data well (χ2=30.659, p<.001, -2LL=1920.911). AT-SAT modeled only a small proportion of the variance in achievement of CPC status (Cox and Snell R2=.016, Nagelkerke R2=.025). The logistic regression coefficient for AT-SAT score of .049 was significant (Wald=30.958, p<.001). Discussion. AT-SAT is a valid predictor of achievement of CPC status at the first assigned field facility. However, the correlation is likely attenuated by time and intervening variables such as the training process itself. Other factors might include the weighting of subtest scores and use of a narrow criterion measure. Further research on the validity of AT-SAT in relation to multiple criteria is recommended.
-
Format:
-
Collection(s):
-
Main Document Checksum:
-
Download URL:
-
File Type:
