Development, Validation, and Fairness of a Biographical Data Questionnaire for the Air Traffic Control Specialist Occupation

Details

• Creators:
  Dean, Michelle ; Broach, Dana
• Corporate Creators:
  United States. Office of Aerospace Medicine
• Subject/TRT Terms:
  Air Traffic Controllers Behavior Data Collection Questionnaires Reliability (Statistics) Selection And Appointment Validity
• Publication/ Report Number:
  DOT/FAA/AM-12/19
• Resource Type:
  Tech Report
• Geographical Coverage:
  United States
• Corporate Publisher:
  Civil Aerospace Medical Institute
• Abstract:
  Development and validation of a biographical data (“biodata”) instrument for selection into the Air Traffic
  
  Control Specialist occupation is described. Bootstrapping was used to estimate correlations between item
  
  responses to the Applicant Background Assessment (ABA; 142 items; n=266), Biographical Questionnaire (BQ;
  
  145 items; n=482), and average supervisory job performance ratings. Scoring keys were developed for the most
  
  predictive 80, 100, and 120 items from the instruments. Reliabilities for the proposed scales ranged from .74 to
  
  .78. Criterion-related validities were .59, .62, and .63 for the 80-, 100-, and 120-item versions, respectively.
  
  Each version of the biodata scale had significant incremental validity over the AT-SAT composite score,
  
  accounting for 29% to 32% additional variance in average job performance ratings. Score distributions and cutscores by race and sex were investigated. Differences (d) in mean scores by gender and ethnicity were generally
  
  low (ranging from -.08 to .37). Finally, cut score analyses were performed to examine pass rates of demographic
  
  subgroups using banding and percentiles.
  
  Based on the findings of this study, it is recommended that the 80-item biodata scale, renamed the Controller
  
  Background Assessment Survey (CBAS), be further developed as a potential ATCS selection procedure.
  
  
• Format:
  PDF
• Collection(s):
  FAA Civil Aerospace Medical Institute US Transportation Collection
• Main Document Checksum:
  urn:sha256:3c6e1e2d2ff92a7669afa860b56e255abc01caa79300f70c01a304d6051c8075
• Download URL:
  https://rosap.ntl.bts.gov/view/dot/25441/dot_25441_DS1.pdf
• File Type:
  [PDF - 485.59 KB ]