Development, Validation, and Fairness of a Biographical Data Questionnaire for the Air Traffic Control Specialist Occupation

Details

• Creators:
  Dean, Michelle ; Broach, Dana
• Corporate Creators:
  United States. Office of Aerospace Medicine
• Subject/TRT Terms:
  • Air traffic controllers
  • Questionnaires
  • Selection and appointment
  • Behavior
  • Validity
  • Reliability (Statistics)
  • Data collection
• Publication/ Report Number:
  DOT/FAA/AM-12/19
• Resource Type:
  Tech Report
• Geographical Coverage:
  United States
• Corporate Publisher:
  Civil Aerospace Medical Institute
• Abstract:
  Development and validation of a biographical data (“biodata”) instrument for selection into the Air Traffic ; Control Specialist occupation is described. Bootstrapping was used to estimate correlations between item ; responses to the Applicant Background Assessment (ABA; 142 items; n=266), Biographical Questionnaire (BQ; ; 145 items; n=482), and average supervisory job performance ratings. Scoring keys were developed for the most ; predictive 80, 100, and 120 items from the instruments. Reliabilities for the proposed scales ranged from .74 to ; .78. Criterion-related validities were .59, .62, and .63 for the 80-, 100-, and 120-item versions, respectively. ; Each version of the biodata scale had significant incremental validity over the AT-SAT composite score, ; accounting for 29% to 32% additional variance in average job performance ratings. Score distributions and cutscores by race and sex were investigated. Differences (d) in mean scores by gender and ethnicity were generally ; low (ranging from -.08 to .37). Finally, cut score analyses were performed to examine pass rates of demographic ; subgroups using banding and percentiles. ; Based on the findings of this study, it is recommended that the 80-item biodata scale, renamed the Controller ; Background Assessment Survey (CBAS), be further developed as a potential ATCS selection procedure.
  More +
• Format:
  PDF
• Download URL:
  https://rosap.ntl.bts.gov/view/dot/25441/dot_25441_DS1.pdf
• File Type:
  [PDF - 485.59 KB]
• Collection(s):
  FAA Civil Aerospace Medical Institute ; US Transportation Collection
• Main Document Checksum:
  urn:sha-512:0bea5e6efe8e3906335335c8f4dc17e67c07a17a254635b79fbd71184ea5fcffbff6d8c128072f1b053df6f23c0076c5c67978cb1af83b047bae5b30c679339d