Details:

Creators:
Broach, Dana
Corporate Creators:
Civil Aeromedical Institute
Corporate Contributors:
United States. Office of Aviation Medicine
Subject/TRT Terms:
[+]
Air Traffic Controllers Air Traffic Controllers--Selection And Appointment Examinations--Design And Construction Examinations--Validity Job Analysis Qualifications Selection And Appointment Training Validity
Publication/ Report Number:
DOT/FAA/AM-91/4
Resource Type:
Tech Report
Geographical Coverage:
United States
Corporate Publisher:
Civil Aerospace Medical Institute
Abstract:
This study evaluates the content validity of the Initial Qualifications Course provided to flight service specialists (FSS) by the FAA Academy. The purpose of FSS Initial Qualifications Course (FAA Academy course 50232) is to predict the student's probability of attaining certification as a full performance level controller in field facilities. First, results of analyses of the FSS position in automated flight service stations (AFSSs) are reviewed and summarized. Second, the linkage between job analysis and specifications of training content are described. Third, a content validation study, using a panel of 16 full performance level specialists from field facilities, is described.

The panel reviewed the graded, multiple-choice written examinations and a sample of graded laboratory simulations against the available job function descriptions and identified knowledges and skills required to perform those functions. The panel indicated whether a knowledge or skill was represented or tested in the reviewed graded instrument. The proportion of knowledges or skills represented by an instrument was then calculated for each rater; the average of these proportions across raters provided an overall index of the degree to which the knowledges and skills were represented in the graded instruments. A criterion of 70% coverage was selected as the evaluative benchmark. Three job functions are taught in the FSS Initial Qualifications Course: (a) flight plan processing; (b) orienting lost aircraft; and (c) weather analysis. Overall, eight of the ten graded components of FAA Academy course 50232 appeared to adequately sample the knowledge and task domains associated with these three AFSS job functions.

This content validation study and associated review of job analyses and course development indicate that FAA Academy course 50232 was constructed with reasonable competence and bears some reasonable, manifest relationship to the job of flight service specialist. The evidence provided by this study provides a basis for using the FSS Initial Qualifications Course on an interim basis for making personnel decisions about specialists.


Format:
PDF
Collection(s):
US Transportation Collection FAA Civil Aerospace Medical Institute
Main Document Checksum:
[+]
urn:sha256:cc9d58b67a1d2373107e1a59182648a7f3e0d0b719eaa27a195f18c945507b43
Download URL:
https://rosap.ntl.bts.gov/view/dot/21333/dot_21333_DS1.pdf
File Type:

Supporting Files

• No Additional Files

More +