Latent Trait Theory Analysis of Changes in Item Response Anchors

Details

• Creators:
  Farmer, W. L. ; Thompson, R. C. ; Heil, S. K. R. ; Heil, M. C.
• Corporate Creators:
  United States. Department of Transportation. Federal Aviation Administration. Office of Aviation. Civil Aerospace Medical Institute ; Oklahoma Department of Mental Health
• Corporate Contributors:
  United States. Department of Transportation. Federal Aviation Administration. Office of Aviation. Office of Aerospace Medicine
• Subject/TRT Terms:
  • Attitudes
  • Employees
  • Random sampling
  • Aviation
  • Data
  • Analysis
  • Item Anchors
  • Latent Trait Theory
  • Item Response Theory
  • Differential Item Functioning
  More +
• Publication/ Report Number:
  DOT/FAA/AM-01/4
• Resource Type:
  Tech Report
• Geographical Coverage:
  United States
• Edition:
  Final Report
• Corporate Publisher:
  United States. Department of Transportation. Federal Aviation Administration. Office of Aviation. Civil Aerospace Medical Institute
• Abstract:
  The purpose of this study was to evaluate the effect that modifications in item response anchors have on responses to survey items. Twenty-nine items were administered in 1993 and 1995 as part of more extensive attitude surveys to two random samples of Federal Aviation Administration employees. Changes in the response scales (5-point Likert) between the two survey administrations ranged from no change at all to extensive re-anchoring of the response categories. Item responses were modeled via two-parameter graded response models based on item response theory. Changes in the way the item responses functioned between both years were assessed using the differential item functioning (DIF) method recommended by Muraki (1997). Twenty-four of the 29 items displayed significant levels of DIF, indicating that the response categories did not measure the constructs of interest in a similar fashion across the two administrations. Items whose response anchors had been changed substantially exhibited significant DIF more frequently than those where the change in anchors was less drastic. These results suggest that researchers and practitioners take a conservative.
• Format:
  PDF
• Download URL:
  https://rosap.ntl.bts.gov/view/dot/57918/dot_57918_DS1.pdf
• File Type:
  [PDF - 335.92 KB]
• Collection(s):
  FAA Civil Aerospace Medical Institute
• Main Document Checksum:
  urn:sha256:bc7aeab0a619515fe7c9a98baf3373e30eec23bb993942b07c7bd9ea1c61c3cf