From Hands-On Measurement to Job Performance: The Issue of Generalizability

Published Date: October 1, 1986
The generalization from hands-on test scores to performance in a military occupation specialty can be threatened by many potential sources of error within the measurement process. Such sources of error can include scoring inconsistencies by test administrators, testing over a long period, and diverse test content. This analysis estimates the influence of these factors on the hands-on scores for three Marine Corps specialties. Estimates of test reliability are discussed in light of the effect the measurement factors on the hands-on scores. Research designs to assess specific issues of reliability are proposed for the full-scale administration of hands-on tests to the Infantry occupational field.