Research for Tests

Syndicate content
An Evaluation of the Student Testing Program (STP97) Norming Sample
December 1, 2003
This analysis was conducted in support of the Defense Manpower Data Center (DMDC) and its effort to provide norms for the Student Testing Program (STP). Through the STP, free testing on the Armed Services Vocational Aptitude Battery (ASVAB) is provided to high schools for use with students in the 10th, 11th, and 12th grades. Norms are also provided for postsecondary students in two-year colleges. The data were collected during a nationwide administration of the ASVAB as part of the National Longitudinal Survey of Youth (NLSY97). The objective of our analysis is to evaluate the suitability of the data for use in developing test norms for the STP. We examined the underlying demographics of the data and concluded that the data for students in the 10th, 11th, and 12th grades were suitable for the development of norms. This follows because the sample is representative of the target population with respect to all demographic variables known to be important correlates of test scores. The data sample for the postsecondary students was somewhat problematic but may be improved by weighting on appropriate demographic variables.
Read More | Download Report
Attitudes, Incentives, and Test Performance
December 1, 2003
This analysis was conducted in support of the Defense Manpower Data Center (DMDC) and its project to develop aptitude test norms from a test administration done as part of the National Longitudinal Survey of Youth (NLSY97). Our analysis draws on an extensive questionnaire administered to the respondents at the conclusion of their aptitude test. We conducted a regression analysis of test scores as a function of demographics and attitudes as expressed on the questionnaire. We summarize the results as follows: · Incentive payments to persons taking the aptitude tests are essential. · Test takers tried equally hard during a lengthy 9-month testing period. Members of some demographic groups did not try as hard as others.
Read More | Download Report
Norming Tables for the Student Testing Program (STP97)
December 1, 2003
The Department of Defense sponsors the Student Testing Program (STP), which provides a form of the Armed Services Vocational Aptitude Battery (ASVAB) for use in high schools and in postsecondary schools. The test scores are used for career exploration in the schools and may also be used to enlist in the armed forces. This document describes our development of national norms for students in the 10th, 11th, and 12th grades as well as postsecondary (2-year) colleges. The norms are based on data collected as part of the National Longitudinal Survey of Youth (NLSY97).
Read More | Download Report
On The Representativeness of Norming Samples for Aptitude Tests
December 1, 2003
This paper discusses the extent to which a sample intended for use in norming aptitude tests must be representative of the underlying population. The work is in support of the Defense Manpower Data Center (DMDC) and its planned use of data from the National Longitudinal Survey of Youth (NLSY97) as a norming sample for aptitude tests. We examined data from a previous national administration of aptitude tests to a representative sample of youth known as Profile of American Youth (PAY 80). We regressed aptitude test scores on demographics and concluded that: · A norming sample for aptitude tests must be representative of the target population with respect to age, race/ethnicity, gender, respondent’s education, and mother’s education. It is not necessary that the sample also be representative with respect to number of siblings in the household, degree of urbanization, or census region. Although these factors may be correlated with aptitude scores, if the other five variables are representative, then these factors need not be representative.
Read More | Download Report
Initial Assessment of the Air Combat Environment Test and Evaluation Facility To Support Operational Test and Evaluation Facility To Support Operational Test and Evaluation: Paper and Presentation Slides for International T&E Workshop--
November 1, 1996
This paper briefly describes the Navy's Operational Test and Evaluation Force's (OPTEVFOR's) assessment regarding the suitability of selected laboratories at the Air Combat Environment Test and Evaluation Facility (ACETEF) to support the operational test and evaluation of electronic warfare systems - Radar Warning Receivers (RWR) and, in particular, the Navy's next-generation RWR, the AN/ALR-67(V)3.
Read More | Download Report
Sensitivity and Fairness of the Marine Corps Mechanical Maintenance Composite
June 1, 1992
A score used for selection or classification should predict the performance of different population subgroups equally well. This research memorandum analyzes the prediction of hands-on performance in the automotive mechanic occupational specialty using the Marine Corps' Mechanical Maintenance composite.
Read More | Download Report
Development and Scoring of Hands-on Performance Tests for Mechanical Maintenance Specialties
March 1, 1992
This memorandum reports the procedures used for the development and scoring of hands-on performance tests for the mechanical maintenance phase of the Job Performance Measurement project.
Read More | Download Report
Reliability of Mechanical Maintenance Performance Measures
February 1, 1992
A fundamental requirement in the development and administration of performance measures is that such assessments should result in reliable scores that accurately indicate a person's level of proficiency. This research memorandum examines the reliability of two performance measures of mechanical maintenance developed for the Marine Corps Job Performance Measurement project: hands-on performance tests and job knowledge tests. Multiple estimates of reliability were computed, and the consistency of test administrators in scoring hands-on performance was specifically examined.
Read More | Download Report
Job Performance Tests for CH-46 Helicopter Mechanics - Volume I: Hands-On Performance Test
August 1, 1991
A hands-on performance test and a job-knowledge test were developed for CH-46 helicopter mechanics as part of the Marine Corps Job Performance Measurement Project. The purpose of this information memorandum is to disseminate these performance measures to Marine Corps personnel managers, training instructors, and interested researchers who may find them useful. This work comprises two parts: this volume contains the hands-on performance tests, and a second volume presents the administrative duties and job knowledge tests. See also 95 017902. AD-B163074
Read More | Download Report
Job Performance Tests for CH-46 Helicopter Mechanics - Volume II: Administrative Duties and Job Knowledge Tests
August 1, 1991
A hands-on performance test and a job-knowledge test were developed for CH-46 helicopter mechanics as part of the Marine Corps Job Performance Measurement Project. The purpose of this information memorandum is to disseminate these performance measures to Marine Corps personnel managers, training instructors, and interested researchers who may find them useful. This work comprises two parts: volume I contains the hands-on performance tests, and this volume presents the administrative duties and job-knowledge tests. See also 95 017901.
Read More | Download Report