Development of Competency Test Instruments for PPG Students in the Automotive Field: Analysis of Validity, Reliability, and Discrimination Power

Abstract

This study aims to develop and validate a competency test instrument for students in the Teacher Professional Education Program (PPG) in the automotive field. The instrument was constructed through stages including the development of measurement specifications, question writing based on a blueprint, review, assembly, trial, analysis of trial results, as well as item selection and reassembly. The trial involved 73 PPG students at Universitas Negeri Malang. Item analysis covered difficulty level, discrimination power, validity, reliability, and distractor effectiveness. The results showed that out of 35 test items, 23 were deemed suitable for use after selection and revision. Thirty items had a medium level of difficulty, 5 were difficult, and none were easy. Regarding discrimination power, 22 items were categorized as ideal, 12 as low, and 1 as high. Item validity analysis revealed that only 9 items were valid, while the remaining 26 required revision or elimination. Distractor analysis showed 9 items with non-functioning distractors. The reliability of the reassembled instrument was 0.719, which is considered high according to Cronbach’s Alpha. These findings confirm that the developed instrument can be used to reliably measure the competencies of PPG automotive students. However, certain aspects, particularly the improvement of item discrimination, still require refinement. This research contributes to providing a valid, reliable evaluation tool aligned with the characteristics of PPG students and can serve as a reference for similar test development in other technical education fields.