Military police selection in Canada : an evaluation of the Canadian Forces Military Police Assessment Centre (MPAC)

Abstract

In this study, I investigated the psychometric properties of the Military Police Assessment Centre (MPAC) including the incremental predictive ability of job performance by the MPAC beyond the predictive validity of the Canadian Forces Aptitude Test (CFAT), a test of cognitive ability. MPAC data from a sample of Canadian Forces (CF) Military Police (MP) candidates (N=323) were examined using reliability analysis, principle components analysis (PCA), and multitrait-multimethod (MTMM) to assess the reliabilities of the 12 MPAC competencies and six method scales, the MPACs factor structure, and for evidence of convergent and discriminant validity. Job performance data from a sample (N=209) and CFAT data of a sample (N=203) of the 323 candidates were examined using correlation analyses to assess the predictive validity of the MPAC and CFAT. Results of the MPAC reliability analysis indicated that the methods demonstrated higher reliabilities than the competencies. Results of the PCA and MTMM indicated that the MPAC lacked construct validity. The MPAC and the CFAT demonstrated no correlation with the job performance measure. Consequently, the incremental predictive validity of the MPAC beyond the CFAT was not assessed. Recommendations for the use and/or development of a better job performance measure to assess the criterion-related validity of the MPAC are discussed, as are limitations and directions for future research.