The reliability and validity of multiple mini interviews (MMIs) in values based recruitment to nursing, midwifery and paramedic practice programmes: Findings from an evaluation study

Abstract

Background Universities in the United Kingdom (UK) are required to incorporate values based recruitment (VBR) into their healthcare student selection processes. This reflects an international drive to strengthen the quality of healthcare service provision. This paper presents novel findings in relation to the reliability and predictive validity of multiple mini interviews (MMIs); one approach to VBR widely being employed by universities. Objectives To examine the reliability (internal consistency) and predictive validity of MMIs using end of Year One practice outcomes of under-graduate pre-registration adult, child, mental health nursing, midwifery and paramedic practice students. Design Cross-discipline evaluation study. Setting: One university in the United Kingdom. Participants Data were collected in two streams: applicants to A) The September 2014 and 2015 Midwifery Studies programmes; B) September 2015 adult; Child and Mental Health Nursing and Paramedic Practice programmes. Fifty-seven midwifery students commenced their programme in 2014 and 69 in 2015; 47 and 54 agreed to participate and completed Year One respectively. 333 healthcare students commenced their programmes in September 2015. Of these, 281 agreed to participate and completed their first year (180 adult, 33 child and 34 mental health nursing and 34 paramedic practice students). Methods Stream A featured a seven station four-minute model with one interviewer at each station and in Stream B a six station model was employed. Cronbach's alpha was used to assess MMI station internal consistency and Pearson's moment correlation co-efficient to explore associations between participants’ admission MMI score and end of Year one clinical practice outcomes (OSCE and mentor grading). Results Stream A: Significant correlations are reported between midwifery applicant's MMI scores and end of Year One practice outcomes. A multivariate linear regression model demonstrated that MMI score significantly predicted end of Year One practice outcomes controlling for age and academic entry level: coefficients 0.195 (p = 0.002) and 0.116 (p = 0.002) for OSCE and mentor grading respectively. In Stream B no significant correlations were found between MMI score and practice outcomes measured by mentor grading. Internal consistency for each MMI station was ‘excellent’ with values ranging from 0.966–0.974 across Streams A and B. Conclusion This novel, cross-discipline study shows that MMIs are reliable VBR tools which have predictive validity when a seven station model is used. These data are important given the current international use of different MMI models in healthcare student selection processes.