- Research and Projects
- Get Involved
This evaluation (EmMA) provides an independent and qualitative review of the first iteration of the PenCHORD Health Services Modelling Associates (HSMA) programme.
The HSMA programme aimed to increase the use of operational research (OR) methods by NHS organisations to support evidence based decision-making, and increase collaboration within and between NHS organisations and between research and NHS organisations.
The evaluation involved interviews with programme developers and HSMAs early-mid stage on in the programme to understand expectations and perceptions of how the programme is progressing. After the programme was completed, we conducted further interviews with the HSMAs, mentors and workplace supervisors. Our final analysis was also informed by a discussion with the modelling software supplier (Simul8), documents outlining the aims and recruitment to the programme, an evaluation questionnaire, logs and monthly reports recorded during the programme by mentors and associates.
The evaluation suggests the programme has been very successful in developing skills in the modelling process and the free software supplied (Simul8). Associates and workplace supervisors both perceived a significant improvement in the quality of information and data analysis produced during the programme and a desire to sustain this approach and links with the PenCHORD team. Four key themes have emerged as relevant to how the programme has succeeded through:
Key outcomes were identified from the evaluation of the HSMA programme:
The evaluation also highlights the aspects of the programme that went well and indicates how existing challenges might be addressed in the future. This includes allowing for flexibility in the timing of the programme, to reflect a more realistic timeframe for NHS decision-makers and providing specifications for each role within the programme. The CLAHRC support of the programme was clearly welcomed as training and expertise was at no cost to NHS organisations. The expertise offered by PenCHORD was highly valued and increased the confidence in the modelling outputs produced by associates. An ongoing collaboration between the associates and PenCHORD was suggested as desirable. Collaboration within and across NHS organisations was welcomed and seen as a direct impact of the HSMA programme. Additionally, an unexpected consequence of the programme was job enrichment for all participants: mentors, workplace supervisors and associates.
The evaluation has highlighted a number of challenges in ensuring the projects have been achievable within the timeframe. The protection of associates’ time and access to necessary data are such examples.
This evaluation study has also provided evidence on how and who the programme has worked for as well as the process of engaging modelling to enable NHS decision making and service change. Theoretical insights into how the programme achieved its aims have been drawn through considering data in the context of the Integrated - Promoting Action on Research Implementation in Health Services (i-PARIHS) framework . This has provided insight and greater understanding of the comments and factors which were suggested as influential to the HSMA programme during the evaluation. These factors relate to those participating in the programme (recipients), the style of facilitation by mentors and workplace supervisors, the design of the HSMA programme itself (innovation) and contextual factors that influenced the outcome and process of individual projects.
 Harvey G and Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implementation Science, 2016. 11:33. DOI 10.1186/s13012-016-0398-2