Valid and reliable techniques for assessing performance are essential to surgical education, especially with the emergence of competency-based frameworks. Despite this, there is a paucity of adequate tools for the evaluation of skills required during joint replacement surgery. In this scoping review, we examine current methods for assessing surgeons’ competency in joint replacement procedures in both simulated and clinical environments. The ability of many of the tools currently in use to make valid, reliable and comprehensive assessments of performance is unclear. Furthermore, many simulation-based assessments have been criticised for a lack of transferability to the clinical setting. It is imperative that more effective methods of assessment are developed and implemented in order to improve our ability to evaluate the performance of skills relating to total joint replacement. This will enable educators to provide formative feedback to learners throughout the training process to ensure that they have attained core competencies upon completion of their training. This should help ensure positive patient outcomes as the surgical trainees enter independent practice. Cite this article: Bone Joint J 2013;95-B:1445–9

We have developed a list of 281 competencies deemed to be of importance in the training of orthopaedic surgeons. A stratified, randomised selection of non-university orthopaedic surgeons rated each individual item on a scale 1 to 4 of increasing importance. Summary statistics across all respondents were given. The mean scores and sds were computed. Secondary analyses were computed in general orthopaedics, paediatrics, trauma and adult reconstruction. Of the 156 orthopaedic surgeons approached 131 (84%) responded to the questionnaire. They rated 240 of the 281 items greater than 3.0 suggesting that competence in these was necessary by completion of training.

Complex procedures were rated to be less important. The structure, delivery and implementation of the curriculum needs further study. Learning activities are ‘driven’ by the evaluation of competencies and thus competency-based learning may soon be in the forefront of training programmes.