Systematic reviews of randomized controlled trials (RCTs) are the highest level of evidence used to inform patient care. However, it has been suggested that the quality of randomization in RCTs in orthopaedic surgery may be low. This study aims to describe the quality of randomization in trials included in systematic reviews in orthopaedic surgery. Systematic reviews of RCTs testing orthopaedic procedures published in 2022 were extracted from PubMed, Embase, and the Cochrane Library. A random sample of 100 systematic reviews was selected, and all included RCTs were retrieved. To be eligible for inclusion, systematic reviews must have tested an orthopaedic procedure as the primary intervention, included at least one study identified as a RCT, been published in 2022 in English, and included human clinical trials. The Cochrane Risk of Bias-2 Tool was used to assess random sequence generation as ‘adequate’, ‘inadequate’, or ‘no information’; we then calculated the proportion of trials in each category. We also collected data to test the association between these categories and characteristics of the RCTs and systematic reviews.Aims
Methods
Bone demonstrates good healing capacity, with a variety of strategies being utilized to enhance this healing. One potential strategy that has been suggested is the use of stem cells to accelerate healing. The following databases were searched: MEDLINE, CENTRAL, EMBASE, Cochrane Database of Systematic Reviews, WHO-ICTRP, ClinicalTrials.gov, as well as reference checking of included studies. The inclusion criteria for the study were: population (any adults who have sustained a fracture, not including those with pre-existing bone defects); intervention (use of stem cells from any source in the fracture site by any mechanism); and control (fracture healing without the use of stem cells). Studies without a comparator were also included. The outcome was any reported outcomes. The study design was randomized controlled trials, non-randomized or observational studies, and case series.Aims
Methods
The poor reporting and use of statistical methods in orthopaedic papers has been widely discussed by both clinicians and statisticians. A detailed review of research published in general orthopaedic journals was undertaken to assess the quality of experimental design, statistical analysis and reporting. A representative sample of 100 papers was assessed for compliance to CONSORT and STROBE guidelines and the quality of the statistical reporting was assessed using a validated questionnaire. Overall compliance with CONSORT and STROBE guidelines in our study was 59% and 58% respectively, with very few papers fulfilling all criteria. In 37% of papers patient numbers were inadequately reported; 20% of papers introduced new statistical methods in the ‘results’ section not previously reported in the ‘methods’ section, and 23% of papers reported no measurement of error with the main outcome measure. Taken together, these issues indicate a general lack of statistical rigour and are consistent with similar reviews undertaken in a number of other scientific and clinical research disciplines. It is imperative that the orthopaedic research community strives to improve the quality of reporting; a failure to do so could seriously limit the development of future research.
