Previous standards for assessing the reliability of a measurement tool have lacked consistency. We reviewed the most current American Society for Testing and Materials and International Organisation for Standardisation (ISO) recommendations, and propose an algorithm for orthopaedic surgeons. When assessing a measurement tool, conditions of the experimental set-up and clear formulae used to compile the results should be strictly reported. According to these recent guidelines, accuracy is a confusing word with an overly broad meaning and should therefore be abandoned. Depending on the experimental conditions, one should be referring to bias (when the study protocol involves accepted reference values), and repeatability (sr, r) or reproducibility (SR, R). In the absence of accepted reference values, only repeatability (sr, r) or reproducibility (SR, R) should be provided. Take home message: Assessing the reliability of a measurement tool involves reporting bias, repeatability and/or reproducibility depending on the defined conditions, instead of precision or accuracy. Cite this article: Bone Joint J 2016;98-B2:166–72

Aims. Diagnosis of cauda equina syndrome (CES) remains difficult; clinical assessment has low accuracy in reliably predicting MRI compression of the cauda equina (CE). This prospective study tests the usefulness of ultrasound bladder scans as an adjunct for diagnosing CES. Methods. A total of 260 patients with suspected CES were referred to a tertiary spinal unit over a 16-month period. All were assessed by Board-eligible spinal surgeons and had transabdominal ultrasound bladder scans for pre- and post-voiding residual (PVR) volume measurements before lumbosacral MRI. Results. The study confirms the low predictive value of ‘red flag’ symptoms and signs. Of note ‘bilateral sciatica’ had a sensitivity of 32.4%, and a positive predictive value (PPV) of only 17.2%, and negative predictive value (NPV) 88.3%. Use of a PVR volume of ≥ 200 ml was a demonstrably more accurate test for predicting cauda equina compression on subsequent MRI (p < 0.001). The PVR sensitivity was 94.1%, specificity 66.8%, PPV 29.9% and NPV 98.7%. The PVR allowed risk-stratification with 13% patients deemed ‘low-risk’ of CES. They had non-urgent MRI scans. None of the latter scans showed any cauda equina compression (p < 0.006) or individuals developed subsequent CES in the intervening period. There were considerable cost-savings associated with the above strategy. Conclusion. This is the largest reported prospective evaluation of suspected CES. Use of the PVR volume ≥ 200 ml was considerably more accurate in predicting CES. It is a useful adjunct to conventional clinical assessment and allows risk-stratification in managing suspected CES. If adopted widely it is less likely incomplete CES would be missed. Cite this article: Bone Joint J 2020;102-B(6):677–682

Static and dynamic measurements of foot pressure have been carried out on three groups of subjects: diabetic patients with neuropathy (with and without a history of ulceration), diabetic patients with no neuropathy, and normal subjects as controls. In many cases both techniques of measurement detected areas of abnormally high pressure under the foot, but in some cases a particularly high-pressure spot was detected on only one of the tests and sometimes both methods were needed to reveal all the areas of the foot which might be considered to be at risk. The dynamic measurements tended to show multiple areas of high pressure better than the static measurements. Our results indicate the importance of making both types of measurement when seeking to devise suitable means of protecting the foot from ulceration

Objectives. The accuracy and precision of two new methods of model-based radiostereometric analysis (RSA) were hypothesised to be superior to a plain radiograph method in the assessment of polyethylene (PE) wear. Methods. A phantom device was constructed to simulate three-dimensional (3D) PE wear. Images were obtained consecutively for each simulated wear position for each modality. Three commercially available packages were evaluated: model-based RSA using laser-scanned cup models (MB-RSA), model-based RSA using computer-generated elementary geometrical shape models (EGS-RSA), and PolyWare. Precision (95% repeatability limits) and accuracy (Root Mean Square Errors) for two-dimensional (2D) and 3D wear measurements were assessed. Results. The precision for 2D wear measures was 0.078 mm, 0.102 mm, and 0.076 mm for EGS-RSA, MB-RSA, and PolyWare, respectively. For the 3D wear measures the precision was 0.185 mm, 0.189 mm, and 0.244 mm for EGS-RSA, MB-RSA, and PolyWare respectively. Repeatability was similar for all methods within the same dimension, when compared between 2D and 3D (all p > 0.28). For the 2D RSA methods, accuracy was below 0.055 mm and at least 0.335 mm for PolyWare. For 3D measurements, accuracy was 0.1 mm, 0.2 mm, and 0.3 mm for EGS-RSA, MB-RSA and PolyWare respectively. PolyWare was less accurate compared with RSA methods (p = 0.036). No difference was observed between the RSA methods (p = 0.10). Conclusions. For all methods, precision and accuracy were better in 2D, with RSA methods being superior in accuracy. Although less accurate and precise, 3D RSA defines the clinically relevant wear pattern (multidirectional). PolyWare is a good and low-cost alternative to RSA, despite being less accurate and requiring a larger sample size

Reimers’ hip migration percentage is commonly used to document the extent of subluxation of the hip in children with spasticity. In this study, two measurers, with six months paediatric orthopaedic experience, measured the migration percentage on 44 pelvic radiographs of children with cerebral palsy, aged between two and eight years. Unknown to the measurers, each radiograph was duplicated, giving 22 non-identical radiographs (44 hips) which were measured twice at time 0 and twice six weeks later. The intra-measurer, intra-sessional absolute differences between the first and second measurements ranged from 0% to 23%, with median values of 2.5% to 3.6%. The intra-sessional median absolute differences were not statistically different between the two measurers and measuring sessions (p = 0.42, Kruskal-Wallis test). The inter-sessional absolute differences for measurements made by the same measurers ranged from 0% to 18% with a median absolute difference of 1.7% to 3.2%. Overall, only 5% of the intra-measurer measurement differences, within and between sessions, were above 13%. Repeated measurements by one measurer over time must, therefore, vary by more than 13% in order to be 95% confident of a true change. The inter-measurer error was higher with median absolute differences between the two measurers’ measurements of the same hip of 3.25% to 5% (0% to 26%) and a 95. th. upper confidence interval of 21% to 23%. Averaging the four separate measurements over the two sessions reduced the inter-measurer error to a median absolute difference of 2.8%, but did not improve the 95. th. upper confidence interval, which measured 22.4%. Such inter-measurer errors may be clinically unacceptable

Our aim was to determine whether tantalum markers improved the accuracy and/or precision of methods for the measurement of migration in total hip replacement based on conventional measurements without mathematical correction of the data, and with Ein Bild Roentgen Analyse – Femoral Component Analysis (EBRA-FCA) which allows a computerised correction. Three observers independently analysed 13 series of roentgen-stereophotogrammetric-analysis (RSA)-compatible radiographs (88). Data were obtained from conventional measurements, EBRA-FCA and the RSA method and all the results were compared with the RSA data. Radiological evaluation was also used to quantify in how many radiographs the intraosseous position of the bone markers had been simulated. The results showed that tantalum markers improve reliability whereas they do not affect accuracy for conventional measurements and for EBRA-FCA. Because of the danger of third-body wear their implantation should be avoided unless they are an integral part of the method

We investigated the reproducibility of the various radiological methods of assessment of hip dysplasia by making 474 assessments of hips and quantifying the inter-observer and intra-observer variation. There was a wide range of variability between the readings made by different observers and by one observer on two occasions. A measurement of acetabular index has to be given a range of +/- 6 degrees in order to be 95% confident of including the true measurement. We found the most helpful measurements to be the acetabular index, up to the age of eight years; the centre-edge angle, over the age of five years; and Smith's c/b ratio and neck-shaft angle. We feel, however, that the change in value over a series of radiographs in the same child is much more valuable. Single readings of all the radiological measurements investigated in this study were unreliable

Aims

Tourniquets have potential adverse effects including postoperative thigh pain, likely caused by their ischaemic and possible compressive effects. The aims of this preliminary study were to determine if it is possible to directly measure intramuscular pH in human subjects over time, and to measure the intramuscular pH changes resulting from tourniquet ischaemia in patients undergoing knee arthroscopy.

Individual components of a total hip replacement are difficult to evaluate and quantify. We have studied the assessment of the acetabular component, and conclude that the measurement of migration allows the comparison of implants, although there is no established link between migration and significant loosening. A method of measurement based on clinical radiographs has been developed, and its limitations estimated. The accuracy of the technique was calculated to be +/- 3 mm

We compared goniometric assessment of passive ankle movement with radiographic measurements in 100 normal ankles. Significant differences were recorded in both dorsiflexion and plantarflexion; clinical measurements overestimated the range of movement. For scientific documentation of tibiotalar mobility, radiographic measurements should be used

The gait pattern of five amputees was recorded by visual observation and also by a quantitative measurement system. The results were compared with the gait pattern predicted from biomechanical analysis. Visual observation was found to be an unreliable clinical skill. The observers recorded only 22.2% of the predicted gait deviations and were unable to comment on 15.6% of all the required observations. The gait parameters which were difficult to assess visually, namely step length and step time, are considered by most workers to be of particular value as diagnostic clinical indicators in gait assessment. The measurement system used was accurate in recording gait deviations and picked up 3.4 times as many deviations as visual observation. This report demonstrates the inadequacy of visual observation as a diagnostic method and emphasises the need for measurements

Current methods of measurement of proprioceptive function depend on the ability to detect passive movement (kinaesthesia) or the awareness of joint position (joint position sense, JPS). However, reports of proprioceptive function in healthy and pathological joints are quite variable, which may be due to the different methods used. We have compared the validity of several frequently used methods to quantify proprioception. Thirty healthy subjects aged between 24 and 72 years underwent five established tests of proprioception. Two tests were used for the measurement of kinaesthesia (KT1 and KT2). Three tests were used for the measurement of JPS, a passive reproduction test (JPS1), a relative reproduction test (JPS2) and a visual estimation test (JPS3). There was no correlation between the tests for kinaesthesia and JPS or between the different JPS tests. There was, however, a significant correlation between the tests for kinaesthesia (r = 0.86). We conclude therefore that a subject with a given result in one test will not automatically obtain a similar result in another test for proprioception. Since they describe different functional proprioceptive attributes, proprioceptive ability cannot be inferred from independent tests of either kinaesthesia or JPS

Dual-energy X-ray absorptiometry (DEXA) is increasingly used to measure changes in bone mineral density (BMD) around femoral prostheses after total hip arthroplasty. We have studied the factors which affect the accuracy of these measurements. The coefficient of variation was < 2% using a hydroxyapatite phantom, 2.7% in an anthropomorphic phantom specimen, and < 1% in repeated measurements on implanted cadaver femora. The precision did not vary with different implant materials or designs. In patients we found a mean precision error of 2.7% to 3.4%. The most significant factor affecting reproducibility was rotation of the femur. We conclude that DEXA is a precise method of measurement for small changes in BMD around femoral implants, but that correct and careful positioning of patients is essential to obtain reliable results

Our aim was to determine the precision of the measurements of bone mineral density (BMD) by dual-energy x-ray absorptiometry in the proximal femur before and after implantation of an uncemented implant, with particular regard to the significance of retro- and prospective studies. We examined 60 patients to determine the difference in preoperative BMD between osteoarthritic and healthy hips. The results showed a preoperative BMD of the affected hip which was lower by a mean of 4% and by a maximum of 9% compared with the opposite side. In addition, measurements were made in the operated hip before and at ten days after operation to determine the effect of the implantation of an uncemented custom-made femoral stem. The mean increase in the BMD was 8% and the maximum was 24%. Previous retrospective studies have reported a marked loss of BMD on the operated side. The precision of double measurements using a special foot jig showed a modified coefficient of variation of 0.6% for the non-operated side in 15 patients and of 0.6% for the operated femur in 20 patients. The effect of rotation on the precision of the measurements after implantation of an uncemented femoral stem was determined in ten explanted femora and for the operated side in ten patients at 10° rotation and in 20 patients at 30° rotation. Rotation within 30° influenced the precision in studies in vivo and in vitro by a mean of 3% and in single cases in up to 60%. Precise prediction of the degree of loss of BMD is thus only possible in prospective cross-sectional measurements, since the effect of the difference in preoperative BMD, as well as the apparent increase in BMD after implantation of an uncemented stem, is not known from retrospective studies. The DEXA method is a reliable procedure for determining periprosthetic BMD when positioning and rotation are strictly controlled

The existing methods of assessing limb lengthening during total hip arthroplasty (THA) are prone to error because the measurements are not parallel to the limb lengthening axis. In order to address this, we designed a caliper to estimate limb lengthening during THA and evaluated its accuracy compared with our previous device, the straight caliper. Limb lengths were measured in 100 patients. The L-shaped caliper was used in 50 cases and the straight caliper in 50. The correlation between intra-operative and post-operative radiographic measurements was significantly improved using the L-shaped device (p < 0.0001, r = 0.934). This method was extremely accurate in predicting changes in limb length due to surgery

We obtained simultaneous measurements of sagittal knee laxity in 12 consecutive patients after reconstruction of the anterior cruciate ligament (ACL), using the Stryker laxity tester and radiostereometric analysis (RSA). The mean anteroposterior (AP) displacement when a 90 N load was applied in both directions was 5.3 ± 2.7 mm with RSA and 9.8 ± 1.6 mm with the external device (p < 0.001). The corresponding measurements at a load of 180 N were 5.7 ± 2.4 mm and 13.8 ± 3.7 mm, respectively (p < 0.001). More than 50% of the sagittal knee movement, as measured by the external device at a load of 180 N, was not true femorotibial displacement of the joint but was due to soft-tissue deformation

The databases of the Picture Archiving and Communication Systems of two hospitals were searched and all children who had a lateral radiograph of the ankle during their attendance at the emergency department were identified. In 227 radiographs, Bohler’s and Gissane’s angles were measured on two separate occasions and by two separate authors to allow calculation of inter- and intra-observer variation. Intraclass correlation coefficients were used to assess the reliability of the measurements. For Bohler’s angle the overall inter-observer reliability, the intraclass correlation coefficient was 0.90 and the intra-observer reliability 0.95, giving excellent agreement. This reliability was maintained across the age groups. For Gissane’s angle, inter- and intra-observer reliability was only fair or poor across most age groups. Further analysis of the Bohler’s angle showed a significant variation in the mean angle with age. Contrary to published opinion, the angle is not uniformly lower than that of adults but varies with age, peaking towards the end of the first decade before attaining adult values. The age-related radiologic changes presented here may help in the interpretation of injuries to the hindfoot in children

The variability in measurement of angles in congenital scoliosis is not known, but it is postulated that it is larger than that in adolescent idiopathic scoliosis due to skeletal immaturity, incomplete ossification, and anomalous development of the end-vertebrae. To determine this variability, we selected 54 radiographs of adequate quality showing 67 scoliotic curves from children with congenital scoliosis. The end-vertebrae were preselected. Each curve was measured by the Cobb method on two separate occasions by six different observers, using the same goniometer and marker. The intraobserver variability was +/- 9.6 degrees and the interobserver variability +/- 11.8 degrees. If 'significant progression' is to be used as a criterion for surgical fusion in congenital scoliosis, there should be at least a 23 degrees increase, the entire range of the interobserver variability, in the curvature to ensure that the perceived increase is not due to variability in measurement

A computer-based image analysis system has been developed as a research tool in total hip replacement. The system has been programmed to take multiple measurements from coronal plane radiographs. Poor quality radiographic images can be enhanced and standardised. The measurements which can be obtained include stem subsidence, cup migration, cup wear, and stem loosening. Reproducibility and accuracy were +/- 0.01 mm and +/- 0.5 mm respectively. The present application is in retrospective research, but prospective monitoring of radiographs is planned

We assessed the reproducibility and accuracy of four ratios used to measure patellar height, namely the Blackburne-Peel, Caton-Deschamps, Insall-Salvati and modified Insall-Salvati, before and after total knee arthroplasty. The patellar height was measured, by means of the four ratios, on the pre- and post-operative lateral radiographs of 44 patients (45 knees) who had undergone total knee arthroplasty. Two independent observers measured the films sequentially, in identical conditions, totalling 720 measurements per observer. Statistical analysis, comparing both observers and ratios, was carried out using the intraclass correlation coefficient. Before operation there was greater interobserver variation using either the Insall-Salvati or modified Insall-Salvati ratios than when using the Caton-Deschamps or Blackburne-Peel methods. This was because of difficulty in identifying the insertion of the patellar tendon. Before operation, there was a minimal difference in reliability between these methods. After operation the interobserver difference was greatly reduced using both the Caton-Deschamps and Blackburne-Peel methods, which use the prosthetic joint line, compared with the Insall-Salvati and modified Insall-Salvati, which reference from the insertion of the patellar tendon. The theoretical advantage of using the Insall-Salvati and modified Insall-Salvati ratios in measuring true patellar height after total knee arthroplasty needs to be balanced against their significant interobserver variability and inferior reliability when compared with other ratios