Health & Wellness Services

Events

Congresses & Conferences

World Congress on Low Back & Pelvic Girdle Pain (2019)

wclbp dr jo abbott

Inter-tester and intra-tester reliability studies: The evidence-based methodology has failed the evidence-based understanding.

Introduction (Ongoing data collection – expected completion June 2019) Hands-on data acquisition is a term used to describe the mechanisms at play when the hands of a tester palpate an individual using observation-based and touch-based methods to fulfil specific tasks such as: manually assessing an individual’s alignment and/or biomechanics; and/or marker placement.  How a tester collects and interprets hands-on data acquisition methods into reliable, specific and sensitive data remains unknown. To the Authors knowledge, no study to date has explored whether the volunteers may be contributing to the inconclusive data reported in inter-tester and intra-tester reliability studies, nor has there been a study that has deductively explored the mechanisms that underpin hands-on data acquisition, suggesting the replication of this inductive methodology has misled the narrative of these studies driving further disparity within the evidence based research. These disparate outcomes have had a two-fold effect within manual therapy: readers acting upon these false-positive outcomes may in fact be causing harm to individuals in their care by prolonging improvements; whilst also strongly discouraging the use of hands-on techniques for data acquisition.

Purpose/Aim This study aimed to deductively investigate the observation-based and touch-based methods a tester uses during hands-on data acquisition. Are we only collecting data from the subject?

Materials and Methods Seven repeated measure design studies were conducted over a two-year period. One hundred and fourteen volunteers (all holding a recognised manual therapy qualification) have been recruited as testers, and one hundred and thirty-four healthy subjects have volunteered as patients. Paired testers had their observation-based and touch-based methods for hands-on data acquisition investigated in isolation and integration within and between three rounds of testing. Prior to the studies commencing, all volunteers craniovertebral and upper thorax regions were assessed, volunteers blinded to outcomes, and any history of head trauma noted by the examiner (Author). Following each experimental study an inductive open interview was conducted with the testers. A convergent parallel mixed methods research approach was employed capitalising on the strengths of both qualitative and quantitative data.  A Cohen Kappa Coefficient analysis was used to explore agreement between and within testers and modalities of data acquisition (1).  A Thematic Analysis (TA) was used to capture the intricacies of the testers experiences, and for the first time explicitly allowing for social as well as psychological interpretations of the data collected (2).

Results Parietal and/or temporal head trauma correlates with unreliable volunteers, both as testers and as subjects within reliability studies.  Testers with incongruent alignment and biomechanics between craniovertebral and upper thorax were consistently unreliable.  Whole-hand placement is necessary for hands-on data acquisition to be reliable.

Conclusion This study suggests there are specific volunteer idiosyncrasies that have contributed as confounding variables during inter-tester and intra-tester reliability studies.  A new methodology for screening volunteers is warranted to better inform human movement studies where hands-on data acquisition is used.

Keywords reliability studies, hands-on, manual screening, marker placement, data acquisition.

References:

  1. Viera AJ, Garrett JM. Understanding Interobserver Agreement: The Kappa Statistic. Family Medicine. 2005;37(5):3.
  2. Braun V, Clarke V. What can “thematic analysis” offer health and wellbeing researchers? Int J Qual Stud Health Well-being. 2014;9:26152.
dr jo abbott world congress 2019

International Federation of Manual and Musculoskeletal Physical Therapists Incorporated (IFOMPT) Conference (2024)

ifompt_2024 dr jo abbott

A multidisciplinary approach providing strong evidence for hands-on manual therapy as a valid measurement instrument in MSK healthcare.

Background:

Musculoskeletal (MSK) ill-health is the greatest socioeconomic burden for the World’s healthcare systems to manage.  Established in ancient history, manual therapy uses a hands-on approach (hereon in referred to as HODA-A, hands-on data acquisition and analysis) provides a safe, affordable, and environmentally convenient assessment and treatment of a person’s MSK system.  HODA-A is used to palpate characteristics of a person’s anatomy, becoming the measurement instrument that underpins the majority of MSK investigations conducted by MSK professionals in both MSK medicine (theory, research, and practice) and MSK clinical practice, often a prerequisite that informs a person’s care in many healthcare disciplines.

Purpose :
The existing evidence-based research investigating HODA-A, or studies that have used HODA-A as part of the methodology, are flawed because HODA-A lacks the necessary developmental studies to determine its validity as a measurement instrument.  For more than 70 years the evidence-based research has focused on reliability studies of HODA-A, concluding it is clinically unacceptable as a measurement instrument – further fuelling the hands-on/hands-off debate.  However, according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias (RoB) standards, validity studies must precede reliability studies on all proposed measurement instruments.  Therefore, to conduct reliability studies without the necessary ‘first-step’ validity studies on HODA-A constitutes a methodological flaw, is a waste of resources and unethical.  Worryingly, within the next 10 years, it is predicted an estimated 250 papers per annum will be published on HODA-A with the same fatal methodological flaws.

Methods:

Initially, a literature review exploring centuries of neurophysiological research, studying how to replicate the human hand for prosthesis and robotics sciences, provided strong evidence detailing five phases that occur when a person is tasked to interpret their active touch.  This information supported a later phenomenographic study using sixteen international expert panellists to explore the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™) of HODA-A when used as a measurement instrument in MSK healthcare. The information gained from these extensive studies was evaluated using the COSMIN RoB standards.

Results:

HODA-A uses eight constructs with associated items to conduct manual MSK assessments on a person, and HODA-A requires a complex system approach to understanding the relationships between the eight constructs and items underpinning HODA-A performance.

Conclusion(s):

For the first time in history HODA-A has been exposed to validity testing, offering substantial insights into the necessary measurement theories and conceptual framework needed for HODA-A to be used as a valid measurement instrument in MSK healthcare. Further research exposing HODA-A to COSMIN RoB standards continued.

Implications:

Reliability studies on HODA-A should only be conducted if the methodology of how HODA-A was applied met all the COSMIN RoB standards.

dr jo abbott ifompt 24

Finnish Sport Physiotherapy Association (SUFT) Congress (2025)

“SUFT Congress: The next best interventions”

Helsinki on 6-7th June 2025

@ National Olympic Training Center URHEA

Share This