Statistical Inconsistency in ALS Trials: How Analysis Methods Skew Treatment Efficacy

Background

Amyotrophic lateral sclerosis (ALS) is a progressive neurodegenerative disorder with limited therapeutic options. The revised ALS Functional Rating Scale (ALSFRS-R) is the most widely used outcome measure in clinical trials to assess disability progression. However, the lack of standardized statistical methods for analyzing ALSFRS-R data has led to inconsistencies in trial conclusions, potentially affecting the validity and precision of treatment effect estimates.

Study Design

The study systematically identified 45 randomized, placebo-controlled ALS trials using ALSFRS-R as the primary endpoint, involving 7,338 patients. Researchers extracted data on statistical analysis approaches and missing data handling strategies. A simulation study assessed the impact of these methods on false-positive rates and statistical power using the Ceftriaxone trial dataset.

Key Findings

The analysis identified 39 distinct statistical methods, with 55.6% of trials failing to utilize all longitudinal ALSFRS-R measurements, leading to suboptimal data use and reduced precision. Treatment effect estimates varied widely, ranging from -1.33 to +2.33 SD differences depending on the analysis method. Alarmingly, 38.9% (95% CI 24.8%-55.1%) of methods increased false-positive rates, risking the advancement of ineffective treatments. Valid methods showed statistical power ranging from 17.9% to 78.2%, highlighting substantial variability in detection capability.

Expert Commentary

The choice of statistical method significantly influences trial conclusions, potentially misleading clinical decision-making and drug development. The study underscores the need for consensus recommendations to standardize ALSFRS-R analysis, improving trial comparability and accelerating the development of effective ALS therapies. Limitations include the focus on ALSFRS-R, though the findings likely apply to other disability rating scales in neurodegenerative disease trials.

Conclusion

This study reveals critical heterogeneity in ALS trial analyses that threatens the reliability of treatment effect estimates. Establishing standardized statistical approaches for disability scales could enhance trial validity, improve drug development efficiency, and ultimately benefit patients with ALS and other neurodegenerative diseases.

Funding and Registration

The original study was published in Neurology (2026;106:e214937) with PMID: 42013406. No specific funding information was provided in the abstract.