From Efficacy to Effectiveness: Evaluating Psychedelic Randomized Controlled Trials for Trustworthy Evidence‐Based Policy and Practice
Pharmacology Research & Perspectives – April 01, 2025
Source: OpenAlex
Summary
The effectiveness of psychedelic therapies, like MDMA for PTSD, hinges on how they're regulated. Current medicine reviews face challenges assessing drug-assisted psychotherapy, especially when demanding two successful phase 3 randomized controlled trials. Issues with blinding and internal validity arise. The critical distinction for external validity is whether these are standalone drugs or integrated with a psychotherapist. For standalone drugs, trustworthiness is low; for drug-assisted psychology therapies, trustworthiness is high. Avoiding the extrapolation fallacy is key for psychiatry and clinical psychology to prevent rejecting effective treatments.
Abstract
ABSTRACT The recent review of a new drug application for MDMA‐assisted therapy for posttraumatic stress disorder by the United States' Food and Drug Administration (FDA) highlighted epistemological and methodological challenges for evidence assessments. Similar challenges will also be faced in reviews of other compounds in early‐ and late‐stage development, like psilocybin for depression. The regulatory demand for two successful phase 3 randomized controlled trials (RCTs) seems problematic, given a current lack of agreement on what constitutes “success”, particularly when psychoactive drug administration is concomitant with (psycho)therapy. These complex arrangements challenge the internal validity of estimated average treatment effect through comparison with conventional control conditions. This paper reviews the assumptions behind RCTs' current “gold‐standard” status in the hierarchy of evidence‐based medicine (EBM). Recapitulating known epistemic limits of randomization and blinding, it emphasizes the urgent need to avoid the extrapolation fallacy. The resulting argument is that the degree of trustworthiness that efficacy—reported in RCTs—will reliably predict effectiveness—in target populations outside RCTs—depends on what type of psychedelic treatments will be regulated. If “stand‐alone” drugs for large‐scale prescription and consumption, trustworthiness should be graded low. On the other hand, for regulation of drug‐assisted (psycho) therapies, the degree of trustworthiness can be considered high. The reason being that these two treatment approaches are based on different causal claims with distinct external validities. Therefore, careful assessment of support factors in each is recommended to prevent detrimental consequences, from potential rejection of effective therapies up to medical reversal of eventually approved drugs.