There is a new scientific article which investigates whether psychedelic therapy is actually more effective than traditional antidepressants in treating depression when an important methodological issue – namely, unblinding – is taken into account.
In it, we discuss:
In studies of psychedelic therapy, participants often realise quite quickly whether they have been given an active psychedelic substance. As a result, these studies are, in practical terms, almost always open-label, even if they are formally designed as blind trials. The authors therefore concluded that psychedelic therapy should be compared more fairly with open-label antidepressant studies, as patients in both situations are equally aware of which treatment they are receiving.
The real focus of this article is therefore not on whether psychedelics work compared to a placebo, but on whether they work better than conventional antidepressants when the benefits derived from expectations and familiarity with the treatment are more evenly distributed. To this end, the authors conducted a systematic review and meta-analysis of studies involving adults with depression in an outpatient setting, without psychosis and without significant comorbidity.
The results show that, in this comparison, psychedelic therapy was no more effective than open-label conventional antidepressants. A total of 24 studies were included. Of these, 8 studies concerned psychedelic therapy, involving a total of 249 patients, and 16 studies concerned open-label antidepressants, involving a total of 7,921 patients. The estimated difference in improvement on the Hamilton Depression Rating Scale was 0.3 points in favour of the open-label antidepressants, but this difference was not statistically significant.
The analysis also shows that blinding does indeed make a difference in the case of traditional antidepressants. Open-label antidepressant trials showed better outcomes than blinded antidepressant trials. In the case of psychedelic therapy, however, the authors did not find this difference. According to them, this supports the idea that, in practice, psychedelic trials almost always turn out to be open-label, as participants and practitioners can usually guess quite accurately what has been administered.
It is important to note, however, that this article is not a new clinical trial, but a meta-analysis involving an indirect comparison of various studies. This means that differences in patient selection, study design, severity of depression and treatment context may still have an influence. The authors therefore do not conclude that psychedelic therapy does not work, but rather that the often highly optimistic claims regarding its superiority have probably been exaggerated.
In a nutshell: this article shows that psychedelic therapy for depression does not perform any better than open-label antidepressants when you take into account the fact that, in practice, psychedelic studies are almost never truly blinded. However, it is difficult to draw this conclusion with certainty, as various studies have been used interchangeably. For the time being, it does appear that psilocybin, in particular, performs better than SSRIs.
Importance: Trials of psychedelic-assisted therapy (PAT) involve a high degree of functional unblinding, which introduces bias into the results when comparing PAT with blinded interventions. As PAT is effectively always open-label, treatment outcomes should be compared with those of open-label traditional antidepressants (TADs), so that any potential benefits associated with patients knowing their treatment are comparable between the interventions.
Objective: To investigate the comparative effectiveness of PAT versus open-label traditional antidepressants (TADs; such as selective serotonin and noradrenaline reuptake inhibitors) for the treatment of major depression.
Data sources: A systematic search of PubMed was carried out in March 2024 to identify trials of PAT and open-label TADs for the treatment of major depression without comorbidity in adults without psychosis in an outpatient setting. Data extraction was supplemented with data from a review and meta-analysis of antidepressant drugs to assess the difference between open-label and blinded TADs.
Data extraction and synthesis: Depression scores were extracted by two independent reviewers; estimates were pooled using both Bayesian and frequentist mixed-effects models. The report complies with the PRISMA guidelines.
Main outcomes and measures: In line with predefined hypotheses, the mean within-arm effect from baseline to the primary endpoint (i.e. patient improvement between PAT and open-label TAD trials on the 17-item Hamilton Depression Rating Scale) was compared. To assess the potential role of blinding, the within-arm effect of blinded versus open-label trials in both PAT and TADs was also compared.
Results: Of the 619 PubMed records initially retrieved, 24 met the inclusion criteria. Contrary to the first of three hypotheses, PAT (8 trials; 249 patients) was no more effective than open-label TAD treatment (16 open-label TAD trials; 7,921 patients), with an estimated difference of 0.3 in favour of open-label TADs (95% CI, –1.39 to 1.98; P = 0.73). Open-label TADs were associated with better outcomes than blinded treatment (144 blinded TAD trials; 31,792 patients), with an estimated difference of 1.3 (95% CI, 0.07–2.51; P = 0.04); however, the same difference was not observed for PAT (0.67; 95% CI, –3.08 to 1.73; P = 0.58).
Conclusions and relevance: In trials of depression, PAT was no more effective than open-label TADs. Blinding made a difference for TADs, but not for PAT, confirming that PAT trials are, in effect, always open-label. These results challenge the highly optimistic narratives surrounding PAT and highlight the importance of maintaining the integrity of blinding.
Keywords: Psychedelic-assisted therapy; antidepressants; depression; meta-analysis; blinding; open-label; Hamilton Depression Rating Scale.
The conclusion drawn from articles of this kind sounds more definitive than it actually is. These usually involve indirect comparisons between different studies, rather than a single direct head-to-head trial. Furthermore, psychedelic therapy is not a single substance like an antidepressant, but a combination of experience, setting and guidance, which is difficult to compare fairly with daily medication. The fact that, on average, it appears to be “equally effective” does not therefore mean that it works in the same way or has the same long-term impact.