This short Devil is in the Detail post was inspired by the 1990 film Presumed Innocent, where the entire justice system hinges on the simple, but vital, principle that innocence is assumed until evidence proves otherwise.
Drug development should operate in much the same way. Yet time and time again, patients, clinicians, researchers and even drug sponsors can slip into a mindset where an investigational treatment is quietly treated as though it’s already ‘working’.
Hope becomes expectation, that expectation becomes narrative and that narrative begins to replace evidence.
Nothing could be further from the truth.
The statistical baseline for any new investigational drug is failure. The burden of proof is absolute. Just as the prosecution must prove guilt in a court of law, those developing a treatment must prove effectiveness through robust scientific evidence.
Effectiveness is not presumed. It must be earned.
That said, it is entirely understandable why patients, especially the newly diagnosed, might instinctively assume a treatment entering clinical trials is likely to work.
After all, we have never had this disease before.
Why would it be entering clinical trials?
Why would researchers dedicate years of their lives to it?
Why would investors fund it and companies stake their futures on it?
These are all reasonable questions I have heard. The brutal answer is that none of these questions require a drug to be effective, but only that there is enough evidence to justify testing it.
Human nature tends to fill in the gaps, especially when powerful financial, commercial and emotional pressures reward optimism. Many biotechnology companies operate in an environment where funding is scarce and future investment depends on maintaining momentum. That does not make the science invalid, but it can create incentives to promote promise long before proof exists, if ever.
As patients, this is something we should always keep in mind.
When an investigational treatment enters a prolonged hiatus, struggles to raise funding, repeatedly misses milestones or remains stuck in development for years, it is worth asking difficult questions. Not because we want a treatment to fail, but because we owe ourselves an honest assessment of the available evidence.
You’ll often hear phrases such as “encouraging”, “promising” or “cautiously optimistic”.
I personally dislike the first two but I am ok with the third.
Sometimes these phrases are justified, but sometimes not.
Having watched ALS/MND research for more than a decade, I’ve seen the very best of science. I’ve seen extraordinary dedication, innovation and progress.
I’ve also seen hype, weak evidence, selective messaging and enthusiasm that far exceeded the available data.
That experience has reinforced something important.
Clinical trials are experiments.
That is not a criticism. It is their purpose.
Some people describe trial participants as guinea pigs. I’ve never liked that characterisation. It overlooks the courage of those willing to contribute their time, energy and often their remaining months or years to scientific progress. Without trial participants, there is no evidence.
Without evidence, there is no progress.
The longer I have lived with this disease, the more I have also come to appreciate the need for rigorous regulation, independent oversight and robust scientific scrutiny.
Many patients initially view regulation as little more than bureaucracy standing between them and a potential treatment. In truth, it exists because history has repeatedly demonstrated what happens when standards are lowered.
That is not to say the system is perfect. Far from it. In the UK, for example, review and approval processes (post proof) can be painfully slow. MND desperately needs a more responsive and disease specific access pathway here. Processes can and should be streamlined but at the same time scientific standards must never be compromised.
In Presumed Innocent, the presumption of innocence protects people from being judged before the evidence has been weighed.
In drug development, the opposite presumption is the safer position.
Treating a therapy as “presumed effective” blinds us to noise, inflates weak signals and turns hope into pseudoscience.
The devil is always in the detail and the detail always says the same thing:
Until the data speaks, a drug is guilty of doing nothing.
That is the only presumption worth keeping.
.
