
Ben Goldacre
Saturday July 21, 2007
The Guardian
Excerpt:
When you know, deep down, that your intervention doesn't work, then you're not going to subject yourself to public exposure through a randomised trial. And if you really believe your policies are effective, then when the results come back negative you're simply going to argue that trials aren't the right way to test a policy. For some cod-philosophical reason or another.
Just like the quacks. Medicine, perhaps through the ubiquity of death, has learnt to accept failure better. Most of the drugs developed don't work either, but we don't say "let's stop bothering"; we say, "great, we've stopped wasting money and side effects on ineffective treatments".
But lastly, people will object, because even when you're subjecting citizens to an experimental new policy, flagging the uncertainty with a trial reinforces the uncertainty. This was a key issue with early trials in medicine, and we overcame our irksomeness decades ago, right up at the front of the game. The crucial early trials on surgical options for breast cancer were highly emotionally charged, but necessary, simply because the options were equipoised.
If we can do Randomized Control Trial's on something as horrifying as whether women have their breasts removed then we can do RCT's on social policy.
click to read full bad science column