There has been some debate following an article on Ed Yong’s blog on the need or otherwise for embargoes in science journalism stemming from a debate at the World Conference of Science Journalists, which in my opinion ignores a particular bugbear of mine regarding embargoes. Namely, mainstream organisations publicising science stories before the research is available to researchers with subscriptions to the journal it was published in.
Take this article from the BBC on Caffeine and Alzhemiers disease, for example. “Coffee ‘may reverse Alzheimer’s‘” says the headline, note the use of what Language Log calls ‘mendacity quotes‘, indicating that the headline probably does not reflect the content of the article. “Drinking five cups of coffee a day could reverse memory problems seen in Alzheimer’s disease (AD), US scientists say.” says the bolded standfirst, in an example of what I, lacking the the diplomacy of Language Log, call a lie. The article actually describes research on an Alzheimer’s disease model in mice noting that “The mice were given the equivalent of five 8 oz (227 grams) cups of coffee a day – about 500 milligrams of caffeine.“, so that’s mice, given a fixed dose of caffeine, not humans drinking five cups of coffee (cup of what – espresso, latte, weak American pseudo-coffee?). The article goes on to say “When the mice were tested again after two months, those who were given the caffeine performed much better on tests measuring their memory and thinking skills and performed as well as mice of the same age without dementia.“. Is this true? This would be remarkable. How can I find out? I could read the paper, unfortunately the BBC don’t link to the paper, just the journal, and it turns out the paper has not been published yet. The abstract is available and we know the research will be published in Volume 17 Number 3 of the Journal of Alzheimers Research but we don’t know the details beyond the abstract.
Gary W. Arendash, Takashi Mori, Chuanhai Cao, Malgorzata Mamcarz, Melissa Runfeldt, Alexander Dickson, Kavon Rezai-Zadeh, Jun Tan, Bruce A. Citron, Xiaoyang Lin, Valentina Echeverria, Huntington Potter
Caffeine Reverses Cognitive Impairment and Decreases Brain Amyloid-β Levels in Aged Alzheimer’s Disease Mice
Abstract: We have recently shown that Alzheimer’s disease (AD) transgenic mice given a moderate level of caffeine intake (the human equivalent of 5 cups of coffee per day) are protected from development of otherwise certain cognitive impairment and have decreased hippocampal amyloid-β (Aβ) levels due to suppression of both β-secretase (BACE1) and presenilin 1 (PS1)/g-secretase expression. To determine if caffeine intake can have beneficial effects in “aged” APPsw mice already demonstrating cognitive impairment, we administered caffeine in the drinking water of 18-19 month old APPsw mice that were impaired in working memory. At 4-5 weeks into caffeine treatment, those impaired transgenic mice given caffeine (Tg/Caff) exhibited vastly superior working memory compared to the continuing impairment of control transgenic mice. In addition, Tg/Caff mice had substantially reduced Aβ deposition in hippocampus (down 40%) and entorhinal cortex (down 46%), as well as correlated decreases in brain soluble Aβ levels. Mechanistically, evidence is provided that caffeine suppression of BACE1 involves the cRaf-1/NFκB pathway. We also determined that caffeine concentrations within human physiological range effectively reduce active and total glycogen synthase kinase 3 levels in SweAPP N2a cells. Even with pre-existing and substantial Aβ burden, aged APPsw mice exhibited memory restoration and reversal of AD pathology, suggesting a treatment potential of caffeine in cases of established AD.
To be fair to the BBC, the abstract does bring up the cup of coffee factoid, something the authors should be more careful about, but it does not say that the mice performed as well as those without dementia, only that they ‘exhibited memory restoration and reversal of AD pathology’, it does not put a value on that restoration and reversal.
This seems like interesting research, delaying or even reversing AD is an important outcome given an aging population and it would be fascinating if simple dietary methods, such as caffeine consumption, could have measurable effects. But this research does not show this in humans, it uses a mouse model of disease and, while it is interesting and important, represents just a small step forward in an understanding of an AD model – it does not justify caffeine consumption to prevent AD or justify the BBC headline. The BBC have put an inaccurate headline and inaccurate standfirst into the public domain prior to the research being available to journal subscribers. The public impression of this research is now likely to be at odds with the reality, not only that by privileging the media publication over the scientific publication the journal has concluded that the public should receive priority in receiving inaccurate interpretations of research over subscribers reading accurate representation. And they wonder why there is a problem with science communication?
[BPSDB]




It is clear that the while the initial pool of participants was 332, only 315 of these took part in the study, despite the abstract appearing to claim otherwise. Now it is perfectly normal for subjects to be excluded from any medical study for any number of reasons and the small number of participants lost will not affect the validity of the results, the lack of control see to that, but it is an unfortunate proofreading error. Of course one should be willing to accept a small amount of human failing in data presentation and occasional lapses are forgivable. However, there are several other such lapses in the abstract.
You will of course notice that the data given in the abstract for Acute OM, 4.0±1.03 varies slightly from that given in Table 15, 4.09±1.03 – the 9 has been left off. Rounding of the digits is not a plausible explanation as the error is given to two decimal points (and oddly some numbers are given to one decimal point while the error is given to two). A lack of proofreading seems to be the case. These errors continue with respect to the normalization data:
I hope the BCA did read this paper prior to issuing their plethora. To claim that “there is actually a significant amount” of evidence supporting chiropractic without actually having read it would indicate that their position on the stupidity spectrum is perilously close to moving from visibly stupid to ultra stupid.
