January 27, 2021

The 8% solution

There was a mysterious piece of vaccine news yesterday when German paper Handelsblatt claimed that the Oxford/AstraZeneca vaccine wasn’t going to be approved in Europe for people over 65 because it had only 8% efficacy in that group.  From the start, he claim of 8% efficacy was clearly either misquoted or misleadingly calculated, but it caused quite a bit of angst — and it is quite possible that the vaccine won’t be approved for older people

The problem is that the vaccine basically wasn’t tested in older people.  In contrast to the Moderna and Pfizer trials, the Oxford/AstraZeneca trials mostly recruited people under 55. The set of four trials reported in December had 428 people over 70, and fewer than 600 between 55 and 70.  Exactly none of these people had the low-dose first injection where the vaccine looked more effective. There’s more data from additional trials, eg in India, but still not very many older people recruited. In fact, about 8%* of all the trial participants were over 65.

Testing in older people is valuable because they’re the single most important group to vaccinate, and because the immune system changes with age.  It’s always possible that a vaccine will be less effective in older people, because they won’t generate as good an antibody response. In normal circumstances, a vaccine with trial data like this would probably be approved with some upper age limit — partly because of real uncertainty and partly because you want to discourage manufacturers from doing trials that don’t include the most important target populations.

Right now, though, we’re seriously short of vaccines. The trials confirm the Oxford/AstraZeneca vaccine does produce good concentrations of antibodies in older people, so there’s reason to expect it will prevent disease. As an additional encouragement, the two mRNA vaccines didn’t show any signs of being importantly less effective with age.  Soon there should be data from a Johnson & Johnson vaccine using the same basic technology as the Oxford vaccine, and it will be even more reassuring if that is effective in older people.  All in all, it wouldn’t be unreasonable to use the Oxford vaccine at least in the short term, but it’s not really surprising that there’s a controversy.

It is more surprising that Handelsblatt would get the facts so badly wrong.

Update:  An actual table with actual data has escaped on to the internet, saying that the point estimate for efficacy in 65+ year olds is 6.3%, with a confidence interval from -1400% to 94%. That is, the vaccine could make you 14 times more likely or 19 times less likely to get Covid, or anything in between. That still doesn’t really explain where the 8% number came from, but it does show the basic problem that there just isn’t direct information on efficacy in older people.  You have to either rely on the antibody levels, or not. 

 

 

* No, that apparently isn’t just a coincidence

avatar

Thomas Lumley (@tslumley) is Professor of Biostatistics at the University of Auckland. His research interests include semiparametric models, survey sampling, statistical computing, foundations of statistics, and whatever methodological problems his medical collaborators come up with. He also blogs at Biased and Inefficient See all posts by Thomas Lumley »

Comments

  • avatar
    Steve Curtis

    The political journalist involved with the story from Handlesblatt says his sources confirm the 8% numbers and its based on data supplied by AZ for the vaccine approval process and not that which is in other published sources.
    https://twitter.com/washingtonski?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor
    Maybe some one at AZ left a page out of their clinical data as it seems they now have provided more information.

    3 years ago

    • avatar
      Thomas Lumley

      We know there’s more information — from the trial in India, for a start. But there isn’t enough more data for them to possibly have good evidence that vaccine efficacy is below 10% in people over 65. That’s why it’s so annoying that they don’t say what they actually mean by the number. Is it a mistake? Is it a lower confidence interval? A point estimate? Who knows.

      3 years ago

      • avatar
        Thomas Lumley

        We *will* soon know from UK population data if the efficacy against serious disease is that low, though not if it’s, say, 40%.

        3 years ago

  • avatar
    Steve Curtis

    Further news about production hitches in EU vaccine plants has the EU fuming and expecting AZ to supply its vaccine anyway-which they havent formally approved yet, and leaked stories raised doubts over- even from the separate British contract.
    Its a reversal from the previous years ‘common view’ that UK would suffer from Brexit and being outside the EU medicines system. The EMA relocated from London to Amsterdam in 2019.

    3 years ago