Posts from September 2018 (22)

September 17, 2018

Briefly

  • Are we being misled by precision medicine? New York Times
  • When people search for a phrase that does not have natural informative results, it’s easy for manipulators to control the results. Take, for example, “did the Holocaust exist?” danah boyd on search and media manipulation
  • Should the Norfolk (UK) police be using a predictive model to decide whether a burglary is worth spending effort on? IEEE Spectrum is somewhat more negative than I would be.
  • Interesting piece at Slate about a story relating social media and hate crimes in Germany
  • Correlations can be confusing. This, from David Hood on Twitter, shows that countries where more people get the recommended amount of exercise have more deaths from heart disease, cancer, lung disease, diabetes.  That’s also what trends over time would say.  Presumably the (real) benefits of exercise are smaller than the benefits of wealth and modern health care, but it’s a neat example.   Note that this isn’t chance correlation in small samples with many variables to choose from, unlike the famous spurious correlations website

 

September 12, 2018

Tracking down the numbers

There was a story on Radio NZ last night, and then in other places

The research is the first in the world to measure the impact of taking numerous medications on fractures in the elderly.

Its findings show elderly people taking several high-risk medications for sleeping, pain or incontinence are twice as likely to fall and break bones as those taking no medication.

As the story says, overmedication in elderly people is known to be a problem — people get put on medications and then not taken off them, and there are interactions, and it’s not good.  Some — even many– of the drugs are necessary, of course, but these researchers aren’t the only people who think there should be more regular review of what all medications someone is taking.

This research is trying to quantify the impact on falls and fractures, using a large NZ data set of everyone in NZ who was being evaluated for publicly funded long-term community services or aged residential care.  Together with the high-quality NZ prescription data, it’s a good opportunity to look at a large enough group of people to measure fractures.

The media stories all seem to come from the Otago press release. The press release doesn’t include a link to the research paper. It doesn’t even give the journal name. The implication that no-one who reads the story could possibly care about the details is a bit insulting.

I’m assuming the research paper is this one, which is new and has the right topic and authors. The analysis is a bit tricky: a lot of people die without having fractures, and you have to decide how to count them in the denominator over time.  They did a sensible analysis, if not exactly the one I would have done.

There’s one problem, though: that paper says, in the Results section of the Abstract:

The estimated subhazard ratio was 1.52 (95% confidence interval: 1.28, 1.81) for those with DBI>3 compared with those with DBI=0 in the adjusted analysis.

That is, the paper’s best estimate is a 50% higher rate of fractures in people taking multiple potentially-risky drugs compared to none. 50% higher is still a problem — they estimate that about 1 in 8 fractures could be prevented if everyone could be taken off these drugs (which, of course, not every one can) — but 50% higher isn’t twice as high, and I couldn’t find the “twice as high” number in the paper.

September 11, 2018

NRL Predictions for Finals Week 2

Team Ratings for Finals Week 2

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Storm 7.16 16.73 -9.60
Roosters 7.01 0.13 6.90
Sharks 5.31 2.20 3.10
Rabbitohs 4.34 -3.90 8.20
Broncos 2.73 4.78 -2.10
Raiders 1.85 3.50 -1.70
Panthers 0.61 2.64 -2.00
Cowboys 0.13 2.97 -2.80
Dragons -0.31 -0.45 0.10
Warriors -0.74 -6.97 6.20
Bulldogs -0.82 -3.43 2.60
Titans -4.06 -8.91 4.90
Wests Tigers -5.43 -3.63 -1.80
Sea Eagles -5.47 -1.07 -4.40
Eels -5.98 1.51 -7.50
Knights -8.66 -8.43 -0.20

 

Performance So Far

So far there have been 196 matches played, 122 of which were correctly predicted, a success rate of 62.2%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Storm vs. Rabbitohs Sep 07 29 – 28 6.60 TRUE
2 Panthers vs. Warriors Sep 08 27 – 12 4.40 TRUE
3 Roosters vs. Sharks Sep 08 21 – 12 4.00 TRUE
4 Broncos vs. Dragons Sep 09 18 – 48 11.90 FALSE

 

Predictions for Finals Week 2

Here are the predictions for Finals Week 2. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Sharks vs. Panthers Sep 14 Sharks 4.70
2 Rabbitohs vs. Dragons Sep 15 Rabbitohs 4.70

 

Mitre 10 Cup Predictions for Round 5

Team Ratings for Round 5

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Canterbury 13.03 15.32 -2.30
Wellington 10.56 12.18 -1.60
Auckland 4.39 -0.50 4.90
North Harbour 3.25 6.42 -3.20
Taranaki 2.97 6.58 -3.60
Tasman 2.48 2.62 -0.10
Bay of Plenty 1.75 0.27 1.50
Otago 0.82 0.33 0.50
Waikato 0.51 -3.24 3.70
Counties Manukau -0.17 1.84 -2.00
Northland -2.89 -3.45 0.60
Manawatu -6.51 -4.36 -2.10
Hawke’s Bay -8.71 -13.00 4.30
Southland -23.66 -23.17 -0.50

 

Performance So Far

So far there have been 30 matches played, 19 of which were correctly predicted, a success rate of 63.3%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Waikato vs. Wellington Sep 05 43 – 31 -12.70 FALSE
2 Canterbury vs. Manawatu Sep 06 34 – 23 26.30 TRUE
3 Otago vs. Northland Sep 07 27 – 23 8.50 TRUE
4 Auckland vs. Tasman Sep 07 36 – 10 1.50 TRUE
5 Southland vs. Counties Manukau Sep 08 26 – 43 -20.00 TRUE
6 Hawke’s Bay vs. Bay of Plenty Sep 08 29 – 28 -8.10 FALSE
7 Wellington vs. North Harbour Sep 09 35 – 23 13.40 TRUE
8 Taranaki vs. Waikato Sep 09 19 – 33 13.20 FALSE

 

Predictions for Round 5

Here are the predictions for Round 5. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 North Harbour vs. Canterbury Sep 12 Canterbury -5.80
2 Waikato vs. Hawke’s Bay Sep 13 Waikato 13.20
3 Northland vs. Manawatu Sep 14 Northland 7.60
4 Tasman vs. Taranaki Sep 14 Tasman 3.50
5 Counties Manukau vs. Wellington Sep 15 Wellington -6.70
6 Southland vs. Otago Sep 15 Otago -20.50
7 North Harbour vs. Bay of Plenty Sep 16 North Harbour 5.50
8 Canterbury vs. Auckland Sep 16 Canterbury 12.60

 

Currie Cup Predictions for Round 5

Team Ratings for Round 5

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Note that Cheetahs2 refers the Cheetahs team when there is a Pro14 match. The assumption is that the team playing in the Pro14 is the top team and the Currie Cup team is essentially a second team.


Current Rating Rating at Season Start Difference
Western Province 6.10 4.66 1.40
Sharks 3.72 4.18 -0.50
Lions 3.53 3.23 0.30
Cheetahs 2.23 3.86 -1.60
Blue Bulls 0.81 0.94 -0.10
Pumas -8.38 -8.36 -0.00
Griquas -10.43 -9.78 -0.60
Cheetahs2 -28.85 -30.00 1.10

 

Performance So Far

So far there have been 11 matches played, 9 of which were correctly predicted, a success rate of 81.8%.
Here are the predictions for last week’s games.


Game Date Score Prediction Correct
1 Sharks vs. Pumas Sep 07 28 – 12 16.70 TRUE
2 Griquas vs. Blue Bulls Sep 08 40 – 45 -7.10 TRUE
3 Lions vs. Cheetahs2 Sep 08 47 – 14 37.60 TRUE

 

Predictions for Round 5

Here are the predictions for Round 5. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.


Game Date Winner Prediction
1 Lions vs. Western Province Sep 15 Lions 1.90
2 Griquas vs. Cheetahs2 Sep 15 Griquas 22.90
3 Blue Bulls vs. Pumas Sep 15 Blue Bulls 13.70

 

September 8, 2018

Screening for heart disease

Ben Goldacre on Twitter, about a “heart age test” that “has so far told eight in ten people that they are at higher risk of serious illness because their heart is prematurely aged.”

“that’s either a fumbled implementation turning coefficients into automated patient advice; or it’s a radical new NHS screening programme announced, oddly, only to individual members of the public, one by one, through an app”

Screening is always easy to sell, so it’s useful to remember a sound-bite: “Screening is the opposite of treatment: you come in healthy and go out sick”

September 7, 2018

Election polling experiment

From the New York Times

For the first time, we’ll publish our poll results and display them in real time, from start to finish, respondent by respondent. No media organization has ever tried something like this, and we hope to set a new standard of transparency. You’ll see the poll results at the same time we do. You’ll see our exact assumptions about who will turn out, where we’re calling and whether someone is picking up. You’ll see what the results might have been had we made different choices.

September 4, 2018

NRL Predictions for Finals Week 1

Team Ratings for Finals Week 1

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Storm 7.55 16.73 -9.20
Roosters 6.66 0.13 6.50
Broncos 5.67 4.78 0.90
Sharks 5.66 2.20 3.50
Rabbitohs 3.95 -3.90 7.80
Raiders 1.85 3.50 -1.70
Cowboys 0.13 2.97 -2.80
Warriors 0.01 -6.97 7.00
Panthers -0.14 2.64 -2.80
Bulldogs -0.82 -3.43 2.60
Dragons -3.25 -0.45 -2.80
Titans -4.06 -8.91 4.90
Wests Tigers -5.43 -3.63 -1.80
Sea Eagles -5.47 -1.07 -4.40
Eels -5.98 1.51 -7.50
Knights -8.66 -8.43 -0.20

 

Performance So Far

So far there have been 192 matches played, 119 of which were correctly predicted, a success rate of 62%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Rabbitohs vs. Wests Tigers Aug 30 51 – 10 7.70 TRUE
2 Warriors vs. Raiders Aug 31 20 – 16 2.40 TRUE
3 Storm vs. Panthers Aug 31 16 – 22 13.40 FALSE
4 Knights vs. Dragons Sep 01 14 – 24 -1.20 TRUE
5 Titans vs. Cowboys Sep 01 26 – 30 -0.70 TRUE
6 Eels vs. Roosters Sep 01 10 – 44 -5.70 TRUE
7 Bulldogs vs. Sharks Sep 02 18 – 30 -2.10 TRUE
8 Broncos vs. Sea Eagles Sep 02 48 – 16 11.20 TRUE

 

Predictions for Finals Week 1

Here are the predictions for Finals Week 1. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Storm vs. Rabbitohs Sep 07 Storm 6.60
2 Panthers vs. Warriors Sep 08 Panthers 4.40
3 Roosters vs. Sharks Sep 08 Roosters 4.00
4 Broncos vs. Dragons Sep 09 Broncos 11.90

 

Mitre 10 Cup Predictions for Round 4

Team Ratings for Round 4

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Canterbury 14.41 15.32 -0.90
Wellington 12.71 12.18 0.50
Taranaki 5.22 6.58 -1.40
Tasman 4.68 2.62 2.10
North Harbour 3.32 6.42 -3.10
Bay of Plenty 2.57 0.27 2.30
Auckland 2.19 -0.50 2.70
Otago 1.23 0.33 0.90
Counties Manukau 0.10 1.84 -1.70
Northland -3.30 -3.45 0.10
Waikato -3.96 -3.24 -0.70
Manawatu -7.89 -4.36 -3.50
Hawke’s Bay -9.53 -13.00 3.50
Southland -23.94 -23.17 -0.80

 

Performance So Far

So far there have been 22 matches played, 14 of which were correctly predicted, a success rate of 63.6%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Counties Manukau vs. Taranaki Aug 29 19 – 26 -0.30 TRUE
2 Auckland vs. Waikato Aug 30 35 – 17 8.40 TRUE
3 Wellington vs. Southland Aug 31 52 – 7 39.70 TRUE
4 Bay of Plenty vs. Canterbury Sep 01 19 – 31 -6.90 TRUE
5 Manawatu vs. Otago Sep 01 17 – 50 1.00 FALSE
6 North Harbour vs. Tasman Sep 01 20 – 32 5.90 FALSE
7 Hawke’s Bay vs. Counties Manukau Sep 02 25 – 29 -6.60 TRUE
8 Northland vs. Taranaki Sep 02 18 – 17 -5.10 FALSE

 

Predictions for Round 4

Here are the predictions for Round 4. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Waikato vs. Wellington Sep 05 Wellington -12.70
2 Canterbury vs. Manawatu Sep 06 Canterbury 26.30
3 Otago vs. Northland Sep 07 Otago 8.50
4 Auckland vs. Tasman Sep 07 Auckland 1.50
5 Southland vs. Counties Manukau Sep 08 Counties Manukau -20.00
6 Hawke’s Bay vs. Bay of Plenty Sep 08 Bay of Plenty -8.10
7 Wellington vs. North Harbour Sep 09 Wellington 13.40
8 Taranaki vs. Waikato Sep 09 Taranaki 13.20

 

Currie Cup Predictions for Round 4

Team Ratings for Round 4

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.
Note that Cheetahs2 refers the Cheetahs team when there is a Pro14 match. The assumption is that the team playing in the Pro14 is the top team and the Currie Cup team is essentially a second team.

Current Rating Rating at Season Start Difference
Western Province 6.10 4.66 1.40
Lions 3.90 3.23 0.70
Sharks 3.77 4.18 -0.40
Cheetahs 2.23 3.86 -1.60
Blue Bulls 0.98 0.94 0.00
Pumas -8.43 -8.36 -0.10
Griquas -10.60 -9.78 -0.80
Cheetahs2 -29.22 -30.00 0.80

 

Performance So Far

So far there have been 8 matches played, 6 of which were correctly predicted, a success rate of 75%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Pumas vs. Western Province Aug 31 28 – 57 -8.70 TRUE
2 Blue Bulls vs. Lions Sep 01 35 – 38 2.50 FALSE
3 Cheetahs2 vs. Sharks Sep 01 29 – 33 -30.10 TRUE

 

Predictions for Round 4

Here are the predictions for Round 4. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Sharks vs. Pumas Sep 07 Sharks 16.70
2 Griquas vs. Blue Bulls Sep 08 Blue Bulls -7.10
3 Lions vs. Cheetahs2 Sep 08 Lions 37.60