Posts from September 2015 (45)

September 30, 2015

Three strikes: some evidence (updated)

Update: the data Graeme Edgeler was given didn’t mean what he (reasonably) thought they meant and this analysis is no longer operative. There isn’t good evidence that the law has any substantial beneficial effect.  See Nikki Macdonald’s story at Stuff and Graeme’s own post at Public Address.

The usual objection to a “three-strikes” law imposing life sentences without parole, in addition to the objections against severe mandatory minimums, is

  • It doesn’t work; or
  • It doesn’t work well enough given the injustice involved; or
  • There isn’t good enough evidence that it works well enough given the potential for injustice involved.

New Zealand’s version of the law is much less bad than the US versions, but there are still both real problems, and theoretical problems (robbery and aggravated burglary both include crimes of a wide range of severity).

Graeme Edgeler (who is not an enthusiast for the law) has a post at Public Address arguing that there is, at least, evidence of a reduction in subsequent offending by people who receive a first-strike warning, based a mixture of published data and OIA requests.

Here’s his data in tabular form, showing second convictions for offences that would qualify under the three-strikes law. The red cell is ‘first strike’ convictions, the other rows did not count as strikes because the law isn’t retrospective.

Offence Conviction Number Second conviction Number
7/05-6/10 7/05-6/10 6809 7/05-6/10 256
Before 7/10 7/10-6/15 2437 7/10-1/15 300
7/10-6/15 7/10-6/15 5422 7/10-6/15 81

 

The first and last rows are directly comparable five-year periods. Offences that now qualify as ‘strikes’ are down 20% in the last five-year period; second convictions are down a further 62%. Data in the middle row isn’t as comparable, but there is at least no apparent support for a general reduction in reoffending in the last five-year period.

The overall 20% decrease could easily be explained as part of the long-term trends in crime, but the extra decrease in second-strike offences can’t be.  It’s also much larger than could be expected from random variation. The law isn’t keeping violent criminals off the streets, but it does seem to be deterring second offences.

Reasonable people could still oppose the three-strikes law (and Graeme does) but unless we have testable alternative explanations for the large, selective decrease, we should probably be looking at arguments that the law is wrong in principle, not that it’s ineffective.

 

NRL Prediction for the Grand Final

Team Ratings for the Grand Final

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Roosters 11.74 9.09 2.60
Cowboys 10.82 9.52 1.30
Broncos 10.28 4.03 6.20
Storm 4.79 4.36 0.40
Bulldogs 1.51 0.21 1.30
Sea Eagles 0.46 2.68 -2.20
Dragons -0.09 -1.74 1.60
Rabbitohs -0.24 13.06 -13.30
Raiders -1.13 -7.09 6.00
Sharks -1.65 -10.76 9.10
Panthers -2.78 3.69 -6.50
Eels -5.07 -7.19 2.10
Wests Tigers -5.16 -13.13 8.00
Knights -5.46 -0.28 -5.20
Warriors -7.47 3.07 -10.50
Titans -9.20 -8.20 -1.00

 

Performance So Far

So far there have been 200 matches played, 118 of which were correctly predicted, a success rate of 59%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Broncos vs. Roosters Sep 25 31 – 12 -1.20 FALSE
2 Storm vs. Cowboys Sep 26 12 – 32 -0.30 TRUE

 

Predictions for the Grand Final

Here are the predictions for the Grand Final. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Broncos vs. Cowboys Oct 04 Cowboys -0.50

 

ITM Cup Predictions for Round 8

Team Ratings for Round 8

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Taranaki 10.96 7.70 3.30
Canterbury 10.82 10.90 -0.10
Tasman 10.14 12.86 -2.70
Auckland 6.95 5.14 1.80
Hawke’s Bay 4.24 -0.57 4.80
Wellington 3.91 -4.62 8.50
Counties Manukau 2.45 7.86 -5.40
Otago 1.46 -4.84 6.30
Waikato -4.82 -6.96 2.10
Bay of Plenty -5.27 -9.77 4.50
Manawatu -7.01 -1.52 -5.50
North Harbour -9.60 -10.54 0.90
Southland -11.20 -6.01 -5.20
Northland -17.01 -3.64 -13.40

 

Performance So Far

So far there have been 54 matches played, 38 of which were correctly predicted, a success rate of 70.4%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Canterbury vs. Waikato Sep 23 18 – 17 24.30 TRUE
2 Hawke’s Bay vs. Auckland Sep 24 17 – 12 0.50 TRUE
3 Northland vs. Bay of Plenty Sep 25 5 – 37 -2.40 TRUE
4 Counties Manukau vs. Tasman Sep 26 42 – 33 -6.50 FALSE
5 Otago vs. Southland Sep 26 61 – 7 8.50 TRUE
6 Manawatu vs. North Harbour Sep 26 31 – 17 5.00 TRUE
7 Waikato vs. Wellington Sep 27 14 – 21 -6.30 TRUE
8 Canterbury vs. Taranaki Sep 27 21 – 24 7.50 FALSE

 

Predictions for Round 8

Here are the predictions for Round 8. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Wellington vs. Hawke’s Bay Sep 30 Wellington 3.70
2 North Harbour vs. Otago Oct 01 Otago -7.10
3 Waikato vs. Counties Manukau Oct 02 Counties Manukau -3.30
4 Tasman vs. Canterbury Oct 03 Tasman 3.30
5 Manawatu vs. Taranaki Oct 03 Taranaki -14.00
6 Auckland vs. Northland Oct 03 Auckland 28.00
7 Southland vs. Hawke’s Bay Oct 04 Hawke’s Bay -11.40
8 Bay of Plenty vs. Wellington Oct 04 Wellington -5.20

 

Currie Cup Predictions for Round 9

Team Ratings for Round 9

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Lions 5.79 3.04 2.70
Western Province 5.32 4.93 0.40
Blue Bulls 1.91 0.17 1.70
Sharks 1.09 3.43 -2.30
Cheetahs -2.37 -1.75 -0.60
Pumas -6.95 -6.47 -0.50
Griquas -9.19 -7.81 -1.40
Kings -9.50 -9.44 -0.10

 

Performance So Far

So far there have been 32 matches played, 23 of which were correctly predicted, a success rate of 71.9%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Sharks vs. Blue Bulls Sep 25 13 – 17 3.40 FALSE
2 Cheetahs vs. Lions Sep 26 31 – 73 -3.10 TRUE
3 Western Province vs. Pumas Sep 26 50 – 19 15.00 TRUE
4 Kings vs. Griquas Sep 26 40 – 37 3.20 TRUE

 

Predictions for Round 9

Here are the predictions for Round 9. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Lions vs. Western Province Oct 02 Lions 4.00
2 Blue Bulls vs. Kings Oct 02 Blue Bulls 14.90
3 Pumas vs. Cheetahs Oct 03 Cheetahs -1.10
4 Griquas vs. Sharks Oct 03 Sharks -6.80

 

September 29, 2015

When variation is the story

A familiar trope of alternative cancer therapy is the patients who were given just months to live and are still alive years later.  The implication is that their survival is surprising and the cancer therapy was responsible.  Falling foul of the post hoc ergo propter hoc fallacy isn’t the big problem here. The big problem is that it’s not surprising that some people live a lot longer than the median.

Our intuition for variation is developed on measurements that aren’t like cancer survival. Most adults are pretty close to the average height — very few are more than a foot taller or shorter. Most people in Western countries die at close to the average age: for example, by the NZ life tables, the median life expectancy for NZ men born now is 81 years, and the tables predict half will die between 73 and 88 years.

For many types of cancer, survival isn’t like that. Here’s a graph from a big Canadian study of breast cancer

F1.large

The median survival for women with stage IV cancer in this group is about a year; half of them are still alive after a year. About half of those are still alive after two years; about half of those are still alive after three years, and some live much longer.

Variation in cancer survival — the long tail — should be welcome, but not surprising. Some people will be alive three, four, five or more years after ‘being given a year to live’.  We should be just as cautious about crediting them with finding a cure as we should be about blaming those who died sooner.

 

September 28, 2015

Rugby World Cup Predictions, 29 September 2015 to 03 October 2015

It is a little difficult to choose a period for the predictions. I have predicted up to October 3 because Tonga plays a further game on October 4, and I want to have updated their rating based on the result of the Tonga-Namibia game before predicting their game against Argentina.

Team Ratings at 29 September

The basic method is described on my Department home page.

Here are the team ratings prior to 29 September along with the ratings at the start of the Rugby World Cup.

Rating at 29 September Rating at RWC Start Difference
New Zealand 27.38 29.01 -1.60
South Africa 21.98 22.73 -0.70
Australia 20.47 20.36 0.10
Ireland 17.72 17.48 0.20
England 17.29 18.51 -1.20
Wales 14.10 13.93 0.20
France 11.53 11.70 -0.20
Argentina 9.03 7.38 1.60
Scotland 6.00 4.84 1.20
Fiji -3.23 -4.23 1.00
Samoa -3.54 -2.28 -1.30
Italy -6.93 -5.86 -1.10
Tonga -7.23 -6.31 -0.90
Japan -10.61 -11.18 0.60
USA -15.69 -15.97 0.30
Georgia -17.57 -17.48 -0.10
Canada -18.06 -18.06 -0.00
Romania -20.20 -21.20 1.00
Uruguay -31.10 -31.04 -0.10
Namibia -34.63 -35.62 1.00

 

Performance So Far

So far there have been 19 matches played, 16 of which were correctly predicted, a success rate of 84.2%.
Here are the predictions for previous games.

Game Date Score Prediction Correct
1 England vs. Fiji Sep 18 35 – 11 29.20 TRUE
2 Tonga vs. Georgia Sep 19 10 – 17 11.20 FALSE
3 Ireland vs. Canada Sep 19 50 – 7 35.50 TRUE
4 South Africa vs. Japan Sep 19 32 – 34 33.90 FALSE
5 France vs. Italy Sep 19 32 – 10 17.60 TRUE
6 Samoa vs. USA Sep 20 25 – 16 13.70 TRUE
7 Wales vs. Uruguay Sep 20 54 – 9 51.50 TRUE
8 New Zealand vs. Argentina Sep 20 26 – 16 21.60 TRUE
9 Scotland vs. Japan Sep 23 45 – 10 14.40 TRUE
10 Australia vs. Fiji Sep 23 28 – 13 24.10 TRUE
11 France vs. Romania Sep 23 38 – 11 33.30 TRUE
12 New Zealand vs. Namibia Sep 24 58 – 14 64.00 TRUE
13 Argentina vs. Georgia Sep 25 54 – 9 24.60 TRUE
14 Italy vs. Canada Sep 26 23 – 18 12.50 TRUE
15 South Africa vs. Samoa Sep 26 46 – 6 23.90 TRUE
16 England vs. Wales Sep 26 25 – 28 11.20 FALSE
17 Australia vs. Uruguay Sep 27 65 – 3 50.30 TRUE
18 Scotland vs. USA Sep 27 39 – 16 21.40 TRUE
19 Ireland vs. Romania Sep 27 44 – 10 38.80 TRUE

 

Predictions for 29 September to 03 October

The prediction is my estimated expected points difference with a positive margin being a win to the first-named team, and a negative margin a win to the second-named team.

Game Date Winner Prediction
1 Tonga vs. Namibia Sep 29 Tonga 27.40
2 Wales vs. Fiji Oct 01 Wales 23.80
3 France vs. Canada Oct 01 France 29.60
4 New Zealand vs. Georgia Oct 02 New Zealand 44.90
5 Samoa vs. Japan Oct 03 Samoa 7.10
6 South Africa vs. Scotland Oct 03 South Africa 16.00
7 England vs. Australia Oct 03 England 3.30

 

Popeye, mānuka, and keeping healthy

  • Good story in the Herald: A survey from Southern Cross Health Insurance estimates that about 750,000 people in NZ regularly take vitamins and dietary supplements. Contrary to what some supporters say, there have been quite a lot of randomised trials of vitamin supplements — it’s just that they tend to give disappointing results.  There are a few exceptions (such as folate in pregnancy) and a few arguably open questions (such as higher-dose vitamin D) but not many.
  • Entertaining legal report in NBR: NZ Honey is fighting the Ministry for Primary Industries over whether it makes unsupported health claims for mānuka honey. The fun part is that the controversy isn’t whether there’s evidence for health benefits, it’s over whether brand names such as “Manuka Doctor” and “Manuka Pharm” are so clearly just puffery that no-one would mistake them for health claims
  • People often claim spinach is very high in iron. Other people often claim this is due to a misplaced decimal point in early German research, and that Popeye didn’t know what he was talking about and spinach is a terrible source of iron. Still other people look into this more carefully and find that the error was not German, or a misplaced decimal point, and that Popeye’s health claims weren’t iron-related. In the end, spinach actually is a moderately good source of iron. (Karl Kruszelnicki, ABC Science)

Seeing the margin of error

A detail from Andrew Chen’s visualisation of all the election polls in NZ:

polls

His full graph is somewhat interactive: you can zoom in on times, select parties, etc. What I like about this format is how clear it makes the poll-to-poll variability.  The poll result for, say, National isn’t a line, it’s a cloud of uncertainty.

The cloud of uncertainty gets narrower for minor parties (as detailed in my cheatsheet), but for the major parties you can see it span an entire 10-percentage-point grid cell or more.

Stat of the Week Competition: September 26 – October 2 2015

Each week, we would like to invite readers of Stats Chat to submit nominations for our Stat of the Week competition and be in with the chance to win an iTunes voucher.

Here’s how it works:

  • Anyone may add a comment on this post to nominate their Stat of the Week candidate before midday Friday October 2 2015.
  • Statistics can be bad, exemplary or fascinating.
  • The statistic must be in the NZ media during the period of September 26 – October 2 2015 inclusive.
  • Quote the statistic, when and where it was published and tell us why it should be our Stat of the Week.

Next Monday at midday we’ll announce the winner of this week’s Stat of the Week competition, and start a new one.

(more…)

Stat of the Week Competition Discussion: September 26 – October 2 2015

If you’d like to comment on or debate any of this week’s Stat of the Week nominations, please do so below!