Posts filed under General (3156)

September 9, 2013

Prevention vs cure

From Slate

The most important difference between the world today and 150 years ago isn’t airplane flight or nuclear weapons or the Internet. It’s lifespan. We used to live 35 or 40 years on average in the United States, but now we live almost 80. We used to get one life. Now we get two.

The medical developments in the story are important

  • Adrian’s lung spontaneously collapsed when he was 18.
  • Becky had an ectopic pregnancy that caused massive internal bleeding.
  • Carl had St. Anthony’s Fire, a strep infection of the skin that killed John Stuart Mill.*
  • Dahlia would have died delivering a child (twice) or later of a ruptured gall bladder.
  • David had an aortic valve replaced.
  • Hanna acquired Type 1 diabetes during a pregnancy and would die without insulin.
  • Julia had a burst appendix at age 14.
  • Katherine was diagnosed with pernicious anemia in her 20s. She treats it with supplements of vitamin B-12, but in the past she would have withered away.
  • Laura (that’s me) had scarlet fever when she was 2, which was once a leading cause of death among children but is now easily treatable with antibiotics.
  • Mitch was bitten by a cat  and had to have emergency surgery and a month of antibiotics or he would have died of cat scratch fever.

but also tend to emphasize treatment over cure.

For example,  St Anthony’s Fire and scarlet fever (both serious streptococcal infections) could kill, but only in a minority of cases. Type I diabetes and pernicious anemia used to be uniformly fatal, but Type I diabetes occurs in 1-25 per 100,000 and pernicious anemia in about 1 per 1000. Treatment of streptococcal infections was a breakthrough, and we should be really scared of the possibility than Strep. pyogenes finally learns how to beat penicillin, but they aren’t responsible for that much of the improvement in life expectancy.

Dehydration due to gastrointestinal disease, one of the really important killers of infants and children, isn’t mentioned, because the lack of it isn’t salient.  Hardly anyone says “I shouldn’t be alive now because I should have caught rotavirus or cholera at age 2 and died, but didn’t because of clean water, ”  but that’s probably the most important single change we have seen.

Prevention isn’t visible, but it’s still real.

September 7, 2013

How statistics is changing baseball

From the New York Times:

Statistical analysis has swept through baseball over the past decade, becoming part of the fabric of the game and an object of growing fascination to its fans. As players, managers and front office executives embrace the esoteric statistics, teams increasingly want their radio announcers just as fluent in the language of WAR, VORP and B.A.B.I.P.

Say what?

Read the full story here.

September 4, 2013

Currie Cup Predictions for Round 5

Team Ratings for Round 5

Here are the team ratings prior to Round 5, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Western Province 3.25 4.47 -1.20
Sharks 2.26 3.24 -1.00
Lions 1.92 -1.22 3.10
Cheetahs -0.66 -2.74 2.10
Blue Bulls -3.79 0.59 -4.40
Griquas -5.12 -6.48 1.40

 

Performance So Far

So far there have been 12 matches played, 5 of which were correctly predicted, a success rate of 41.7%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Lions vs. Western Province Aug 30 31 – 31 7.50 FALSE
2 Cheetahs vs. Griquas Aug 31 40 – 20 10.20 TRUE
3 Sharks vs. Blue Bulls Aug 31 34 – 18 13.00 TRUE

 

Predictions for Round 5

Here are the predictions for Round 5. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Griquas vs. Lions Sep 07 Griquas 0.50
2 Blue Bulls vs. Cheetahs Sep 07 Blue Bulls 4.40
3 Western Province vs. Sharks Sep 07 Western Province 8.50

 

NRL Predictions, Round 26

Team Ratings for Round 26

Here are the team ratings prior to Round 26, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Current Rating Rating at Season Start Difference
Storm 11.74 9.73 2.00
Sea Eagles 11.10 4.78 6.30
Roosters 9.86 -5.68 15.50
Rabbitohs 7.50 5.23 2.30
Cowboys 6.22 7.05 -0.80
Bulldogs 5.42 7.33 -1.90
Knights 1.92 0.44 1.50
Titans 0.65 -1.85 2.50
Warriors 0.58 -10.01 10.60
Sharks 0.03 -1.78 1.80
Panthers -5.92 -6.58 0.70
Broncos -6.38 -1.55 -4.80
Raiders -8.65 2.03 -10.70
Dragons -9.65 -0.33 -9.30
Wests Tigers -10.71 -3.71 -7.00
Eels -17.46 -8.82 -8.60

 

Performance So Far

So far there have been 184 matches played, 112 of which were correctly predicted, a success rate of 60.87%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Broncos vs. Knights Aug 30 18 – 26 -2.75 TRUE
2 Wests Tigers vs. Rabbitohs Aug 30 18 – 32 -13.64 TRUE
3 Warriors vs. Raiders Aug 31 50 – 16 8.66 TRUE
4 Bulldogs vs. Panthers Aug 31 34 – 14 14.80 TRUE
5 Sea Eagles vs. Storm Aug 31 28 – 8 -0.17 FALSE
6 Sharks vs. Cowboys Sep 01 18 – 31 1.13 FALSE
7 Roosters vs. Titans Sep 01 22 – 30 19.13 FALSE
8 Eels vs. Dragons Sep 02 26 – 22 -5.14 FALSE

 

Predictions for Round 26

Here are the predictions for Round 26. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Broncos vs. Bulldogs Sep 05 Bulldogs -7.30
2 Rabbitohs vs. Roosters Sep 06 Rabbitohs 2.10
3 Dragons vs. Warriors Sep 07 Warriors -5.70
4 Storm vs. Titans Sep 07 Storm 15.60
5 Cowboys vs. Wests Tigers Sep 07 Cowboys 21.40
6 Sea Eagles vs. Panthers Sep 08 Sea Eagles 21.50
7 Knights vs. Eels Sep 08 Knights 23.90
8 Raiders vs. Sharks Sep 08 Sharks -4.20

 

NZ tax/benefit system is moderately progressive

In the run up to the US election, there was a popular factoid to the effect that  50% of the US population paid no tax. This was, of course, untrue, but it could be arrived at by minor blurring of a true statement:  47% of tax units (family or individual) paid no net federal income tax.   The US has a strongly progressive federal income tax (more so than NZ), combined with a moderately regressive federal payroll tax and state and local taxes.  The average tax rate ranges from 17% for the poorest 20% of people, to 25% for the middle 20%, to 29% for the richest 1%. These figures are potentially misleading in the other direction, since they don’t count benefits, but the US benefit system is relatively limited and the figures for the middle 20% and up would not be appreciably different.

Doing this sort of calculation precisely is surprisingly difficult, because it’s not as easy as you might think to work out who really pays which taxes.  For example, you might assume that shoppers pay GST and land owners pay land taxes/rates, but in fact renters end up paying a chunk of the rates in increased rent, and retailers pay a small part of GST in reduced profits.   In New Zealand it’s probably a reasonable approximation to just count income tax and GST, and to assume these are effectively paid by earners and buyers.  It’s not a reasonable approximation to just count income tax — and publishing estimates of tax share that only use income tax and benefits, even if you do it with scrupulous accuracy, is likely to lead to the sort of misquotation that we saw in the US.

Over at pundit.co.nz, Rob Salmond does some calculations, and while I think the tone is unnecessarily inflammatory, the final numbers look plausible. The 10% highest-income households  get about 30% of the income and they (actually, ‘we’, I think) pay 43% of the net tax.  [Rob also mentions the highest-wealth 10% of families, implying incorrectly that these are the same people].

For comparison, in the US, it’s the highest-income 5% of the population that gets 35% of the income and they pay 37% of the tax. Since benefits are about 28% of US federal spending, they are about 18% of all taxes, and so the share of net taxes for the top 5% will be about 44%. NZ is both less unequal and has a slightly more progressive tax and transfer system (and we have a national health system, too).  In the other direction, we have more inequality and a less progressive tax and transfer system than, say, Sweden.

If we stipulate that a mix of income tax and GST, with few deductions, is what we’re working with, making the  tax system more progressive has obvious benefits in terms of reducing inequality, and costs in terms of reducing productivity.  Making this tradeoff is a policy issue rather than a technical one, and it’s perfectly reasonable for people to argue for their own positions as strongly as they can: inequality and productivity are worth arguing about.

On the other hand, if you’re going to use a relatively unnatural statistic based on income tax and benefits but not GST, aggregated in an unusual way, I think you have the responsibility to point out carefully  and explicitly that you’ve left out GST (and, ideally, explain why). Bill English said ” The 1.3 million households with incomes under $110,000 a year collectively pay no net tax—that is, their total income support payments match their combined income tax.” The clause before the dash is simply false. The clause after the dash is true, but I don’t think it’s a contribution to informed public debate.

August 28, 2013

NRL Predictions, Round 25

Team Ratings for Round 25

Here are the team ratings prior to Round 25, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Current Rating Rating at Season Start Difference
Storm 13.75 9.73 4.00
Roosters 12.57 -5.68 18.30
Sea Eagles 9.09 4.78 4.30
Rabbitohs 7.46 5.23 2.20
Bulldogs 4.90 7.33 -2.40
Cowboys 4.81 7.05 -2.20
Sharks 1.44 -1.78 3.20
Knights 1.39 0.44 1.00
Warriors -1.95 -10.01 8.10
Titans -2.06 -1.85 -0.20
Panthers -5.40 -6.58 1.20
Broncos -5.86 -1.55 -4.30
Raiders -6.11 2.03 -8.10
Dragons -8.74 -0.33 -8.40
Wests Tigers -10.68 -3.71 -7.00
Eels -18.37 -8.82 -9.50

 

Performance So Far

So far there have been 176 matches played, 108 of which were correctly predicted, a success rate of 61.36%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Rabbitohs vs. Bulldogs Aug 23 28 – 20 6.82 TRUE
2 Panthers vs. Broncos Aug 23 28 – 12 2.20 TRUE
3 Dragons vs. Wests Tigers Aug 24 18 – 34 12.05 FALSE
4 Titans vs. Warriors Aug 24 22 – 24 5.99 FALSE
5 Cowboys vs. Knights Aug 24 26 – 6 4.90 TRUE
6 Raiders vs. Sea Eagles Aug 25 22 – 36 -9.87 TRUE
7 Storm vs. Eels Aug 25 64 – 4 30.78 TRUE
8 Sharks vs. Roosters Aug 26 32 – 22 -10.79 FALSE

 

Predictions for Round 25

Here are the predictions for Round 25. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Broncos vs. Knights Aug 30 Knights -2.70
2 Wests Tigers vs. Rabbitohs Aug 30 Rabbitohs -13.60
3 Warriors vs. Raiders Aug 31 Warriors 8.70
4 Bulldogs vs. Panthers Aug 31 Bulldogs 14.80
5 Sea Eagles vs. Storm Aug 31 Storm -0.20
6 Sharks vs. Cowboys Sep 01 Sharks 1.10
7 Roosters vs. Titans Sep 01 Roosters 19.10
8 Eels vs. Dragons Sep 02 Dragons -5.10

 

Currie Cup Predictions for Round 4

This is proving to be an extremely unpredictable competition. The Lions absolutely thrashing the Bulls last weekend has resulted in a rankings jump for the Lions and a drop for the Bulls. Certainly the competition is harder to predict than the Australian NRL which in turn is harder to predict than the Super 15.

Team Ratings for Round 4

Here are the team ratings prior to Round 4, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Lions 2.59 -1.22 3.80
Western Province 2.57 4.47 -1.90
Sharks 1.99 3.24 -1.20
Cheetahs -1.54 -2.74 1.20
Blue Bulls -3.52 0.59 -4.10
Griquas -4.23 -6.48 2.30

 

Performance So Far

So far there have been 9 matches played, 3 of which were correctly predicted, a success rate of 33.3%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Cheetahs vs. Sharks Aug 23 15 – 18 5.50 FALSE
2 Griquas vs. Western Province Aug 24 19 – 20 1.10 FALSE
3 Blue Bulls vs. Lions Aug 24 23 – 62 10.20 FALSE

 

Predictions for Round 4

Here are the predictions for Round 4. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Lions vs. Western Province Aug 30 Lions 7.50
2 Cheetahs vs. Griquas Aug 31 Cheetahs 10.20
3 Sharks vs. Blue Bulls Aug 31 Sharks 13.00

 

August 21, 2013

Currie Cup Predictions for Round 3

Oh dear, mea culpa. I was alerted by Pierre du Plessis (pduplessis1@gmail.com) that my predictions were a bit bizarre and on checking I found I had entered an incorrect parameter value. Here are the correct predictions for this week. Note that the success probability below is what would have been obtained if I had entered the correct parameter value previously.
 

Team Ratings for Round 3

Here are the team ratings prior to Round 3, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Western Province 2.39 4.47 -2.10
Sharks 1.22 3.24 -2.00
Blue Bulls 0.91 0.59 0.30
Cheetahs -0.78 -2.74 2.00
Lions -1.84 -1.22 -0.60
Griquas -4.05 -6.48 2.40

 

Performance So Far

So far there have been 6 matches played, 3 of which were correctly predicted, a success rate of 50%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Sharks vs. Lions Aug 16 33 – 25 11.10 TRUE
2 Blue Bulls vs. Griquas Aug 16 15 – 9 13.90 TRUE
3 Western Province vs. Cheetahs Aug 17 15 – 14 12.80 TRUE

 

Predictions for Round 3

Here are the predictions for Round 3. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Cheetahs vs. Sharks Aug 23 Cheetahs 5.50
2 Griquas vs. Western Province Aug 24 Griquas 1.10
3 Blue Bulls vs. Lions Aug 24 Blue Bulls 10.20

 

NRL Predictions, Round 24

Team Ratings for Round 24

Here are the team ratings prior to Round 24, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Current Rating Rating at Season Start Difference
Roosters 14.65 -5.68 20.30
Storm 10.83 9.73 1.10
Sea Eagles 8.67 4.78 3.90
Rabbitohs 7.34 5.23 2.10
Bulldogs 5.02 7.33 -2.30
Cowboys 3.30 7.05 -3.70
Knights 2.90 0.44 2.50
Sharks -0.64 -1.78 1.10
Titans -1.26 -1.85 0.60
Warriors -2.75 -10.01 7.30
Broncos -4.48 -1.55 -2.90
Raiders -5.70 2.03 -7.70
Dragons -5.93 -0.33 -5.60
Panthers -6.78 -6.58 -0.20
Wests Tigers -13.48 -3.71 -9.80
Eels -15.45 -8.82 -6.60

 

Performance So Far

So far there have been 168 matches played, 103 of which were correctly predicted, a success rate of 61.31%.

Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Rabbitohs vs. Sea Eagles Aug 16 22 – 10 0.96 TRUE
2 Broncos vs. Eels Aug 16 22 – 12 16.84 TRUE
3 Raiders vs. Bulldogs Aug 17 16 – 28 -4.78 TRUE
4 Cowboys vs. Titans Aug 17 22 – 10 8.33 TRUE
5 Dragons vs. Sharks Aug 17 18 – 22 0.01 FALSE
6 Warriors vs. Panthers Aug 18 24 – 28 11.66 FALSE
7 Knights vs. Storm Aug 18 10 – 23 -1.04 TRUE
8 Wests Tigers vs. Roosters Aug 19 14 – 56 -19.04 TRUE

 

Predictions for Round 24

Here are the predictions for Round 24. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Rabbitohs vs. Bulldogs Aug 23 Rabbitohs 6.80
2 Panthers vs. Broncos Aug 23 Panthers 2.20
3 Dragons vs. Wests Tigers Aug 24 Dragons 12.10
4 Titans vs. Warriors Aug 24 Titans 6.00
5 Cowboys vs. Knights Aug 24 Cowboys 4.90
6 Raiders vs. Sea Eagles Aug 25 Sea Eagles -9.90
7 Storm vs. Eels Aug 25 Storm 30.80
8 Sharks vs. Roosters Aug 26 Roosters -10.80

 

August 20, 2013

Briefly

Diversity edition

  • Statistical classification (data mining, learning) algorithms will learn to match your classifications. Sometimes that’s not quite what you want
  • People are starting to comment more on entirely-male conference speaker lineups. Here’s a simple calculator for the probability distribution of number of people from some group (eg women), for a given proportion in the target population. For example, if you select 10 people from a population that’s 15% female, you should have only a 1/9 chance of not getting any women.
  • Map of scientific collaborations, based on co-authorship of books and papers. (click for a really big version)

collabolinks