March 17, 2012

Faster-than-light neutrinos don’t replicate

This isn’t in the NZ media yet, but it will probably turn up soon.  A second CERN experiment, ICARUS,  has repeated the measurement of neutrino speed made by the famous OPERA experiment: the same neutrino source, the same distance, but different measurement equipment.   And the neutrinos arrived on-time, not 60ns early. Since the OPERA results violate relativity  and have other practical and theoretical problems , it’s not that hard to decide which set of numbers to believe.

As Prof. Matt Strassler says

This is the way it works in science all the time. A first experiment makes a claim that they see a striking and surprising effect. A second experiment tries to verify the effect and instead shows no sign of it. It’s commonplace. Research at the forefront of knowledge is much more difficult than people often realize, and mistakes and flukes happen on a regular basis. When something like this happens, physicists shrug and move on, unruffled and unsurprised.

 That’s why replication, reproducibility, and peer review are so important in science.  If your experiments are easy to run correctly and straightforward to interpret, you obviously aren’t working at the cutting edge.
March 16, 2012

Blink, and you’ll miss it

It’s not often that you see a special interest group make a claim about the economic impact of their chosen problem and think “I never imagined it could be so small”.

Today is, apparently, World Sleep Day, and we have a problem

A quarter of New Zealanders have a chronic sleep problem, according to the World Association of Sleep Medicine.

 That’s 15% with insomnia and `up to’ 9% with sleep apnea.  The  sleep docs go on to say

Studies by the World Association of Sleep Medicine show sleep disorders cost New Zealand at least 40 million dollars a year in lost productivity

A quarter of (working-age) New Zealanders is a bit under a million people, so that’s an average of about a buck a week, or about five minutes per sufferer per week at minimum wage.   Can lack of sleep really be that unimportant economically, or has someone dropped a decimal place somewhere?

The $8 billion iPod

Actual numbers from entertainment industry lawyers and lobbyists form the basis for this, frankly, unbelievable talk about Copyright Math(TM).

http://www.ted.com/talks/rob_reid_the_8_billion_ipod.html

While this talk may seem amusing, the figures he quotes are used to justify all sorts of real world implications for you and I. The Copyright (Infringing File Sharing) Amendment Act came into power last year, the US Embassy attempted to write Section 92A for New Zealand, and now new trade agreements are being negotiated.

Next time you see unbelievable claims, specifically of a numerical nature, question the figures.

And remember to insure your music collection. It’s worth billions.

March 15, 2012

NRL Predictions, Round 3

 

Team Ratings for Round 3

Here are the team ratings prior to Round 3, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Current Rating Rating at Season Start
Sea Eagles 9.70 9.83
Warriors 5.68 5.28
Broncos 4.78 5.57
Storm 4.71 4.63
Wests Tigers 3.84 4.52
Dragons 2.35 4.36
Knights 1.35 0.77
Bulldogs 1.18 -1.86
Rabbitohs -0.98 0.04
Roosters -1.30 0.25
Panthers -2.06 -3.40
Cowboys -2.63 -1.32
Eels -5.64 -4.23
Raiders -6.88 -8.40
Sharks -7.43 -7.97
Titans -10.40 -11.8

Performance So Far

So far there have been 16 matches played, 8 of which were correctly predicted, a success rate of 50%.

Here are the predictions for the games so far.

Game Date Score Prediction Correct
1 Knights vs. Dragons Mar 01 14 – 15 0.91 FALSE
2 Eels vs. Broncos Mar 02 6 – 18 -5.30 TRUE
3 Raiders vs. Storm Mar 03 19 – 24 -8.53 TRUE
4 Panthers vs. Bulldogs Mar 03 14 – 22 2.96 FALSE
5 Cowboys vs. Titans Mar 03 0 – 18 14.98 FALSE
6 Warriors vs. Sea Eagles Mar 04 20 – 26 -0.05 TRUE
7 Wests Tigers vs. Sharks Mar 04 17 – 16 16.99 TRUE
8 Rabbitohs vs. Roosters Mar 05 20 – 24 4.29 FALSE
9 Sea Eagles vs. Wests Tigers Mar 09 22 – 18 11.56 TRUE
10 Broncos vs. Cowboys Mar 09 26 – 28 14.56 FALSE
11 Titans vs. Raiders Mar 10 12 – 24 3.45 FALSE
12 Bulldogs vs. Dragons Mar 10 30 – 4 -0.99 FALSE
13 Sharks vs. Knights Mar 11 6 – 18 -2.81 TRUE
14 Roosters vs. Panthers Mar 11 0 – 18 9.69 FALSE
15 Storm vs. Rabbitohs Mar 11 24 – 10 9.47 TRUE
16 Eels vs. Warriors Mar 12 20 – 36 -5.07 TRUE

 

Predictions for Round 3

Here are the predictions for Round 3

Game Date Winner Prediction
1 Dragons vs. Wests Tigers Mar 16 Dragons 3.00
2 Knights vs. Broncos Mar 16 Knights 1.10
3 Titans vs. Storm Mar 17 Storm -10.60
4 Cowboys vs. Eels Mar 17 Cowboys 7.50
5 Warriors vs. Bulldogs Mar 18 Warriors 9.00
6 Roosters vs. Raiders Mar 18 Roosters 10.10
7 Panthers vs. Rabbitohs Mar 18 Panthers 3.40
8 Sharks vs. Sea Eagles Mar 19 Sea Eagles -12.60

Super 15 Predictions, Week 4


Team Ratings for Week 4

Here are the team ratings prior to Week 4, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Current Rating Rating at Season Start
Crusaders 7.65 10.46
Stormers 6.03 6.59
Bulls 5.17 4.16
Waratahs 3.99 4.98
Reds 3.29 5.03
Blues 2.99 2.87
Sharks 1.31 0.87
Chiefs 0.63 -1.17
Hurricanes 0.31 -1.90
Highlanders -3.22 -5.69
Cheetahs -4.36 -1.46
Force -6.44 -4.95
Brumbies -6.82 -6.66
Lions -9.78 -10.82
Rebels -14.08 -15.64

 

Performance So Far

So far there have been 21 matches played, 12 of which were correctly predicted, a success rate of 57.1%.
Here are the predictions for the games so far.

Game Date Score Prediction Correct
1 Blues vs. Crusaders Feb 24 18 – 19 -3.10 TRUE
2 Brumbies vs. Force Feb 24 19 – 17 2.80 TRUE
3 Bulls vs. Sharks Feb 24 18 – 13 7.80 TRUE
4 Chiefs vs. Highlanders Feb 25 19 – 23 9.00 FALSE
5 Waratahs vs. Reds Feb 25 21 – 25 4.40 FALSE
6 Stormers vs. Hurricanes Feb 25 39 – 26 13.00 TRUE
7 Lions vs. Cheetahs Feb 25 27 – 25 -4.90 FALSE
8 Chiefs vs. Blues Mar 02 29 – 14 -0.70 FALSE
9 Rebels vs. Waratahs Mar 02 19 – 35 -15.40 TRUE
10 Lions vs. Hurricanes Mar 02 28 – 30 -3.90 TRUE
11 Highlanders vs. Crusaders Mar 03 27 – 24 -10.40 FALSE
12 Reds vs. Force Mar 03 25 – 20 15.10 TRUE
13 Cheetahs vs. Bulls Mar 03 19 – 51 -1.40 TRUE
14 Stormers vs. Sharks Mar 03 15 – 12 10.00 TRUE
15 Crusaders vs. Chiefs Mar 09 19 – 24 14.70 FALSE
16 Force vs. Hurricanes Mar 09 19 – 46 2.50 FALSE
17 Brumbies vs. Cheetahs Mar 10 24 – 23 2.20 TRUE
18 Highlanders vs. Waratahs Mar 10 18 – 17 -3.40 FALSE
19 Reds vs. Rebels Mar 10 11 – 6 25.10 TRUE
20 Sharks vs. Lions Mar 10 32 – 20 16.30 TRUE
21 Bulls vs. Blues Mar 10 23 – 29 9.10 FALSE

 

Predictions for Week 4

Here are the predictions for Week 4. The prediction is my estimated points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Chiefs vs. Brumbies Mar 16 Chiefs 11.90
2 Stormers vs. Blues Mar 16 Stormers 7.50
3 Hurricanes vs. Highlanders Mar 17 Hurricanes 8.00
4 Waratahs vs. Force Mar 17 Waratahs 14.90
5 Sharks vs. Reds Mar 17 Sharks 2.50
6 Rebels vs. Cheetahs Mar 18 Cheetahs -5.20

 

 

Two for the price of one

Roy Morgan have released their “State of the Nation” report, and the Herald has two stories. In the first

According to the Roy Morgan State of the Nation March 2012 report, there has been an upsurge in the number of New Zealanders who consider Maori culture to be an “essential component” of New Zealand society.

 If a change from 52% to 61% is an upsurge, then yes, but the upsurge happened from 2001-2005.  Since 2006, the proportion has been flat at over 60%, as is clear from the Herald’s own graph:

The other story says that most of NZ wealth is now  held by over-55s.

the 55-plus group has increased its share of net wealth from 43 per cent in 2002 to 52 per cent last year.

that is, by about a quarter

Their share of the population also rose in the same period, but only from 19.5 per cent to 24.7 per cent.

or, about a quarter.   Based on these numbers, in 2002, the average net wealth for people over 55 was about 2.2 times higher than the average for everyone over 14, and it’s now about 2.1 times higher.  Since the story goes on to say

The value of their own homes accounted for 56 per cent of their wealth a decade ago, and 70 per cent last year.

presumably the ratio for non-home wealth is even less favorable to the over-55s.

 

Significant imperfections in cancer screening

The Herald did a good job itself in providing statistics to put today’s front-page story in context

BREAST CANCER

2700 number of new cases in 2008

624 number of deaths in 2008

8: number of women who had something unspecified wrong with their diagnosis, for reasons we don’t give, having unknown impact on their future health, in circumstances that are still being investigated but might not be exciting enough for the front page if we wait for the facts.

 

Prediction is hard, especially about buses?

The bus prediction system is potentially a very good idea — research in other cities has shown that it reduces actual waiting time, and reduces perceived waiting time even more.

Unfortunately, the illusory sense of control over one’s fate that the prediction system gives is easy to shatter.  This morning it was a stealth bus: arriving when it was allegedly still ten minutes away.   On other occasions the waiting time counts down steadily to DUE and then disappears, indicating that a ghost bus has gone by.

Bus prediction involves some hard engineering problems: the buses need to know where they are, they need to be able to tell the central office, and the central office needs to be able to get the information to transit users.  Fortunately, the first problem is solved by GPS (and odometers), the second by packet radio, and the third by the internet (and text-message gateways).

What remains is mostly a statistical problem, and partly a problem in applied psychology.    The data are fairly straightforward: the system knows approximately where the bus was every couple of minutes into the past, and this needs to be projected forward.   The Seattle MyBus project did a good job of implementing a simple version about ten years ago:  the prediction is a weighted average between where the bus would arrive at its current speed and when it should arrive by schedule, and the weights come from a large collection of actual bus trips.   There’s actually a lot more information available — for example, it’s hard to predict from a bus’s performance along Manukau Rd how long it will take to get through Newmarket, but since there’s a bus along Broadway every few minutes the system potentially has up-to-date information on congestion and crowding.

My guess, based on the relatively high frequency of buses that apparently go backwards, is that the Auckland system is a bit over-optimistic about how fast a late bus can return to schedule, and isn’t using the congestion information.  It also doesn’t seem to know which incoming bus will be running each route out of the city, so the city-center predictions can be a bit useless.  The real problem, though, is how to incorporate this uncertainty when presenting the results.   Even when you’re using all the available information there’s always prediction error, and sometimes a bus will stop transmitting information either for a few minutes or for its whole route.   In that case, the system has to fall back on the timetable, but the Auckland system doesn’t tell you it’s done that.

OneBusAway, in Seattle, distinguishes clearly between real predictions and timetable predictions. It also does helpful things like indicating which buses have just left, and it doesn’t seem to have ghost buses or stealth buses.  It’s also based on an open data stream that anyone can use — both the real-time bus location data and the predictions are accessible to anyone who wants to set up an improved system or just write a better app.

 

 

March 14, 2012

Big data in the papers

The New York Times has another article about the importance of `big data’ in the modern world:

GOOD with numbers? Fascinated by data? The sound you hear is opportunity knocking.

and in the UK, the Graudian’s DataBlog is asking “What is a data scientist?”, motivated by a conference in Califoria on “Making Data Work“.

 

March 12, 2012

Run along and play

The Herald (and others) are reporting the Milo State of Play survey, which says kids don’t play enough. In fact, the Herald says

The report outlines how a lack of play can deprive children of an activity crucial to healthy brain development.

Actually, it doesn’t. The report states that play is important to social development, and uses the phrase ‘prefrontal cortex’, but that’s all. Perfectly reasonable, since that’s not what the survey was about.  The survey (once you find the actual report than backs up the YouTube animation) used interviews of three samples: children, parents, grandparents to ask about activities and attitudes.  These were sampled in a nicely representative way, though from an online survey panel, so they may be more technologically aware and active than Kiwis as a whole.

According to the YouTube video, 96% of the participants agreed that active play was essential for development, and about half  (52%) of the parents, but less than half the children (40%)  or grandparents (31%), said children should have more playtime outside than they currently do.  That’s not really the impression that the story gives.

Some of the detailed findings are interesting:

More than half (56%) of parents think children enjoy playing games from their parents’ childhood. Where in fact, 96% of children state they do enjoy playing games from their parents’ youth.

and most children said they would like to spend more time playing with their parents.

The basic message of spending more time playing and having more unstructured time is one that has been promoted before, and seems sensible, but the report doesn’t really provide any more evidence for it than we had previously.

As a final note, the Herald story leads with

New Zealand children risk weight and brain development issues as a new study shows nearly half of Kiwi kids are not playing every day.

Is it just me that finds it ironic to get warnings like this from a survey sponsored by a multinational founded on selling chocolate and baby formula ?