Stats Chat

Each week, we would like to invite readers of Stats Chat to submit nominations for our Stat of the Week competition and be in with the chance to win an iTunes voucher.

Here’s how it works:

• Anyone may add a comment on this post to nominate their Stat of the Week candidate before midday Friday June 21 2013.
• Statistics can be bad, exemplary or fascinating.
• The statistic must be in the NZ media during the period of June 15 – 21 2013 inclusive.
• Quote the statistic, when and where it was published and tell us why it should be our Stat of the Week.

Next Monday at midday we’ll announce the winner of this week’s Stat of the Week competition, and start a new one.

(more…)

Team Ratings for Round 18

This year the predictions have been slightly changed with the help of a student, Joshua Dale. The home ground advantage now is different when both teams are from the same country to when the teams are from different countries. The basic method is described on my Department home page.

Here are the team ratings prior to Round 18, along with the ratings at the start of the season.

Performance So Far

So far there have been 103 matches played, 70 of which were correctly predicted, a success rate of 68%.

Here are the predictions for last week’s games.

Predictions for Round 18

Here are the predictions for Round 18. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Kieran Healy uses data from the time of the American Revolution to show how membership of organisations can be turned into social network information

Rest assured that we only collected metadata on these people, and no actual conversations were recorded or meetings transcribed. All I know is whether someone was a member of an organization or not. Surely this is but a small encroachment on the freedom of the Crown’s subjects. I have been asked, on the basis of this poor information, to present some names for our field agents in the Colonies to work with. It seems an unlikely task.

If you want to follow along yourself, there is a secret repository containing the data and the appropriate commands for your portable analytical engine.

You may well already have seen this, but I’ve been travelling.

Team Ratings for Round 14

Here are the team ratings prior to Round 14, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Performance So Far

So far there have been 99 matches played, 60 of which were correctly predicted, a success rate of 60.61%.

Here are the predictions for last week’s games.

Predictions for Round 14

Here are the predictions for Round 14. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

This morning sometime after 11am, I’ll be talking on Radio New Zealand’s Nine to Noon programme about one of the Department’s projects, CensusAtSchool. I’ll post a link to the interview recording once it’s online.

CensusAtSchool runs biennial surveys online to get data of interest to Year 5-13 students by asking them questions about themselves. This data then feeds into the teaching and learning about statistics. The surveys produce data about kids, from kids, for kids – to enrich their learning about how to collect, explore and analyse data.

The project also goes much further and provides support to teachers across all dimensions of teaching statistics in schools in New Zealand.

For more, see the CensusAtSchool website.

Update:

Each week, we would like to invite readers of Stats Chat to submit nominations for our Stat of the Week competition and be in with the chance to win an iTunes voucher.

Here’s how it works:

• Anyone may add a comment on this post to nominate their Stat of the Week candidate before midday Friday June 14 2013.
• Statistics can be bad, exemplary or fascinating.
• The statistic must be in the NZ media during the period of June 8 – 14 2013 inclusive.
• Quote the statistic, when and where it was published and tell us why it should be our Stat of the Week.

Next Monday at midday we’ll announce the winner of this week’s Stat of the Week competition, and start a new one.

(more…)

In the Herald, in late May, there was a commentary on the importance of freeing-up the GCSB to do more surveillance. Aaron Lim wrote

The recent bombings at the Boston Marathon are a vivid example of the fragmented nature of modern warfare, and changes to the GCSB legislation are a necessary safeguard against a similar incident in New Zealand.

 …

Ceding a measure of privacy to our intelligence agencies is a small price to pay for safe-guarding the country against a low-probability but high-impact domestic incident.

Unfortunately for him, it took only a couple of weeks for this to be proved wrong: in the US, vastly more information was being routinely collected, and it did nothing to prevent the Boston bombing.  Why not?  The NSA and FBI have huge resources and talented and dedicated staff, and have managed to hook into a vast array of internet sites. Why couldn’t they stop the Tsarnaevs, or the Undabomber, or other threats?

The statistical problem is that terrorism is very rare.  The IRD can catch tax evaders, because their accounts look like the accounts of many known tax evaders, and because even a moderate rate of detection will help deter evasion.  The banks can catch credit-card fraud, because the patterns of card use look like the patterns of card use in many known fraud cases, and because even a moderate rate of detection will help deter fraud.  Doctors can predict heart disease, because the patterns of risk factors and biochemical meausurements match those of many known heart attacks, and because even a moderate level of accuracy allows for useful gains in public health.

The NSA just doesn’t have that large a sample of terrorists to work with.  As the FBI pointed out after the Boston bombing, lots of people don’t like the United States, and there’s nothing illegal about that.  Very few of them end up attempting to kill lots of people, and it is so rare that there aren’t good patterns to match against.   It’s quite likely that the NSA can do some useful things with the information, but it clearly can’t stop `low-probability, high-impact domestic incidents’, because it doesn’t.  The GCSB is even more limited, because it’s unlikely to be able to convince major US internet firms to hand over data or the private keys needed to break https security.

Aaron Lim’s piece ended with the typical surveillance cliche

And if you have nothing to hide from the GCSB, then you have nothing to fear

Computer security expert Bruce Schneier has written about this one extensively, so I’ll just add that if you believe that, you can easily deduce Kristofferson’s Corollary

Freedom’s just another word for nothing left to lose.

Mathew Dearnaley, in the Herald, has a story today about dangerous roads where he observes that the largest number of deaths is in the Auckland region, but immediately points out that what matters is the individual risk, estimated by fatalities per million km travelled.  We’ve been over this point quite a lot on StatsChat, so it’s great to see proper use of denominators in public.

When you divide by total distance travelled, to get a fair comparison, it  turns out that Gisborne has the most dangerous roads, followed by Taranaki, and that Auckland, like Wellington, is relatively safe.

Although Waikato roads claimed 66 lives – more than a fifth of a national toll of 308 deaths – the odds of being among the 10 people who died in crashes between the Wharerata Hills south of Gisborne and East Cape were almost twice as high as in the busier northern region.

One problem with the story is the issue of random variation.  According to NZTA, Hawkes Bay and Gisborne together had a total of 16 deaths last year, up from 8 the previous year.  There’s a lot of noise in these numbers, and even though the story sensibly looked at serious injuries as well, it’s hard to tell how much of the difference between regions is real and how much is chance.

It would be helpful to add up data over multiple years, though even then there is a problem, since we know that road deaths decreased noticeably in mid-2010, and this decrease may not have been uniform across regions.

Joshua Katz, a statistics PhD student at North Carolina State University, has produced a beautiful set of maps of US dialect.  He used data from the Dialect Survey conducted by Bruce Vaux, of Harvard University.

As an example, people in various parts of the US were asked about their generic name for sweetened carbonated soft drinks: soda, pop, or coke.

The original maps by Prof Vaux were closer to the data, since they showed dots for individual respondents, but they have visual artifacts due to population density — the clear vertical edge running north from Texas is a rainfall threshold, not a dialect boundary.

While looking into mobile internet options for a trip to Europe, I saw an ad for one of those products that’s supposed to stop dangerous mobile-phone radiation — as usual, it probably wouldn’t work even if dangerous mobile-phone radiation existed.

The company (which is in NZ), says

Cellguard® uses Frequency Infused Technology (FIT) which works to enhance the Bio energy function of the body.

With enhanced Bio energy function your body is better able to maintain an optimum state of wellbeing and significantly reduce the impact of the considered effects of mobile phone use.

which I think qualifies as “not even false”.  They also sell a product that is supposed to improve the acid/alkaline balance in your body — if you drink it, or rub on your skin or sprayed it up your  nose.

a modified liquid silica that is high in oxygen and is highly alkaline to help offset our acidic lifestyles. Alka Vita has a high pH of around 14.3 and is non corrosive ..

The ‘high in oxygen’ doesn’t sound plausible, but who knows? On the other hand, if it has a pH of 14.3 and is non-corrosive, they clearly don’t mean what chemists mean by ‘pH’.  14.3 is more alkaline than drain cleaner, and 60 times more alkaline than the NZ legal limit for dishwasher detergent.

Fortunately, the legal disclaimer page says

The information provided on this website is not intended as professional advice, but as guidelines for convenience only, upon the condition that you, by receiving or reading the material contained on this website, agree not to act in reliance upon it without first satisfying yourself by independent inquiry or advice as to the suitability, appropriateness, relevance, nature, fitness or purpose, likely side effects or long term effects, accuracy, reliability or otherwise of that material, having regard (without limitation) to your physical state, and your general fitness or medical condition.