Stats Chat

The cricket graphics system now allows 3-d barcharts projected over the playing field, and casting actual virtual shadows.

Yeah, nah.

• From the Upshot blog at the New York Times, a puzzle to test your problem solving skills — really, not just pointless tricks like whether you recognise upside-down photos

• I can’t resist mentioning a pointless number puzzle originating in New York. How does this sequence continue: 50, 42, 34, 23, 14,…

• Big Data: from Jennifer Gardy, a Canadian genomic epidemiologist, on Twitter. This is 5000TB, ie, about 5 million gigabytes, of genetic sequence data 
• From Upshot at the New York Times again, How to Know Whether to Believe a Health Study. StatsChat readers will be familiar with most of this.

• Another problem with errors in automatic classifications, for apps that purport to recognise bird songs
  If it tells you a nuthatch’s call is in fact a great tit (a bird which, by the way, is thought to have over 40 different types of call), you’ll take that mistake away with you and carry on misdiagnosing nuthatches.
  (On the other hand, I completely disagree with the argument that recognising bird songs should take work, dammit)

• Nathan Yau, at Flowing Data, is recreating the Statistical Atlas of the United States, using modern data and the 1870-style graphics.

• Nathan also has a list of actual rules about graphics, ones that aren’t just fashion statements or in-crowd shibboleths.

The New York Times has a well-deserved reputation for data journalism, but anyone can have a bad day.  There’s a piece by Steven Johnson on the non-extinction of the music industry (which I think makes some good points), but which the Future of Music Coalition doesn’t like at all. And they also have some good points.

In particular, Johnson says

“According to the OES, in 1999 there were nearly 53,000 Americans who considered their primary occupation to be that of a musician, a music director or a composer; in 2014 more than 60,000 people were employed writing, singing, or playing music. That’s a rise of 15 percent.”

He’s right. This is a graph (not that you really need one)

The Future of Music Coalition give the numbers for each year, and they’re interesting. Here’s a graph of the totals:

There isn’t a simple increase; there’s a weird two-humped pattern. Why?

Well, if you look at the two categories, “Music Directors and Composers” and “Musicians and Singers”, making up the total, it’s quite revealing

The larger category, “Musicians and Singers”, has been declining.  The smaller category, “Music Directors and Composers” was going up slowly, then had a dramatic three-year, straight-line increase, then decreased a bit.

Going  into the Technical Notes for the estimates (eg, 2009), we see

May 2009 estimates are based on responses from six semiannual panels collected over a 3-year period

That means the three-year increase of 5000 jobs/year is probably a one-off increase of 15,000 jobs. Either the number of “Music Directors and Composers” more than doubled in 2009, or more likely there was a change in definitions or sampling approach.  The Future of Music Coalition point out that Bureau of Labor Statistics FAQs say this is a problem (though they’ve got the wrong link: it’s here, question F.1)

Challenges in using OES data as a time series include changes in the occupational, industrial, and geographical classification systems

In particular, the 2008 statistics estimate only 390 of these people as being employed in primary and secondary schools; the 2009 estimate is 6000, and the 2011 estimate is 16880. A lot of primary and secondary school teachers got reclassified into this group; it wasn’t a real increase.

When the school teachers are kept out of  “Music Directors and Composers”, to get better comparability across years, the change is from 53000 in 1999 to 47000 in 2014. That’s not a 15% increase; it’s an 11% decrease.

Official statistics agencies try not to change their definitions, precisely because of this problem, but they do have to keep up with a changing world. In the other direction, I wrote about a failure to change definitions that led the US Census Bureau to report four times as many pre-schoolers were cared for by fathers vs mothers.

From Stuff: “Korean pears are the best way to prevent hangovers, say scientists.”

This is precisely not what scientists say; in fact, the scientist in question is even quoted (in the last line of the story) as not saying that.

Meanwhile, as a responsible scientist, she reminded that abstaining from excess alcohol consumption is the only certain way to avoid a hangover.

At least Stuff got ‘prevention’ in the headline. Many other sources, such as the Daily Mail, led with claims of a “hangover cure.”  The Mail also illustrated the story with a photo of the wrong species: the research was on the Asian species Pyrus pyrifolia,  rather than the European pear Pyrus communis. CSIRO hopes that European pears are effective, since that’s what Australia has vast quantities of, but they weren’t tested.

What Stuff doesn’t seem to have noticed is that this isn’t a new CSIRO discovery. The blog post certainly doesn’t go out of its way to make that obvious, but right at the bottom, after the cat picture, the puns, and the Q&A with the researcher, you can read

Manny also warns this is only a preliminary scoping study, with the results yet to be finalised. Ultimately, her team hope to deliver a comprehensive review of the scientific literature on pears, pear components and relevant health measures.

That is, the experimental study on Korean pears isn’t new research done at CSIRO. It’s research done in Korea, and published a couple of years ago. There’s nothing wrong with this, though it would have been nice to give credit, and it would have made the choice of Korean pears less mysterious.

The Korean researchers recruited a group of young Korean men, and gave alcohol (in the form of shoju), preceded by either Korean pear juice or placebo pear juice (pear-flavoured sweetened water).  Blood chemistry studies, as well as research in mice by the same group, suggest that the pear juice speeds up the metabolism of alcohol and acetaldehyde. This didn’t prevent hangovers, but it did seem to lead to a small reduction in hangover severity.

The study was really too small to be very convincing. Perhaps more importantly, the alcohol dose was nearly eleven standard drinks (540ml of 20% alcohol) over a short period of time, so you’d hope it was relevant to a fairly small group of people.  Even in Australia.

I’ve posted a few times about the maps, word clouds, and so on that show the most distinctive words by gender or state — sometimes they are even mislabelled as the “most common” words.  As I explained, these are often very rare words; it’s just that they are slightly less rare in one group than in the others.

An old post from the XKCD blog gives a really good example. Randall Munroe set up a survey to show people colours and ask for the colour name. He got five million responses, from over 200,000 sessions, and came up with nearly 1000 reasonably well-characterised colours.  You can download the complete data, if you care.

The survey asked participants about their chromosomal sex, because two of the colour receptor genes are on the X-chromosome and this is linked to colour blindness (and possibly to tetrachromatic vision). It turned out that the basic colour names were very similar between male and female respondents, though women were slightly more likely to use modifiers (“lime green” vs “green”).

However, Munroe also looked at the responses that differed most in frequency between men and women. These were all uncommon responses, but all from multiple people, and after extensive spam filtering.

You can probably guess which group is which:

1. Dusty Teal
2. Blush Pink
3. Dusty Lavender
4. Butter Yellow
5. Dusky Rose

1. Penis
2. Gay
3. WTF
4. Dunno
5. Baige

(Presumably this is a gender effect, not an X-linked language defect.)

Team Ratings for Round 2

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 7 matches played, 5 of which were correctly predicted, a success rate of 71.4%.

Here are the predictions for last week’s games.

Predictions for Round 2

Here are the predictions for Round 2. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Team Ratings for Round 24

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 168 matches played, 96 of which were correctly predicted, a success rate of 57.1%.

Here are the predictions for last week’s games.

Predictions for Round 24

Here are the predictions for Round 24. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Team Ratings for Round 3

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 8 matches played, 6 of which were correctly predicted, a success rate of 75%.

Here are the predictions for last week’s games.

Predictions for Round 3

Here are the predictions for Round 3. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

What are you doing on October 20? Statisticians all over the world will be showcasing the value of their work under the theme ‘Better data, better lives’. Quite. Here is the logo for this year, downloadable from the UNStats site here.

The World Statistics Day was proclaimed by the United Nations General Assembly in 2010 – so, fairly recently – to recognise the importance of statistics in shaping our societies. National and regional statistical days already existed in more than 100 countries, but the General Assembly’s adoption of this international day as 20 October brought extra momentum. That first World Statistics Day in October 2010 was marked in more than 130 countries and areas.

According to UNStats, this year marks an important cornerstone for official statistics, with the conclusion of the Millennium Development Goals (see how countries have fared here), the post-2015 development agenda, the data revolution (see what the Data Revolution Group set up by UN Secretary-General Ban Ki-Moon has to say here), the preparations for the 2020 World Population and Housing Census Programme and the likes.

Statschat hasn’t heard a lot about what might be happening in New Zealand and elsewhere – it might yet be a bit too early for announcements – but if you are running an event or know of one, please let us know. In the meantime, one cute initiative of UNStats is to translate the English logo into many of the languages of the world. We couldn’t miss the opportunity to have UNStats do ours in the first language of this country, te reo Māori. Te tino kē hoki o te moko nā! (Nice logo!)

From XKCD

“How would you even study that?” is an excellent question to ask when you see a surprising statistic in the media. Often the answer is “they didn’t,” but sometimes you get to find out about some really clever research technique.