Archive for December, 2010

This is why you test your new formulas first

December 6, 2010

The First Law of Development Stats: Whatever our Bizarre Methodology, We make Africa look Worse

The biggest change in method was that the new HDI is a geometric average rather than a normal (additive) average. Geometric average means you multiply the separate indices (each ranging between 0 and 1) for income, life expectancy, and education together and then take the cube root (I know your pulse starts to race here…)

Now, students, please notice the following: if one of these indices is zero, then the new HDI will be zero, regardless of how great the other indices are. The same mostly applies if one of the indices is close to zero. The new HDI has a “you’re only as strong as your weakest link” property, and in practice the weakest link turns out to be very low income (and guess which region has very low income).

You can see why the geometric average might have been attractive: by multiplying and then taking a root, it avoids the Bill-Gates-Walks-Into-A-Bar problem that besets arithmetic averages. But instead it makes errors in scaling or in linearity much worse. You gains on the swings, but you loses on the roundabouts.

And ultimately it’s always going to be about the scaling. $2 may make you twice as happy as $1, but $2 million is unlikely to make you twice as happy as $1 million, much less a million times as happy as $2.

It’s much, much easier, both mathematically and politically (because you get to avoid claims of subjectivity) to measure utility or development in linear terms of clear quantities like dollars or years of life or bushels of food. Too bad all you learn is ever more precisely where the house keys aren’t.


Unclear on the concept

December 6, 2010

Queens Woman Nearly Loses Home Over Bank Error –

Because she had a dogged lawyer, who had the wit to get a New York Times columnist interested in her case, a terrible mistake was uncovered. As a result, an unjustified foreclosure may well be reversed.

In the column that contains these lines, Nocera documents repeated acceptance of payments under false information, repeated court filing of falsified documents, knowing dissemination of false information in financial transactions (oh, yeah, and the usual failure to perform proper service of documents in a lawsuit). This is a mistake?

Ever bleeping convicted bad-check signer and con artist in the country would be walking around with a clean record if they could just say “oops, my bad” the way Bank of America gets to do.