Tuesday, April 22, 2014

The Economist explains: The backlash against big data | The Economist

A succinct summary via @datameer

"The criticisms fall into three areas that are not intrinsic to big data per se, but endemic to data analysis, and have some merit. First, there are biases inherent to data that must not be ignored. That is undeniably the case. Second, some proponents of big data have claimed that theory (ie, generalisable models about how the world works) is obsolete. In fact, subject-area knowledge remains necessary even when dealing with large data sets. Third, the problem of spurious correlations—associations that are statistically robust but only happen by chance—increases with more data. Although there are new statistical techniques to identify and banish spurious correlations, such as running many tests against subsets of the data, this will always be a problem."
The Economist explains: The backlash against big data | The Economist

No comments: