Menus Subscribe Search

Book Reviews

data-set

(Photo: Joe Baker)

Through a Data Set, Darkly

• January 08, 2014 • 6:00 AM

(Photo: Joe Baker)

Is quantitative analysis the secret to understanding culture?

What to do with all this data? There’s now so much digital information being produced (about a terabyte per capita per year worldwide) that a major industry has arisen in response, promising to mine it for insight. A widely cited paper published in 2011 by the World Economic Forum and Bain & Company called personal data “the new oil.” According to its many boosters, Big Data—the neologism refers both to the bounty of information and to its analysis—is on the cusp of revolutionizing health care, scientific research, education, insurance, public health, energy policy, and national security.

The humanities are also jumping on the Big Data train. With museum archives, ancient manuscripts, and whole libraries being digitized, some researchers argue that data analysis will let studies of culture finally claim some of the empirical certainty traditionally associated with “hard” sciences like chemistry and physics. In their new book, Uncharted: Big Data as a Lens on Human Culture, Erez Aiden, a mathematician and geneticist, and Jean-Baptiste Michel, a data scientist, echo that argument, expressing total confidence that “Big data is going to change the humanities, transform the social sciences, and renegotiate the relationship between the world of commerce and the ivory tower.” Access to unprecedented amounts of information, they contend, will give rise to “culturomics,” a new form of cultural history that wrings its insights from sophisticated data analysis.

uncharted_bookThe main culturomic tool Aiden and Michel discuss is one they invented themselves: the Google Ngram Viewer, which lets users search a selection of the enormous Google Books archive for incidences of words over time. Type in a word and you get a handsome chart ostensibly showing how that word rose or fell in popularity through the years. When Ngram launched in 2010, it received millions of hits in its first 24 hours online, was covered on the front page of The New York Times, and was heralded as a fun—and potentially revolutionary—tool for exploring lexicographic history.

Aiden and Michel are enamored of their creation; just as the telescope helped us unlock the secrets of the night sky, they write, Ngram will help us unlock the secrets of culture. In their enthusiasm, however, they gloss over some of the program’s practical limitations. Early in Uncharted, they admit that Ngram’s data set, drawn from more than five million books published in seven languages between 1500 and 2000, is far from perfect. For starters, it uses only a small fraction of the Google Books reservoir of 30 million titles; major swathes remain inaccessible because of copyright concerns. (Plus, about 100 million books remain undigitized, according to Google’s estimate.) But after some early mentions, these shortcomings hardly come up again, as if merely acknowledging their existence solved them for good.

Attempting to showcase the exciting potential of culturomics, the authors use Ngram to detect when certain words and phrases replaced others (when, for example, World War I became more popular than the Great War); when certain irregular verbs (burnt) became regularized (burned); and when notable personalities’ fame waxed and waned. Combining Ngram charts with a potted history of Nazi censorship, they try to show how Jewish artists like Marc Chagall were briefly erased from history.

These are interesting observations, but too often, even the findings cherry-picked by Ngram’s creators are inconclusive or merely confirm things we already know. Dictators get written about a lot. Hollywood fame is typically fleeting. Charles Dickens helped popularize the greeting Merry Christmas. And some of the observations are just meaningless: At one point, we learn, the term Bill Clinton appeared almost as frequently as lettuce.

Aiden and Michel also fail to ask some basic questions about their own methods. Ngram counts the number of books in which a term was used, but it doesn’t consider the context in which the term was used within an individual book, nor how widely a book was read. And what about the influence of other media—television, film, radio, newspapers—in word usage?

Perhaps the most serious problem with Uncharted is that, like many Big Data enterprises, it introduces numerous correlations without illuminating much about their causes. Aiden and Michel come up with some evocative results, but then barely dig beneath the topsoil for explanations. When a causal mechanism isn’t immediately apparent, they’re far too willing to chalk it up to the mysteries of a still-developing field— something to be solved by the Ngram’s descendants—rather than their own limited curiosity or unwillingness to engage with “traditional” history.

A prime example can be found in their treatment of a finding about the persistence of calendar years in public consciousness. 1872, they tell us, was a big deal in 1872, but steadily declined in mentions thereafter. Same for 1873, and so on. Hopping forward a century, Aiden and Michel notice a change. Starting in 1973, it appears that “the half-life of collective forgetting” began to decrease. Years, and their histories, seemed to start disappearing faster from public memory.

“What caused that change?” Aiden and Michel ask. It’s a potentially fascinating question, and one that probably couldn’t have been posed without Big Data’s help. But in addition to ignoring the possible flaws in their sample, Aiden and Michel ignore history itself. The fact is, 1973 was a momentous year: the Yom Kippur War started (and ended), the United States began its pullout from Vietnam, Salvador Allende was overthrown, and the Watergate investigation was plastered across newspapers’ front pages. But it also came early in the era of satellite news, cable TV, and personal computing. Surely these factors had some effect on how history was written and published; perhaps the flowering of real-time, televised reporting came at the expense of longer, book-length treatments of history. But Aiden and Michel mention none of these events—nor anything else from 1973. “We don’t know,” they write. “For now, all we have are the naked correlations. … It may be some time before we figure out the underlying mechanisms.”

Uncharted ends on a note of intense optimism, with its authors looking beyond Google Books to the “tidal wave of data that will soon break over the social sciences.” After all, we are all data producers now—you and I and everyone we know. Aiden and Michel suggest that culturomics—armed with information from our tweets, Facebook updates, and perhaps devices that will record “every sensory experience, every beat of our heart, every rumble in our stomach, and even every thought that crosses our mind”—could make it possible to foresee the future of civilization.

That’s a lofty endnote for a thin book whose specific conclusions are limited and not particularly surprising. But this is typical of arguments on behalf of Big Data, which are prone to overstatement. The media scholars Danah Boyd and Kate Crawford convincingly argued in a 2011 paper that Big Data “encourages the practice of apophenia: seeing patterns where none actually exist.” The lure of deeper patterns leads almost invariably to the collection of more data. Or, as General Keith B. Alexander, director of the National Security Agency, put it recently, regarding widespread government surveillance of citizens: “You need the haystack to find the needle.”

In academia, overenthusiasm for suggestive correlations makes for shoddy scholarship. Out in the wider world, it affects lives, as when the government puts you on a no-fly list because the latest algorithm says your digital profile resembles that of a terrorist, or when a mortgage company denies you a loan based on patterns in your social media presence. Uncharted is, unwittingly, a cautionary tale for Big Data enthusiasts of all stripes. In their rush to inaugurate a powerful new discipline, Aiden and Michel overlook the fact that digital data and computer code are human inventions, incorporating human error, biases, and modes of thought—the stuff of history.


This post originally appeared in the January/February 2014 issue of Pacific Standard as “Through a Data Set, Darkly.” For more, consider subscribing to our bimonthly print magazine.

Jacob Silverman
Jacob Silverman is writing a book about social media and digital culture, which will be published by HarperCollins later this year.

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

September 19 • 4:00 PM

In Your Own Words: What It’s Like to Get Sued Over Past Debts

Some describe their surprise when they were sued after falling behind on medical and credit card bills.



September 19 • 1:26 PM

For Charitable Products, Sex Doesn’t Sell

Sexy women may turn heads, but for pro-social and charitable products, they won’t change minds.


September 19 • 12:00 PM

Carbon Taxes Really Do Work

A new study shows that taxing carbon dioxide emissions could actually work to reduce greenhouse gases without any negative effects on employment and revenues.


September 19 • 10:00 AM

Why the Poor Remain Poor

A follow-up to “How Being Poor Makes You Poor.”


September 19 • 9:03 AM

Why Science Won’t Defeat Ebola

While science will certainly help, winning the battle against Ebola is a social challenge.


September 19 • 8:00 AM

Burrito Treason in the Lone Star State

Did Meatless Mondays bring down Texas Agriculture Commissioner Todd Staples?


September 19 • 7:31 AM

Savor Good Times, Get Through the Bad Ones—With Categories

Ticking off a category of things to do can feel like progress or a fun time coming to an end.


September 19 • 6:00 AM

The Most Untouchable Man in Sports

How the head of the governing body for the world’s most popular sport freely wields his wildly incompetent power.


September 19 • 4:00 AM

The Danger of Dining With an Overweight Companion

There’s a good chance you’ll eat more unhealthy food.



September 18 • 4:00 PM

Racial Disparity in Imprisonment Inspires White People to Be Even More Tough on Crime

White Americans are more comfortable with punitive and harsh policing and sentencing when they imagine that the people being policed and put in prison are black.



September 18 • 2:00 PM

The Wages of Millions Are Being Seized to Pay Past Debts

A new study provides the first-ever tally of how many employees lose up to a quarter of their paychecks over debts like unpaid credit card or medical bills and student loans.


September 18 • 12:00 PM

When Counterfeit and Contaminated Drugs Are Deadly

The cost and the crackdown, worldwide.


September 18 • 10:00 AM

How Do You Make a Living, Molly Crabapple?

Noah Davis talks to Molly Crapabble about Michelangelo, the Medicis, and the tension between making art and making money.


September 18 • 9:00 AM

Um, Why Are These Professors Creeping on My Facebook Page?

The ethics of student-teacher “intimacy”—on campus and on social media.


September 18 • 8:00 AM

Welcome to the Economy Economy

With the recent introduction of Apple Pay, the Silicon Valley giant is promising to remake how we interact with money. Could iCoin be next?



September 18 • 6:09 AM

How to Build a Better Election

Elimination-style voting is harder to fiddle with than majority rule.


September 18 • 6:00 AM

Homeless on Purpose

The latest entry in a series of interviews about subculture in America.


September 18 • 4:00 AM

Why Original Artworks Move Us More Than Reproductions

Researchers present evidence that hand-created artworks convey an almost magical sense of the artist’s essence.


September 17 • 4:00 PM

Why Gun Control Groups Have Moved Away From an Assault Weapons Ban

A decade after the ban expired, gun control groups say that focusing on other policies will save more American lives.


September 17 • 2:00 PM

Can You Make Two People Like Each Other Just By Telling Them That They Should?

OKCupid manipulates user data in an attempt to find out.


September 17 • 12:00 PM

Understanding ISIL Messaging Through Behavioral Science

By generating propaganda that taps into individuals’ emotional and cognitive states, ISIL is better able motivate people to join their jihad.


Follow us


For Charitable Products, Sex Doesn’t Sell

Sexy women may turn heads, but for pro-social and charitable products, they won't change minds.

Carbon Taxes Really Do Work

A new study shows that taxing carbon dioxide emissions could actually work to reduce greenhouse gases without any negative effects on employment and revenues.

Savor Good Times, Get Through the Bad Ones—With Categories

Ticking off a category of things to do can feel like progress or a fun time coming to an end.

How to Build a Better Election

Elimination-style voting is harder to fiddle with than majority rule.

Do Conspiracy Theorists Feed on Unsuspecting Internet Trolls?

Not literally, but debunkers and satirists do fuel conspiracy theorists' appetites.

The Big One

One in three drivers in Brooklyn's Park Slope—at certain times of day—is just looking for parking. The same goes for drivers in Manhattan's SoHo. September/October 2014 new-big-one-3

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.