Menus Subscribe Search

Follow us


Book Reviews

data-set

(Photo: Joe Baker)

Through a Data Set, Darkly

• January 08, 2014 • 6:00 AM

(Photo: Joe Baker)

Is quantitative analysis the secret to understanding culture?

What to do with all this data? There’s now so much digital information being produced (about a terabyte per capita per year worldwide) that a major industry has arisen in response, promising to mine it for insight. A widely cited paper published in 2011 by the World Economic Forum and Bain & Company called personal data “the new oil.” According to its many boosters, Big Data—the neologism refers both to the bounty of information and to its analysis—is on the cusp of revolutionizing health care, scientific research, education, insurance, public health, energy policy, and national security.

The humanities are also jumping on the Big Data train. With museum archives, ancient manuscripts, and whole libraries being digitized, some researchers argue that data analysis will let studies of culture finally claim some of the empirical certainty traditionally associated with “hard” sciences like chemistry and physics. In their new book, Uncharted: Big Data as a Lens on Human Culture, Erez Aiden, a mathematician and geneticist, and Jean-Baptiste Michel, a data scientist, echo that argument, expressing total confidence that “Big data is going to change the humanities, transform the social sciences, and renegotiate the relationship between the world of commerce and the ivory tower.” Access to unprecedented amounts of information, they contend, will give rise to “culturomics,” a new form of cultural history that wrings its insights from sophisticated data analysis.

uncharted_bookThe main culturomic tool Aiden and Michel discuss is one they invented themselves: the Google Ngram Viewer, which lets users search a selection of the enormous Google Books archive for incidences of words over time. Type in a word and you get a handsome chart ostensibly showing how that word rose or fell in popularity through the years. When Ngram launched in 2010, it received millions of hits in its first 24 hours online, was covered on the front page of The New York Times, and was heralded as a fun—and potentially revolutionary—tool for exploring lexicographic history.

Aiden and Michel are enamored of their creation; just as the telescope helped us unlock the secrets of the night sky, they write, Ngram will help us unlock the secrets of culture. In their enthusiasm, however, they gloss over some of the program’s practical limitations. Early in Uncharted, they admit that Ngram’s data set, drawn from more than five million books published in seven languages between 1500 and 2000, is far from perfect. For starters, it uses only a small fraction of the Google Books reservoir of 30 million titles; major swathes remain inaccessible because of copyright concerns. (Plus, about 100 million books remain undigitized, according to Google’s estimate.) But after some early mentions, these shortcomings hardly come up again, as if merely acknowledging their existence solved them for good.

Attempting to showcase the exciting potential of culturomics, the authors use Ngram to detect when certain words and phrases replaced others (when, for example, World War I became more popular than the Great War); when certain irregular verbs (burnt) became regularized (burned); and when notable personalities’ fame waxed and waned. Combining Ngram charts with a potted history of Nazi censorship, they try to show how Jewish artists like Marc Chagall were briefly erased from history.

These are interesting observations, but too often, even the findings cherry-picked by Ngram’s creators are inconclusive or merely confirm things we already know. Dictators get written about a lot. Hollywood fame is typically fleeting. Charles Dickens helped popularize the greeting Merry Christmas. And some of the observations are just meaningless: At one point, we learn, the term Bill Clinton appeared almost as frequently as lettuce.

Aiden and Michel also fail to ask some basic questions about their own methods. Ngram counts the number of books in which a term was used, but it doesn’t consider the context in which the term was used within an individual book, nor how widely a book was read. And what about the influence of other media—television, film, radio, newspapers—in word usage?

Perhaps the most serious problem with Uncharted is that, like many Big Data enterprises, it introduces numerous correlations without illuminating much about their causes. Aiden and Michel come up with some evocative results, but then barely dig beneath the topsoil for explanations. When a causal mechanism isn’t immediately apparent, they’re far too willing to chalk it up to the mysteries of a still-developing field— something to be solved by the Ngram’s descendants—rather than their own limited curiosity or unwillingness to engage with “traditional” history.

A prime example can be found in their treatment of a finding about the persistence of calendar years in public consciousness. 1872, they tell us, was a big deal in 1872, but steadily declined in mentions thereafter. Same for 1873, and so on. Hopping forward a century, Aiden and Michel notice a change. Starting in 1973, it appears that “the half-life of collective forgetting” began to decrease. Years, and their histories, seemed to start disappearing faster from public memory.

“What caused that change?” Aiden and Michel ask. It’s a potentially fascinating question, and one that probably couldn’t have been posed without Big Data’s help. But in addition to ignoring the possible flaws in their sample, Aiden and Michel ignore history itself. The fact is, 1973 was a momentous year: the Yom Kippur War started (and ended), the United States began its pullout from Vietnam, Salvador Allende was overthrown, and the Watergate investigation was plastered across newspapers’ front pages. But it also came early in the era of satellite news, cable TV, and personal computing. Surely these factors had some effect on how history was written and published; perhaps the flowering of real-time, televised reporting came at the expense of longer, book-length treatments of history. But Aiden and Michel mention none of these events—nor anything else from 1973. “We don’t know,” they write. “For now, all we have are the naked correlations. … It may be some time before we figure out the underlying mechanisms.”

Uncharted ends on a note of intense optimism, with its authors looking beyond Google Books to the “tidal wave of data that will soon break over the social sciences.” After all, we are all data producers now—you and I and everyone we know. Aiden and Michel suggest that culturomics—armed with information from our tweets, Facebook updates, and perhaps devices that will record “every sensory experience, every beat of our heart, every rumble in our stomach, and even every thought that crosses our mind”—could make it possible to foresee the future of civilization.

That’s a lofty endnote for a thin book whose specific conclusions are limited and not particularly surprising. But this is typical of arguments on behalf of Big Data, which are prone to overstatement. The media scholars Danah Boyd and Kate Crawford convincingly argued in a 2011 paper that Big Data “encourages the practice of apophenia: seeing patterns where none actually exist.” The lure of deeper patterns leads almost invariably to the collection of more data. Or, as General Keith B. Alexander, director of the National Security Agency, put it recently, regarding widespread government surveillance of citizens: “You need the haystack to find the needle.”

In academia, overenthusiasm for suggestive correlations makes for shoddy scholarship. Out in the wider world, it affects lives, as when the government puts you on a no-fly list because the latest algorithm says your digital profile resembles that of a terrorist, or when a mortgage company denies you a loan based on patterns in your social media presence. Uncharted is, unwittingly, a cautionary tale for Big Data enthusiasts of all stripes. In their rush to inaugurate a powerful new discipline, Aiden and Michel overlook the fact that digital data and computer code are human inventions, incorporating human error, biases, and modes of thought—the stuff of history.


This post originally appeared in the January/February 2014 issue of Pacific Standard as “Through a Data Set, Darkly.” For more, consider subscribing to our bimonthly print magazine.

Jacob Silverman
Jacob Silverman is writing a book about social media and digital culture, which will be published by HarperCollins later this year.

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 24 • 4:00 PM

We Need to Normalize Drug Use in Our Society

After the disastrous misconceptions of the 20th century, we’re returning to the idea that drugs are an ordinary part of life experience and no more cause addiction than do other behaviors. This is rational and welcome.


October 24 • 2:00 PM

A Letter to the Next Attorney General: Fix Presidential Pardons

More than two years ago, a series showed that white applicants were far more likely to receive clemency than comparable applicants who were black. Since then, the government has spent hundreds of thousands of dollars on a study, but the pardons system remains unchanged.


October 24 • 12:00 PM

What Makes You So Smart, Middle School Math Teacher?

Noah Davis talks to Vern Williams about what makes middle school—yes, middle school—so great.


October 24 • 10:00 AM

Why DNA Is One of Humanity’s Greatest Inventions

How we’ve co-opted our genetic material to change our world.


October 24 • 8:00 AM

What Do Clowns Think of Clowns?

Three major players weigh in on the current state of the clown.


October 24 • 7:13 AM

There Is No Surge in Illegal Immigration

The overall rate of illegal immigration has actually decreased significantly in the last 10 years. The time is ripe for immigration reform.


October 24 • 6:15 AM

Politicians Really Aren’t Better Decision Makers

Politicians took part in a classic choice experiment but failed to do better than the rest of us.


October 24 • 5:00 AM

Why We Gossip: It’s Really All About Ourselves

New research from the Netherlands finds stories we hear about others help us determine how we’re doing.


October 24 • 2:00 AM

Congratulations, Your City Is Dying!

Don’t take population numbers at face value.


October 23 • 4:00 PM

Of Course Marijuana Addiction Exists

The polarized legalization debate leads to exaggerated claims and denials about pot’s potential harms. The truth lies somewhere in between.


October 23 • 2:00 PM

American Companies Are Getting Way Too Cozy With the National Security Agency

Newly released documents describe “contractual relationships” between the NSA and U.S. companies, as well as undercover operatives.


October 23 • 12:00 PM

The Man Who’s Quantifying New York City

Noah Davis talks to the proprietor of I Quant NY. His methodology: a little something called “addition.”


October 23 • 11:02 AM

Earliest High-Altitude Settlements Found in Peru

Discovery suggests humans adapted to high altitude faster than previously thought.


October 23 • 10:00 AM

The Psychology of Bribery and Corruption

An FBI agent offered up confidential information about a political operative’s enemy in exchange for cash—and they both got caught. What were they thinking?


October 23 • 8:00 AM

Ebola News Gives Me a Guilty Thrill. Am I Crazy?

What it means to feel a little excited about the prospect of a horrific event.


October 23 • 7:04 AM

Why Don’t Men Read Romance Novels?

A lot of men just don’t read fiction, and if they do, structural misogyny drives them away from the genre.


October 23 • 6:00 AM

Why Do Americans Pray?

It depends on how you ask.


October 23 • 4:00 AM

Musicians Are Better Multitaskers

New research from Canada finds trained musicians more efficiently switch from one mental task to another.


October 22 • 4:00 PM

The Last Thing the Women’s Movement Needs Is a Heroic Male Takeover

Is the United Nations’ #HeForShe campaign helping feminism?


October 22 • 2:00 PM

Turning Public Education Into Private Profits

Baker Mitchell is a politically connected North Carolina businessman who celebrates the power of the free market. Every year, millions of public education dollars flow through Mitchell’s chain of four non-profit charter schools to for-profit companies he controls.


October 22 • 12:00 PM

Will the End of a Tax Loophole Kill Off Irish Business and Force Google and Apple to Pay Up?

U.S. technology giants have constructed international offices in Dublin in order to take advantage of favorable tax policies that are now changing. But Ireland might have enough other draws to keep them there even when costs climb.


October 22 • 10:00 AM

Veterans in the Ivory Tower

Why there aren’t enough veterans at America’s top schools—and what some people are trying to do to change that.


October 22 • 8:00 AM

Our Language Prejudices Don’t Make No Sense

We should embrace the fact that there’s no single recipe for English. Making fun of people for replacing “ask” with “aks,” or for frequently using double negatives just makes you look like the unsophisticated one.


October 22 • 7:04 AM

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.


October 22 • 6:00 AM

How We Form Our Routines

Whether it’s a morning cup of coffee or a glass of warm milk before bed, we all have our habitual processions. The way they become engrained, though, varies from person to person.


Follow us


Politicians Really Aren’t Better Decision Makers

Politicians took part in a classic choice experiment but failed to do better than the rest of us.

Earliest High-Altitude Settlements Found in Peru

Discovery suggests humans adapted to high altitude faster than previously thought.

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you've (almost) got yourself a low-cost way to remove arsenic from drinking water.

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they're motivated by love while their enemies are motivated by hate.

The Big One

One company, Amazon, controls 67 percent of the e-book market in the United States—down from 90 percent five years ago. September/October 2014 new-big-one-5

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.