Menus Subscribe Search

Follow us


Book Reviews

data-set

(Photo: Joe Baker)

Through a Data Set, Darkly

• January 08, 2014 • 6:00 AM

(Photo: Joe Baker)

Is quantitative analysis the secret to understanding culture?

What to do with all this data? There’s now so much digital information being produced (about a terabyte per capita per year worldwide) that a major industry has arisen in response, promising to mine it for insight. A widely cited paper published in 2011 by the World Economic Forum and Bain & Company called personal data “the new oil.” According to its many boosters, Big Data—the neologism refers both to the bounty of information and to its analysis—is on the cusp of revolutionizing health care, scientific research, education, insurance, public health, energy policy, and national security.

The humanities are also jumping on the Big Data train. With museum archives, ancient manuscripts, and whole libraries being digitized, some researchers argue that data analysis will let studies of culture finally claim some of the empirical certainty traditionally associated with “hard” sciences like chemistry and physics. In their new book, Uncharted: Big Data as a Lens on Human Culture, Erez Aiden, a mathematician and geneticist, and Jean-Baptiste Michel, a data scientist, echo that argument, expressing total confidence that “Big data is going to change the humanities, transform the social sciences, and renegotiate the relationship between the world of commerce and the ivory tower.” Access to unprecedented amounts of information, they contend, will give rise to “culturomics,” a new form of cultural history that wrings its insights from sophisticated data analysis.

uncharted_bookThe main culturomic tool Aiden and Michel discuss is one they invented themselves: the Google Ngram Viewer, which lets users search a selection of the enormous Google Books archive for incidences of words over time. Type in a word and you get a handsome chart ostensibly showing how that word rose or fell in popularity through the years. When Ngram launched in 2010, it received millions of hits in its first 24 hours online, was covered on the front page of The New York Times, and was heralded as a fun—and potentially revolutionary—tool for exploring lexicographic history.

Aiden and Michel are enamored of their creation; just as the telescope helped us unlock the secrets of the night sky, they write, Ngram will help us unlock the secrets of culture. In their enthusiasm, however, they gloss over some of the program’s practical limitations. Early in Uncharted, they admit that Ngram’s data set, drawn from more than five million books published in seven languages between 1500 and 2000, is far from perfect. For starters, it uses only a small fraction of the Google Books reservoir of 30 million titles; major swathes remain inaccessible because of copyright concerns. (Plus, about 100 million books remain undigitized, according to Google’s estimate.) But after some early mentions, these shortcomings hardly come up again, as if merely acknowledging their existence solved them for good.

Attempting to showcase the exciting potential of culturomics, the authors use Ngram to detect when certain words and phrases replaced others (when, for example, World War I became more popular than the Great War); when certain irregular verbs (burnt) became regularized (burned); and when notable personalities’ fame waxed and waned. Combining Ngram charts with a potted history of Nazi censorship, they try to show how Jewish artists like Marc Chagall were briefly erased from history.

These are interesting observations, but too often, even the findings cherry-picked by Ngram’s creators are inconclusive or merely confirm things we already know. Dictators get written about a lot. Hollywood fame is typically fleeting. Charles Dickens helped popularize the greeting Merry Christmas. And some of the observations are just meaningless: At one point, we learn, the term Bill Clinton appeared almost as frequently as lettuce.

Aiden and Michel also fail to ask some basic questions about their own methods. Ngram counts the number of books in which a term was used, but it doesn’t consider the context in which the term was used within an individual book, nor how widely a book was read. And what about the influence of other media—television, film, radio, newspapers—in word usage?

Perhaps the most serious problem with Uncharted is that, like many Big Data enterprises, it introduces numerous correlations without illuminating much about their causes. Aiden and Michel come up with some evocative results, but then barely dig beneath the topsoil for explanations. When a causal mechanism isn’t immediately apparent, they’re far too willing to chalk it up to the mysteries of a still-developing field— something to be solved by the Ngram’s descendants—rather than their own limited curiosity or unwillingness to engage with “traditional” history.

A prime example can be found in their treatment of a finding about the persistence of calendar years in public consciousness. 1872, they tell us, was a big deal in 1872, but steadily declined in mentions thereafter. Same for 1873, and so on. Hopping forward a century, Aiden and Michel notice a change. Starting in 1973, it appears that “the half-life of collective forgetting” began to decrease. Years, and their histories, seemed to start disappearing faster from public memory.

“What caused that change?” Aiden and Michel ask. It’s a potentially fascinating question, and one that probably couldn’t have been posed without Big Data’s help. But in addition to ignoring the possible flaws in their sample, Aiden and Michel ignore history itself. The fact is, 1973 was a momentous year: the Yom Kippur War started (and ended), the United States began its pullout from Vietnam, Salvador Allende was overthrown, and the Watergate investigation was plastered across newspapers’ front pages. But it also came early in the era of satellite news, cable TV, and personal computing. Surely these factors had some effect on how history was written and published; perhaps the flowering of real-time, televised reporting came at the expense of longer, book-length treatments of history. But Aiden and Michel mention none of these events—nor anything else from 1973. “We don’t know,” they write. “For now, all we have are the naked correlations. … It may be some time before we figure out the underlying mechanisms.”

Uncharted ends on a note of intense optimism, with its authors looking beyond Google Books to the “tidal wave of data that will soon break over the social sciences.” After all, we are all data producers now—you and I and everyone we know. Aiden and Michel suggest that culturomics—armed with information from our tweets, Facebook updates, and perhaps devices that will record “every sensory experience, every beat of our heart, every rumble in our stomach, and even every thought that crosses our mind”—could make it possible to foresee the future of civilization.

That’s a lofty endnote for a thin book whose specific conclusions are limited and not particularly surprising. But this is typical of arguments on behalf of Big Data, which are prone to overstatement. The media scholars Danah Boyd and Kate Crawford convincingly argued in a 2011 paper that Big Data “encourages the practice of apophenia: seeing patterns where none actually exist.” The lure of deeper patterns leads almost invariably to the collection of more data. Or, as General Keith B. Alexander, director of the National Security Agency, put it recently, regarding widespread government surveillance of citizens: “You need the haystack to find the needle.”

In academia, overenthusiasm for suggestive correlations makes for shoddy scholarship. Out in the wider world, it affects lives, as when the government puts you on a no-fly list because the latest algorithm says your digital profile resembles that of a terrorist, or when a mortgage company denies you a loan based on patterns in your social media presence. Uncharted is, unwittingly, a cautionary tale for Big Data enthusiasts of all stripes. In their rush to inaugurate a powerful new discipline, Aiden and Michel overlook the fact that digital data and computer code are human inventions, incorporating human error, biases, and modes of thought—the stuff of history.


This post originally appeared in the January/February 2014 issue of Pacific Standard as “Through a Data Set, Darkly.” For more, consider subscribing to our bimonthly print magazine.

Jacob Silverman
Jacob Silverman is writing a book about social media and digital culture, which will be published by HarperCollins later this year.

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 22 • 2:00 PM

Turning Public Education Into Private Profits

Baker Mitchell is a politically connected North Carolina businessman who celebrates the power of the free market. Every year, millions of public education dollars flow through Mitchell’s chain of four non-profit charter schools to for-profit companies he controls.


October 22 • 12:00 PM

Will the End of a Tax Loophole Kill Off Irish Business and Force Google and Apple to Pay Up?

U.S. technology giants have constructed international offices in Dublin in order to take advantage of favorable tax policies that are now changing. But Ireland might have enough other draws to keep them there even when costs climb.


October 22 • 10:00 AM

Veterans in the Ivory Tower

Why there aren’t enough veterans at America’s top schools—and what some people are trying to do to change that.


October 22 • 8:00 AM

Our Language Prejudices Don’t Make No Sense

We should embrace the fact that there’s no single recipe for English. Making fun of people for replacing “ask” with “aks,” or for frequently using double negatives just makes you look like the unsophisticated one.


October 22 • 7:04 AM

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.


October 22 • 6:00 AM

How We Form Our Routines

Whether it’s a morning cup of coffee or a glass of warm milk before bed, we all have our habitual processions. The way they become engrained, though, varies from person to person.


October 22 • 4:00 AM

For Preschoolers, Spite and Smarts Go Together

New research from Germany finds greater cognitive skills are associated with more spiteful behavior in children.


October 21 • 4:00 PM

Why the Number of Reported Sexual Offenses Is Skyrocketing at Occidental College

When you make it easier to report assault, people will come forward.


October 21 • 2:00 PM

Private Donors Are Supplying Spy Gear to Cops Across the Country Without Any Oversight

There’s little public scrutiny when private donors pay to give police controversial technology and weapons. Sometimes, companies are donors to the same foundations that purchase their products for police.


October 21 • 12:00 PM

How Clever Do You Think Your Dog Is?

Maybe as smart as a four-year-old child?


October 21 • 10:00 AM

Converting the Climate Change Non-Believers

When hard science isn’t enough, what can be done?



October 21 • 8:00 AM

Education Policy Is Stuck in the Manufacturing Age

Refining our policies and teaching social and emotional skills will help us to generate sustained prosperity.


October 21 • 7:13 AM

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you’ve (almost) got yourself a low-cost way to remove arsenic from drinking water.


October 21 • 6:00 AM

Fruits and Vegetables Are About to Enter a Flavor Renaissance

Chefs are teaming up with plant breeders to revitalize bland produce with robust flavors and exotic beauty—qualities long neglected by industrial agriculture.


October 21 • 4:00 AM

She’s Cheating on Him, You Can Tell Just by Watching Them

New research suggests telltale signs of infidelity emerge even in a three- to five-minute video.


October 21 • 2:00 AM

Cheating Demographic Doom: Pittsburgh Exceptionalism and Japan’s Surprising Economic Resilience

Don’t judge a metro or a nation-state by its population numbers.


October 20 • 4:00 PM

The Bird Hat Craze That Sparked a Preservation Movement

How a fashion statement at the turn of the 19th century led to the creation of the first Audubon societies.


October 20 • 2:00 PM

The Risk of Getting Killed by the Police If You Are White, and If You Are Black

An analysis of killings by police shows outsize risk for young black males.


October 20 • 12:00 PM

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they’re motivated by love while their enemies are motivated by hate.


October 20 • 11:00 AM

My Dog Comes First: The Importance of Pets to Homeless Youth

Dogs and cats have both advantages and disadvantages for street-involved youth.


October 20 • 10:00 AM

Homophobia Is Not a Thing of the Past

Despite growing support for LGBT rights and recent decisions from the Supreme Court regarding the legality of same-sex marriage, the battle for acceptance has not yet been decided.


October 20 • 8:00 AM

Big Boobs Matter Most

Medical mnemonics are often scandalous and sexist, but they help the student to both remember important facts and cope with challenging new experiences.


October 20 • 6:00 AM

When Disease Becomes Political: The Likely Electoral Fallout From Ebola

Will voters blame President Obama—and punish Democrats in the upcoming mid-term elections—for a climate of fear?


October 20 • 4:00 AM

Coming Soon: The Anatomy of Ignorance


Follow us


My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you've (almost) got yourself a low-cost way to remove arsenic from drinking water.

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they're motivated by love while their enemies are motivated by hate.

How to Water a Farm in Sandy Ground

Physicists investigate how to grow food more efficiently in fine-grained soil.

Unlocking Consciousness

A study of vegetative patients closes in on the nature of consciousness.

The Big One

One company, Amazon, controls 67 percent of the e-book market in the United States—down from 90 percent five years ago. September/October 2014 new-big-one-5

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.