Menus Subscribe Search

Book Reviews

data-set

(Photo: Joe Baker)

Through a Data Set, Darkly

• January 08, 2014 • 6:00 AM

(Photo: Joe Baker)

Is quantitative analysis the secret to understanding culture?

What to do with all this data? There’s now so much digital information being produced (about a terabyte per capita per year worldwide) that a major industry has arisen in response, promising to mine it for insight. A widely cited paper published in 2011 by the World Economic Forum and Bain & Company called personal data “the new oil.” According to its many boosters, Big Data—the neologism refers both to the bounty of information and to its analysis—is on the cusp of revolutionizing health care, scientific research, education, insurance, public health, energy policy, and national security.

The humanities are also jumping on the Big Data train. With museum archives, ancient manuscripts, and whole libraries being digitized, some researchers argue that data analysis will let studies of culture finally claim some of the empirical certainty traditionally associated with “hard” sciences like chemistry and physics. In their new book, Uncharted: Big Data as a Lens on Human Culture, Erez Aiden, a mathematician and geneticist, and Jean-Baptiste Michel, a data scientist, echo that argument, expressing total confidence that “Big data is going to change the humanities, transform the social sciences, and renegotiate the relationship between the world of commerce and the ivory tower.” Access to unprecedented amounts of information, they contend, will give rise to “culturomics,” a new form of cultural history that wrings its insights from sophisticated data analysis.

uncharted_bookThe main culturomic tool Aiden and Michel discuss is one they invented themselves: the Google Ngram Viewer, which lets users search a selection of the enormous Google Books archive for incidences of words over time. Type in a word and you get a handsome chart ostensibly showing how that word rose or fell in popularity through the years. When Ngram launched in 2010, it received millions of hits in its first 24 hours online, was covered on the front page of The New York Times, and was heralded as a fun—and potentially revolutionary—tool for exploring lexicographic history.

Aiden and Michel are enamored of their creation; just as the telescope helped us unlock the secrets of the night sky, they write, Ngram will help us unlock the secrets of culture. In their enthusiasm, however, they gloss over some of the program’s practical limitations. Early in Uncharted, they admit that Ngram’s data set, drawn from more than five million books published in seven languages between 1500 and 2000, is far from perfect. For starters, it uses only a small fraction of the Google Books reservoir of 30 million titles; major swathes remain inaccessible because of copyright concerns. (Plus, about 100 million books remain undigitized, according to Google’s estimate.) But after some early mentions, these shortcomings hardly come up again, as if merely acknowledging their existence solved them for good.

Attempting to showcase the exciting potential of culturomics, the authors use Ngram to detect when certain words and phrases replaced others (when, for example, World War I became more popular than the Great War); when certain irregular verbs (burnt) became regularized (burned); and when notable personalities’ fame waxed and waned. Combining Ngram charts with a potted history of Nazi censorship, they try to show how Jewish artists like Marc Chagall were briefly erased from history.

These are interesting observations, but too often, even the findings cherry-picked by Ngram’s creators are inconclusive or merely confirm things we already know. Dictators get written about a lot. Hollywood fame is typically fleeting. Charles Dickens helped popularize the greeting Merry Christmas. And some of the observations are just meaningless: At one point, we learn, the term Bill Clinton appeared almost as frequently as lettuce.

Aiden and Michel also fail to ask some basic questions about their own methods. Ngram counts the number of books in which a term was used, but it doesn’t consider the context in which the term was used within an individual book, nor how widely a book was read. And what about the influence of other media—television, film, radio, newspapers—in word usage?

Perhaps the most serious problem with Uncharted is that, like many Big Data enterprises, it introduces numerous correlations without illuminating much about their causes. Aiden and Michel come up with some evocative results, but then barely dig beneath the topsoil for explanations. When a causal mechanism isn’t immediately apparent, they’re far too willing to chalk it up to the mysteries of a still-developing field— something to be solved by the Ngram’s descendants—rather than their own limited curiosity or unwillingness to engage with “traditional” history.

A prime example can be found in their treatment of a finding about the persistence of calendar years in public consciousness. 1872, they tell us, was a big deal in 1872, but steadily declined in mentions thereafter. Same for 1873, and so on. Hopping forward a century, Aiden and Michel notice a change. Starting in 1973, it appears that “the half-life of collective forgetting” began to decrease. Years, and their histories, seemed to start disappearing faster from public memory.

“What caused that change?” Aiden and Michel ask. It’s a potentially fascinating question, and one that probably couldn’t have been posed without Big Data’s help. But in addition to ignoring the possible flaws in their sample, Aiden and Michel ignore history itself. The fact is, 1973 was a momentous year: the Yom Kippur War started (and ended), the United States began its pullout from Vietnam, Salvador Allende was overthrown, and the Watergate investigation was plastered across newspapers’ front pages. But it also came early in the era of satellite news, cable TV, and personal computing. Surely these factors had some effect on how history was written and published; perhaps the flowering of real-time, televised reporting came at the expense of longer, book-length treatments of history. But Aiden and Michel mention none of these events—nor anything else from 1973. “We don’t know,” they write. “For now, all we have are the naked correlations. … It may be some time before we figure out the underlying mechanisms.”

Uncharted ends on a note of intense optimism, with its authors looking beyond Google Books to the “tidal wave of data that will soon break over the social sciences.” After all, we are all data producers now—you and I and everyone we know. Aiden and Michel suggest that culturomics—armed with information from our tweets, Facebook updates, and perhaps devices that will record “every sensory experience, every beat of our heart, every rumble in our stomach, and even every thought that crosses our mind”—could make it possible to foresee the future of civilization.

That’s a lofty endnote for a thin book whose specific conclusions are limited and not particularly surprising. But this is typical of arguments on behalf of Big Data, which are prone to overstatement. The media scholars Danah Boyd and Kate Crawford convincingly argued in a 2011 paper that Big Data “encourages the practice of apophenia: seeing patterns where none actually exist.” The lure of deeper patterns leads almost invariably to the collection of more data. Or, as General Keith B. Alexander, director of the National Security Agency, put it recently, regarding widespread government surveillance of citizens: “You need the haystack to find the needle.”

In academia, overenthusiasm for suggestive correlations makes for shoddy scholarship. Out in the wider world, it affects lives, as when the government puts you on a no-fly list because the latest algorithm says your digital profile resembles that of a terrorist, or when a mortgage company denies you a loan based on patterns in your social media presence. Uncharted is, unwittingly, a cautionary tale for Big Data enthusiasts of all stripes. In their rush to inaugurate a powerful new discipline, Aiden and Michel overlook the fact that digital data and computer code are human inventions, incorporating human error, biases, and modes of thought—the stuff of history.


This post originally appeared in the January/February 2014 issue of Pacific Standard as “Through a Data Set, Darkly.” For more, consider subscribing to our bimonthly print magazine.

Jacob Silverman
Jacob Silverman is writing a book about social media and digital culture, which will be published by HarperCollins later this year.

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

July 31 • 4:00 PM

Thank You for Your Service: How One Company Sues Soldiers Worldwide

With stores near military bases across the country, the retailer USA Discounters offers easy credit to service members. But when those loans go bad, the company uses the local courts near its Virginia headquarters to file suits by the thousands.


July 31 • 2:00 PM

A New York State of Fracking

Court cases. A governor’s moratorium. Pending health study. A quick guide to the state of fracking in New York.


July 31 • 11:17 AM

How California Could Power Itself Using Nothing but Renewables

We don’t need fossil fuels.


July 31 • 8:00 AM

Should Athletes Train Their Memories?

Sure, but it probably won’t help.


July 31 • 6:00 AM

Universal Basic Income: Something We Can All Agree on?

According to Almaz Zelleke, it’s not a crazy thought.


July 31 • 4:00 AM

Medical Dramas Produce Misinformed, Fatalistic Viewers

New research suggests TV doctor dramas leave viewers with skewed impressions of important health-related topics.


July 30 • 4:00 PM

Still the World’s Top Military Spender

Although declining in real terms, the United States’ military budget remains substantial and a huge drain on our public resources.



July 30 • 2:04 PM

The Rise of the Nuisance Flood

Minor floods are afflicting parts of Maryland nearly 10 times more often than was the case in the 1960s.


July 30 • 2:00 PM

The (Mostly Awful) Things You Learn After Investigating Unpaid Internships for a Year

Though the intern economy remains opaque, dialogue about the role of interns in the labor force—and protections they deserve—is beginning to take shape.


July 30 • 12:00 PM

Why Coffee Shortages Won’t Change the Price of Your Frappuccino

You’re so loyal to Starbucks—and the company knows it—that your daily serving of caffeine is already marked up beyond the reach of any fluctuations in supply.



July 30 • 10:00 AM

Having Difficult Conversations With Your Children

Why it’s necessary, and how to do it.


July 30 • 8:00 AM

How to Make a Convincing Sci-Fi Movie on a Tight Budget

Coherence is a good movie, and its initial shoot cost about the same amount of money as a used Prius.


July 30 • 6:00 AM

Are You Really as Happy as You Say You Are?

Researchers find a universal positivity bias in the way we talk, tweet, and write.


July 30 • 4:00 AM

The Declining Wage Gap for Gay Men

New research finds gay men in America are rapidly catching up with straight married men in terms of wages.


July 30 • 2:00 AM

LeBron James Migration: Big Chef Seeking Small Pond

The King’s return to Cleveland is a symbol for the dramatic shift in domestic as well as international migration.


July 29 • 4:00 PM

Are Children Seeking Refuge Turning More Americans Against Undocumented Immigrants?

A look at Pew Research Center survey data collected in February and July of this year.


July 29 • 2:00 PM

Under Water: The EPA’s Ongoing Struggle to Combat Pollution

Frustration and inaction color efforts to enforce the Clean Water Act.


July 29 • 12:40 PM

America’s Streams Are Awash With Pesticides Banned in Europe

You may have never heard of clothianidin, but it’s probably in your local river.


July 29 • 12:00 PM

Mining Your Genetic Data for Profit: The Dark Side of Biobanking

One woman’s personal story raises deep questions about the stark limits of current controls in a nascent industry at the very edge of the frontier of humans and technology.


July 29 • 11:23 AM

Where Should You Go to College?


July 29 • 10:29 AM

How Textbooks Have Changed the Face of War

War is more personal, less glorious, and more hellish in modern textbooks than in the past. But there’s still room for improvement.


July 29 • 10:00 AM

The Monolingual American: Why Are Those Outside of the U.S. Encouraging It?

If you are an American trying to learn German in a large German town or city, you will mostly hear English in return, even when you give sprechen your best shot.


July 29 • 8:00 AM

The Elusive Link Between Casinos and Crime

With a study of the impact of Philadelphia’s SugarHouse Casino, a heated debate gets fresh ammunition.


Follow us


Subscribe Now

The Rise of the Nuisance Flood

Minor floods are afflicting parts of Maryland nearly 10 times more often than was the case in the 1960s.

America’s Streams Are Awash With Pesticides Banned in Europe

You may have never heard of clothianidin, but it's probably in your local river.

How Textbooks Have Changed the Face of War

War is more personal, less glorious, and more hellish in modern textbooks than in the past. But there’s still room for improvement.

NASA Could Build Entire Spacecrafts in Space Using 3-D Printers

This year NASA will experiment with 3-D printing small objects in space. That could mark the beginning of a gravity-free manufacturing revolution.

The Big One

One in two full-time American fast-food workers' families are enrolled in public assistance programs, at a cost of $7 billion per year. July/August 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.