Menus Subscribe Search

Follow us


Taming the U.S. Government’s Secrecy Machine

• May 26, 2011 • 3:07 PM

The plodding effort to bring a modicum of common sense to how the U.S. declassifies its documents has resisted most efforts to rev it up in the digital age.

The Nixon Presidential Library plans in June to officially release the Pentagon Papers, the 7,000-page secret history of the Vietnam War that was famously first published, in part, by The New York Times in 1971. In the four decades since, the document has been the focus of innumerable newspapers articles, dozens of books — including both complete versions of the actual text itself — and even a couple of movies.

But until now, the Pentagon Papers have never been formally declassified by the government originally responsible for writing them.

This odd fact underscores the convoluted and plodding nature of a U.S. secrecy system that classifies many documents not needing such protection and releases too slowly many others that have long since gone benign.

Barack Obama came into office pledging to reform this beast, although the process he set in motion has been moving about as slowly as the broken system it seeks to repair. Only 19 out of 41 agencies met Obama’s deadline this past December to review their classification policies and begin implementing reform. And as Steven Aftergood, director of the Federation of American Scientists’ Project on Government Secrecy, has observed, the president was never all that specific in exactly what he was looking for in a “fundamental transformation” of the system.

The problem — as exemplified in the official release of a document that’s been easily accessible for decades — clearly requires big ideas more than bureaucratic adjustments. And as part of the government’s efforts, a Public Interest Declassification Board has been considering some of the major architectural changes that would be required to fix and move the system into the 21st century. The board oversees the government process and reports directly to the president (it also reported to the public at a forum today in Washington), although it has little power to compel individual agencies to adopt its ideas.

Jennifer Sims, director of intelligence studies at the Georgetown University Center for Peace and Security Studies, was appointed by Obama to the board. One if its main challenges, she said, is the sheer volume of the backlog — and the requirement that every agency with any interest in an individual document has the right to review it. A document that contains classified information about weapons of mass destruction originally obtained by a CIA agent, for example, must be reviewed by the Department of Energy and the intelligence community.

“This multiagency review of a single document exponentially increases the amount of work involved and the number of eyes that have to review the document,” Sims said. “But that’s all just dealing with the paper documents. The real challenge is going to be handling the volume of digital material that’s being generated every day now.”

Think of how many emails flow in and out of your inbox every day — and multiply that by every government employee in every federal agency from the Defense Intelligence Agency to the National Security Agency.

The information age is yielding reams of official communication not even worth saving, let alone classifying. But for all the ways technology is complicating secrecy, it also holds promise for redesigning the entire system. Part of the board’s mandate is to visualize how that might work not just today but 20 years from now.

“That’s a big task,” Sims said. “That’s a DARPA-type task, a truly transformative task, which makes the work very, very difficult.”

So what would a federal classification system look like on the other end of a “fundamental transformation”? Sims offered her vision, one of several on the board.

“It would almost be an artificial-intelligence-like capability,” she said, “so that we would have no longer this 25-year rule. Documents would be constantly searched by a central automated processing capability that does contextual analysis of every document ingested into the system.”

Such software would crawl through the government’s digital record in real time, determining which documents warrant classification, which don’t and which need to be reviewed by a human eye. It could automatically redact sensitive material and tag classified documents with a targeted release date. Older paper records could be digitized and fed into the system. A user interaction component could allow policymakers to dip into the trove to examine documents or release them, as current events require.

“It is a whole system that solves the front-end problem, which is sometimes overclassification of documents or underclassification of documents or inconsistent classification of documents,” Sims said, “and at the back end, also allows us to process much more rapidly in real time the declassification.”

The technology isn’t so far-fetched. But whether such a lumbering government system could realistically transform itself in this mold — that’s the other question.

“We want to think bold,” Sims said, “but at the same time not get so bold that we don’t grapple simultaneously with our current issues.”

Sign up for the free Miller-McCune.com e-newsletter.

“Like” Miller-McCune on Facebook.

Follow Miller-McCune on Twitter.

Add Miller-McCune.com news to your site.

Subscribe to Miller-McCune

Emily Badger
Emily Badger is a freelance writer living in the Washington, D.C. area who has contributed to The New York Times, International Herald Tribune and The Christian Science Monitor. She previously covered college sports for the Orlando Sentinel and lived and reported in France.

More From Emily Badger

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 31 • 4:00 PM

Should the Victims of the War on Drugs Receive Reparations?

A drug war Truth and Reconciliation Commission along the lines of post-apartheid South Africa is a radical idea proposed by the Green Party. Substance.com asks their candidates for New York State’s gubernatorial election to tell us more.


October 31 • 2:00 PM

India’s Struggle to Get Reliable Power to Hundreds of Millions of People

India’s new Prime Minister Narendra Modi is known as a “big thinker” when it comes to energy. But in his country’s case, could thinking big be a huge mistake?


October 31 • 12:00 PM

In the Picture: SNAP Food Benefits, Birthday Cake, and Walmart

In every issue, we fix our gaze on an everyday photograph and chase down facts about details in the frame.


October 31 • 10:15 AM

Levels of Depression Could Be Evaluated Through Measurements of Acoustic Speech

Engineers find tell-tale signs in speech patterns of the depressed.


October 31 • 8:00 AM

Who Wants a Cute Congressman?

You probably do—even if you won’t admit it. In politics, looks aren’t everything, but they’re definitely something.


October 31 • 7:00 AM

Why Scientists Make Promises They Can’t Keep

A research proposal that is totally upfront about the uncertainty of the scientific process and its potential benefits might never pass governmental muster.


October 31 • 6:12 AM

The Psychology of a Horror Movie Fan

Scientists have tried to figure out the appeal of axe murderers and creepy dolls, but it mostly remains a spooky mystery.


October 31 • 4:00 AM

The Power of Third Person Plural on Support for Public Policies

Researchers find citizens react differently to policy proposals when they’re framed as impacting “people,” as opposed to “you.”


October 30 • 4:00 PM

I Should Have Told My High School Students About My Struggle With Drinking

As a teacher, my students confided in me about many harrowing aspects of their lives. I never crossed the line and shared my biggest problem with them—but now I wish I had.


October 30 • 2:00 PM

How Dark Money Got a Mining Company Everything It Wanted

An accidentally released court filing reveals how one company secretly gave money to a non-profit that helped get favorable mining legislation passed.


October 30 • 12:00 PM

The Halloween Industrial Complex

The scariest thing about Halloween might be just how seriously we take it. For this week’s holiday, Americans of all ages will spend more than $5 billion on disposable costumes and bite-size candy.


October 30 • 10:00 AM

Sky’s the Limit: The Case for Selling Air Rights

Lower taxes and debt, increased revenue for the city, and a much better use of space in already dense environments: Selling air rights and encouraging upward growth seem like no-brainers, but NIMBY resistance and philosophical barriers remain.


October 30 • 9:00 AM

Cycles of Fear and Bias in the Criminal Justice System

Exploring the psychological roots of racial disparity in U.S. prisons.


October 30 • 8:00 AM

How Do You Make a Living, Email Newsletter Writer?

Noah Davis talks to Wait But Why writer Tim Urban about the newsletter concept, the research process, and escaping “money-flushing toilet” status.



October 30 • 6:00 AM

Dreamers of the Carbon-Free Dream

Can California go full-renewable?


October 30 • 5:08 AM

We’re Not So Great at Rejecting Each Other

And it’s probably something we should work on.


October 30 • 4:00 AM

He’s Definitely a Liberal—Just Check Out His Brain Scan

New research finds political ideology can be easily determined by examining how one’s brain reacts to disgusting images.


October 29 • 4:00 PM

Should We Prosecute Climate Change Protesters Who Break the Law?

A conversation with Bristol County, Massachusetts, District Attorney Sam Sutter, who dropped steep charges against two climate change protesters.


October 29 • 2:23 PM

Innovation Geography: The Beginning of the End for Silicon Valley

Will a lack of affordable housing hinder the growth of creative start-ups?


October 29 • 2:00 PM

Trapped in the Tobacco Debt Trap

A refinance of Niagara County, New York’s tobacco bonds was good news—but for investors, not taxpayers.


October 29 • 12:00 PM

Purity and Self-Mutilation in Thailand

During the nine-day Phuket Vegetarian Festival, a group of chosen ones known as the mah song torture themselves in order to redirect bad luck and misfortune away from their communities and ensure a year of prosperity.


October 29 • 10:00 AM

Can Proposition 47 Solve California’s Problem With Mass Incarceration?

Reducing penalties for low-level felonies could be the next step in rolling back draconian sentencing laws and addressing the criminal justice system’s long legacy of racism.


October 29 • 9:00 AM

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.


October 29 • 8:00 AM

America’s Bathrooms Are a Total Failure

No matter which American bathroom is crowned in this year’s America’s Best Restroom contest, it will still have a host of terrible flaws.


Follow us


Levels of Depression Could Be Evaluated Through Measurements of Acoustic Speech

Engineers find tell-tale signs in speech patterns of the depressed.

We’re Not So Great at Rejecting Each Other

And it's probably something we should work on.

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.

Incumbents, Pray for Rain

Come next Tuesday, rain could push voters toward safer, more predictable candidates.

Could Economics Benefit From Computer Science Thinking?

Computational complexity could offer new insight into old ideas in biology and, yes, even the dismal science.

The Big One

One town, Champlain, New York, was the source of nearly half the scams targeting small businesses in the United States last year. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.