Menus Subscribe Search

Follow us


Taming the U.S. Government’s Secrecy Machine

• May 26, 2011 • 3:07 PM

The plodding effort to bring a modicum of common sense to how the U.S. declassifies its documents has resisted most efforts to rev it up in the digital age.

The Nixon Presidential Library plans in June to officially release the Pentagon Papers, the 7,000-page secret history of the Vietnam War that was famously first published, in part, by The New York Times in 1971. In the four decades since, the document has been the focus of innumerable newspapers articles, dozens of books — including both complete versions of the actual text itself — and even a couple of movies.

But until now, the Pentagon Papers have never been formally declassified by the government originally responsible for writing them.

This odd fact underscores the convoluted and plodding nature of a U.S. secrecy system that classifies many documents not needing such protection and releases too slowly many others that have long since gone benign.

Barack Obama came into office pledging to reform this beast, although the process he set in motion has been moving about as slowly as the broken system it seeks to repair. Only 19 out of 41 agencies met Obama’s deadline this past December to review their classification policies and begin implementing reform. And as Steven Aftergood, director of the Federation of American Scientists’ Project on Government Secrecy, has observed, the president was never all that specific in exactly what he was looking for in a “fundamental transformation” of the system.

The problem — as exemplified in the official release of a document that’s been easily accessible for decades — clearly requires big ideas more than bureaucratic adjustments. And as part of the government’s efforts, a Public Interest Declassification Board has been considering some of the major architectural changes that would be required to fix and move the system into the 21st century. The board oversees the government process and reports directly to the president (it also reported to the public at a forum today in Washington), although it has little power to compel individual agencies to adopt its ideas.

Jennifer Sims, director of intelligence studies at the Georgetown University Center for Peace and Security Studies, was appointed by Obama to the board. One if its main challenges, she said, is the sheer volume of the backlog — and the requirement that every agency with any interest in an individual document has the right to review it. A document that contains classified information about weapons of mass destruction originally obtained by a CIA agent, for example, must be reviewed by the Department of Energy and the intelligence community.

“This multiagency review of a single document exponentially increases the amount of work involved and the number of eyes that have to review the document,” Sims said. “But that’s all just dealing with the paper documents. The real challenge is going to be handling the volume of digital material that’s being generated every day now.”

Think of how many emails flow in and out of your inbox every day — and multiply that by every government employee in every federal agency from the Defense Intelligence Agency to the National Security Agency.

The information age is yielding reams of official communication not even worth saving, let alone classifying. But for all the ways technology is complicating secrecy, it also holds promise for redesigning the entire system. Part of the board’s mandate is to visualize how that might work not just today but 20 years from now.

“That’s a big task,” Sims said. “That’s a DARPA-type task, a truly transformative task, which makes the work very, very difficult.”

So what would a federal classification system look like on the other end of a “fundamental transformation”? Sims offered her vision, one of several on the board.

“It would almost be an artificial-intelligence-like capability,” she said, “so that we would have no longer this 25-year rule. Documents would be constantly searched by a central automated processing capability that does contextual analysis of every document ingested into the system.”

Such software would crawl through the government’s digital record in real time, determining which documents warrant classification, which don’t and which need to be reviewed by a human eye. It could automatically redact sensitive material and tag classified documents with a targeted release date. Older paper records could be digitized and fed into the system. A user interaction component could allow policymakers to dip into the trove to examine documents or release them, as current events require.

“It is a whole system that solves the front-end problem, which is sometimes overclassification of documents or underclassification of documents or inconsistent classification of documents,” Sims said, “and at the back end, also allows us to process much more rapidly in real time the declassification.”

The technology isn’t so far-fetched. But whether such a lumbering government system could realistically transform itself in this mold — that’s the other question.

“We want to think bold,” Sims said, “but at the same time not get so bold that we don’t grapple simultaneously with our current issues.”

Sign up for the free Miller-McCune.com e-newsletter.

“Like” Miller-McCune on Facebook.

Follow Miller-McCune on Twitter.

Add Miller-McCune.com news to your site.

Subscribe to Miller-McCune

Emily Badger
Emily Badger is a freelance writer living in the Washington, D.C. area who has contributed to The New York Times, International Herald Tribune and The Christian Science Monitor. She previously covered college sports for the Orlando Sentinel and lived and reported in France.

More From Emily Badger

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

November 25 • 12:00 PM

Why Did Doctors Stop Giving Women Orgasms?

You can thank the rise of the vibrator for that, according to technology historian Rachel Maines.


November 25 • 10:08 AM

Geography, Race, and LOLs

The online lexicon spreads through racial and ethnic groups as much as it does through geography and other traditional linguistic measures.


November 25 • 10:00 AM

If It’s Yellow, Seriously, Let It Mellow

If you actually care about water and the future of the species, you’ll think twice about flushing.


November 25 • 8:00 AM

Sometimes You Should Just Say No to Surgery

The introduction of national thyroid cancer screening in South Korea led to a 15-fold increase in diagnoses and a corresponding explosion of operations—but no difference in mortality rates. This is a prime example of over-diagnosis that’s contributing to bloated health care costs.



November 25 • 6:00 AM

The Long War Between Highbrow and Lowbrow

Despise The Avengers? Loathe the snobs who despise The Avengers? You’re not the first.


November 25 • 4:00 AM

Are Women More Open to Sex Than They Admit?

New research questions the conventional wisdom that men overestimate women’s level of sexual interest in them.


November 25 • 2:00 AM

The Geography of Innovation, or, Why Almost All Japanese People Hate Root Beer

Innovation is not a product of population density, but of something else entirely.


November 24 • 4:00 PM

Federal Reserve Announces Sweeping Review of Its Big Bank Oversight

The Federal Reserve Board wants to look at whether the views of examiners are being heard by higher-ups.



November 24 • 2:00 PM

That Catcalling Video Is a Reminder of Why Research Methods Are So Important

If your methods aren’t sound then neither are your findings.


November 24 • 12:00 PM

Yes, Republicans Can Still Win the White House

If the economy in 2016 is where it was in 2012 or better, Democrats will likely retain the White House. If not, well….


November 24 • 11:36 AM

Feeling—Not Being—Wealthy Cuts Support for Economic Redistribution

A new study suggests it’s relative wealth that leads people to oppose taxing the rich and giving to the poor.


November 24 • 10:00 AM

Why Are Patients Drawn to Certain Doctors?

We look for an emotional fit between our physicians and ourselves—and right now, that’s the best we can do.


November 24 • 8:00 AM

Why Do We Elect Corrupt Politicians?

Voters, it seems, are willing to forgive—over and over again—dishonest yet beloved politicians if they think the job is still getting done.



November 24 • 6:00 AM

They Steal Babies, Don’t They?

Ethiopia, the Hague, and the rise and fall of international adoption. An exclusive investigation of internal U.S. State Department documents describing how humanitarian adoptions metastasized into a mini-industry shot through with fraud, becoming a source of income for unscrupulous orphanages, government officials, and shady operators—and was then reined back in through diplomacy, regulation, and a brand-new federal law.


November 24 • 4:00 AM

Nudging Drivers, and Pedestrians, Into Better Behavior

Daniel Pink’s new series, Crowd Control, premieres tonight on the National Geographic Channel.


November 21 • 4:00 PM

Why Are America’s Poorest Toddlers Being Over-Prescribed ADHD Drugs?

Against all medical guidelines, children who are two and three years old are getting diagnosed with ADHD and treated with Adderall and other stimulants. It may be shocking, but it’s perfectly legal.



November 21 • 2:00 PM

The Best Moms Let Mess Happen

That’s the message of a Bounty commercial that reminds this sociologist of Sharon Hays’ work on “the ideology of intensive motherhood.”


November 21 • 12:00 PM

Eating Disorders Are Not Just for Women

Men, like women, are affected by our cultural preoccupation with thinness. And refusing to recognize that only makes things worse.


November 21 • 10:00 AM

Queens of the South

Inside Asheville, North Carolina’s 7th annual Miss Gay Latina pageant.


November 21 • 9:12 AM

‘Shirtstorm’ and Sexism in Science

Following the recent T-shirt controversy, it’s clear that sexism in science persists. But the forces driving the gender gap are still being debated.


November 21 • 8:00 AM

What Makes a Film Successful in 2014?

Domestic box office earnings are no longer a reliable metric.


Follow us


Geography, Race, and LOLs

The online lexicon spreads through racial and ethnic groups as much as it does through geography and other traditional linguistic measures.

Feeling—Not Being—Wealthy Cuts Support for Economic Redistribution

A new study suggests it's relative wealth that leads people to oppose taxing the rich and giving to the poor.

Sufferers of Social Anxiety Disorder, Your Friends Like You

The first study of friends' perceptions suggest they know something's off with their pals but like them just the same.

Standing Up for My Group by Kicking Yours

Members of a minority ethnic group are less likely to express support for gay equality if they believe their own group suffers from discrimination.

How Old Brains Learn New Tricks

A new study shows that the neural plasticity needed for learning doesn't vanish as we age—it just moves.

The Big One

One in two United States senators and two in five House members who left office between 1998 and 2004 became lobbyists. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.