Menus Subscribe Search

Taming the U.S. Government’s Secrecy Machine

• May 26, 2011 • 3:07 PM

The plodding effort to bring a modicum of common sense to how the U.S. declassifies its documents has resisted most efforts to rev it up in the digital age.

The Nixon Presidential Library plans in June to officially release the Pentagon Papers, the 7,000-page secret history of the Vietnam War that was famously first published, in part, by The New York Times in 1971. In the four decades since, the document has been the focus of innumerable newspapers articles, dozens of books — including both complete versions of the actual text itself — and even a couple of movies.

But until now, the Pentagon Papers have never been formally declassified by the government originally responsible for writing them.

This odd fact underscores the convoluted and plodding nature of a U.S. secrecy system that classifies many documents not needing such protection and releases too slowly many others that have long since gone benign.

Barack Obama came into office pledging to reform this beast, although the process he set in motion has been moving about as slowly as the broken system it seeks to repair. Only 19 out of 41 agencies met Obama’s deadline this past December to review their classification policies and begin implementing reform. And as Steven Aftergood, director of the Federation of American Scientists’ Project on Government Secrecy, has observed, the president was never all that specific in exactly what he was looking for in a “fundamental transformation” of the system.

The problem — as exemplified in the official release of a document that’s been easily accessible for decades — clearly requires big ideas more than bureaucratic adjustments. And as part of the government’s efforts, a Public Interest Declassification Board has been considering some of the major architectural changes that would be required to fix and move the system into the 21st century. The board oversees the government process and reports directly to the president (it also reported to the public at a forum today in Washington), although it has little power to compel individual agencies to adopt its ideas.

Jennifer Sims, director of intelligence studies at the Georgetown University Center for Peace and Security Studies, was appointed by Obama to the board. One if its main challenges, she said, is the sheer volume of the backlog — and the requirement that every agency with any interest in an individual document has the right to review it. A document that contains classified information about weapons of mass destruction originally obtained by a CIA agent, for example, must be reviewed by the Department of Energy and the intelligence community.

“This multiagency review of a single document exponentially increases the amount of work involved and the number of eyes that have to review the document,” Sims said. “But that’s all just dealing with the paper documents. The real challenge is going to be handling the volume of digital material that’s being generated every day now.”

Think of how many emails flow in and out of your inbox every day — and multiply that by every government employee in every federal agency from the Defense Intelligence Agency to the National Security Agency.

The information age is yielding reams of official communication not even worth saving, let alone classifying. But for all the ways technology is complicating secrecy, it also holds promise for redesigning the entire system. Part of the board’s mandate is to visualize how that might work not just today but 20 years from now.

“That’s a big task,” Sims said. “That’s a DARPA-type task, a truly transformative task, which makes the work very, very difficult.”

So what would a federal classification system look like on the other end of a “fundamental transformation”? Sims offered her vision, one of several on the board.

“It would almost be an artificial-intelligence-like capability,” she said, “so that we would have no longer this 25-year rule. Documents would be constantly searched by a central automated processing capability that does contextual analysis of every document ingested into the system.”

Such software would crawl through the government’s digital record in real time, determining which documents warrant classification, which don’t and which need to be reviewed by a human eye. It could automatically redact sensitive material and tag classified documents with a targeted release date. Older paper records could be digitized and fed into the system. A user interaction component could allow policymakers to dip into the trove to examine documents or release them, as current events require.

“It is a whole system that solves the front-end problem, which is sometimes overclassification of documents or underclassification of documents or inconsistent classification of documents,” Sims said, “and at the back end, also allows us to process much more rapidly in real time the declassification.”

The technology isn’t so far-fetched. But whether such a lumbering government system could realistically transform itself in this mold — that’s the other question.

“We want to think bold,” Sims said, “but at the same time not get so bold that we don’t grapple simultaneously with our current issues.”

Sign up for the free Miller-McCune.com e-newsletter.

“Like” Miller-McCune on Facebook.

Follow Miller-McCune on Twitter.

Add Miller-McCune.com news to your site.

Subscribe to Miller-McCune

Emily Badger
Emily Badger is a freelance writer living in the Washington, D.C. area who has contributed to The New York Times, International Herald Tribune and The Christian Science Monitor. She previously covered college sports for the Orlando Sentinel and lived and reported in France.

More From Emily Badger

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

August 29 • 4:00 PM

The Hidden Costs of Tobacco Debt

Even when taxpayers aren’t explicitly on the hook, tobacco bonds can cost states and local governments money. Here’s how.


August 29 • 2:00 PM

Why Don’t Men and Women Wear the Same Gender-Neutral Bathing Suits?

They used to in the 1920s.


August 29 • 11:48 AM

Your Brain Decides Whether to Trust Someone in Milliseconds

We can determine trustworthiness even when we’re only subliminally aware of the other person.


August 29 • 10:00 AM

True Darwinism Is All About Chance

Though the rich sometimes forget, Darwin knew that nature frequently rolls the dice.


August 29 • 8:00 AM

Why Our Molecular Make-Up Can’t Explain Who We Are

Our genes only tell a portion of the story.


August 29 • 6:00 AM

Strange Situations: Attachment Theory and Sexual Assault on College Campuses

When college women leave home, does attachment behavior make them more vulnerable to campus rape?


August 29 • 4:00 AM

Forgive Your Philandering Partner—and Pay the Price

New research finds people who forgive an unfaithful romantic partner are considered weaker and less competent than those who ended the relationship.


August 28 • 4:00 PM

Some Natural-Looking Zoo Exhibits May Be Even Worse Than the Old Concrete Ones

They’re often designed for you, the paying visitor, and not the animals who have to inhabit them.


August 28 • 2:00 PM

What I Learned From Debating Science With Trolls

“Don’t feed the trolls” is sound advice, but occasionally ignoring it can lead to rewards.


August 28 • 12:00 PM

The Ice Bucket Challenge’s Meme Money

The ALS Association has raised nearly $100 million over the past month, 50 times what it raised in the same period last year. How will that money be spent, and how can non-profit executives make a windfall last?


August 28 • 11:56 AM

Outlawing Water Conflict: California Legislators Confront Risky Groundwater Loophole

California, where ambitious agriculture sucks up 80 percent of the state’s developed water, is no stranger to water wrangles. Now one of the worst droughts in state history is pushing legislators to reckon with its unwieldy water laws, especially one major oversight: California has been the only Western state without groundwater regulation—but now that looks set to change.


August 28 • 11:38 AM

Young, Undocumented, and Invisible

While young migrant workers struggle under poor working conditions, U.S. policy has done little to help.


August 28 • 10:00 AM

The Five Words You Never Want to Hear From Your Doctor

“Sometimes people just get pains.”


August 28 • 8:00 AM

Why I’m Not Sharing My Coke

Andy Warhol, algorithms, and a bunch of popular names printed on soda cans.


August 28 • 6:00 AM

Can Outdoor Art Revitalize Outdoor Advertising?

That art you’ve been seeing at bus stations and billboards—it’s serving a purpose beyond just promoting local museums.


August 28 • 4:00 AM

Linguistic Analysis Reveals Research Fraud

An examination of papers by the discredited Diederik Stapel finds linguistic differences between his legitimate and fraudulent studies.


August 28 • 2:00 AM

Poverty and Geography: The Myth of Racial Segregation

Migration, regardless of race, ethnicity, gender, or sexuality (not to mention class), can be a poverty-buster.


August 27 • 4:00 PM

The ‘Non-Lethal’ Flash-Bang Grenades Used in Ferguson Can Actually Be Quite Lethal

A journalist says he was singed by a flash-bang fired by St. Louis County police trying to disperse a crowd, raising questions about how to use these military-style devices safely and appropriately.


August 27 • 2:00 PM

Do Better Looking People Have Better Personalities Too?

An experiment on users of the dating site OKCupid found that members judge both looks and personality by looks alone.


August 27 • 12:00 PM

Love Can Make You Stronger

A new study links oxytocin, the hormone most commonly associated with social bonding, and the one that your body produces during an orgasm, with muscle regeneration.


August 27 • 11:05 AM

Education, Interrupted

When it comes to educational access, young Syrian refugees are becoming a “lost generation.”


August 27 • 9:47 AM

No, Smartphone-Loss Anxiety Disorder Isn’t Real

But people are anxious about losing their phones, even if they don’t do much to protect them.


August 27 • 8:00 AM

A Skeptic Meets a Psychic: When You Can See Into the Future, How Do You Handle Uncertainty?

For all the crystal balls and beaded doorways, some psychics provide a useful, non-paranormal service. The best ones—they give good advice.


August 27 • 6:00 AM

Speaking Eyebrow: Your Face Is Saying More Than You Think

Our involuntary gestures take on different “accents” depending on our cultural background.


August 27 • 4:00 AM

The Politics of Anti-NIMBYism and Addressing Housing Affordability

Respected expert economists like Paul Krugman and Edward Glaeser are confusing readers with their poor grasp of demography.


Follow us


Subscribe Now

Your Brain Decides Whether to Trust Someone in Milliseconds

We can determine trustworthiness even when we’re only subliminally aware of the other person.

Young, Undocumented, and Invisible

While young migrant workers struggle under poor working conditions, U.S. policy has done little to help.

Education, Interrupted

When it comes to educational access, young Syrian refugees are becoming a “lost generation.”

No, Smartphone-Loss Anxiety Disorder Isn’t Real

But people are anxious about losing their phones, even if they don’t do much to protect them.

Being a Couch Potato: Not So Bad After All?

For those who feel guilty about watching TV, a new study provides redemption.

The Big One

One in two full-time American fast-food workers' families are enrolled in public assistance programs, at a cost of $7 billion per year. July/August 2014 fast-food-big-one

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.