Menus Subscribe Search

Follow us


face-recognition-security

(PHOTO: KEITH GENTRY/SHUTTERSTOCK)

Why You’re Able to Spot a Friend in a Crowd, Even When You Can’t See Their Face

• October 09, 2013 • 10:00 AM

(PHOTO: KEITH GENTRY/SHUTTERSTOCK)

And how new research on this common phenomenon will be used to improve controversial facial-recognition technology.

Have you ever surprised yourself by correctly recognizing a friend in a crowd, far, far away? Even if her face isn’t at all visible, there’s something about the way she’s standing or walking that gives her away instantly. New research by psychologists at the University of Texas-Dallas helps to confirm and explain that very common phenomenon.

In a study published recently in the journal Psychological Science, researchers asked participants to look at photographs of people in different settings and clothing and to match them up, determining which ones were photos of the same person. The photographs in the experiment were specifically chosen because they were hard for a facial-recognition computer program to identify. The study found that the participants had more success when they could see the bodies of the people in the photographs—and less success when the bodies were less visible but the faces were clearer. In fact, the participants also accurately matched the photos when they could only see the people’s bodies, while the faces were completely blocked out.

“Our work shows that the body can be surprisingly useful for identification, especially when the face fails to provide the necessary identity information.”

What’s most interesting about the experiment is that the participants tended to believe, incorrectly, that they were primarily looking at the faces in the photos in order to identify the people they were looking at. Eye-tracking equipment revealed that that wasn’t the case: when they couldn’t get enough information from the faces in the photos, they were actually spending more time studying the people’s bodies. “People’s recognition strategies were inaccessible to their conscious awareness,” said lead researcher Allyson Rice.

Many psychologists and computer scientists have historically studied facial recognition and ignored the larger picture, the authors concluded. They added that there are clear implications here for the technological development of non-human recognizers of faces, as well.

“Given the widespread use of face recognition systems in security settings, it is important for these systems to make use of all potentially helpful information,” said co-author Alice O’Toole. “Our work shows that the body can be surprisingly useful for identification, especially when the face fails to provide the necessary identity information.”

According to the University of Texas, this study was funded by the Technical Support Working Group of the Department of Defense, and the work of one of its co-authors, P. Jonathon Philips, is partially funded by the FBI. The fact that these agencies are working to find ways to make facial-recognition technology even more accurate than it already is won’t be surprising news, but neither will it be welcome news, to many people.

Facial-recognition technology in general has proved to be a fairly controversial issue, from the ethically problematic crime-fighting and crime-solving tactics pairing the tool with ubiquitous surveillance cameras, to the slightly more banal (but still creepy) example of Facebook photo-tagging. As it turns out, people don’t like to feel as though they’re walking around constantly being scanned through a series of Terminator’s-eye lenses.

Many legislators and privacy advocacy groups have spoken out against the spread this technology, and the debate will surely continue as more stories come out about the sometimes surprising ways that government agencies and corporations have been adopting it. And, of course, there’s the commercial exploitation of that creeped-out-feeling. For instance, there’s a new line of “Glamoflage” T-shirts that are meant to be worn as a kind of facial-recognition-tech-camouflage. (But, unfortunately, they are absolutely hideous.)

Maybe facial-recognition technology could avoid controversy if it weren’t used in massive government databases or for the purpose of coercing us into becoming even more absorbed in online social media. Maybe it could stick to its most appropriate use, in a machine that recognizes when we’re yawning and gives us free coffee. That’s something that everyone can get behind.

Lauren Kirchner
Lauren Kirchner is the Web editor of The Baffler. She has written for the Columbia Journalism Review, Capital New York, Slate, The Awl, The Hairpin, and many others. Follow her on Twitter @lkirchner.

More From Lauren Kirchner

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 31 • 4:00 PM

Should the Victims of the War on Drugs Receive Reparations?

A drug war Truth and Reconciliation Commission along the lines of post-apartheid South Africa is a radical idea proposed by the Green Party. Substance.com asks their candidates for New York State’s gubernatorial election to tell us more.


October 31 • 2:00 PM

India’s Struggle to Get Reliable Power to Hundreds of Millions of People

India’s new Prime Minister Narendra Modi is known as a “big thinker” when it comes to energy. But in his country’s case, could thinking big be a huge mistake?


October 31 • 12:00 PM

In the Picture: SNAP Food Benefits, Birthday Cake, and Walmart

In every issue, we fix our gaze on an everyday photograph and chase down facts about details in the frame.


October 31 • 10:15 AM

Levels of Depression Could Be Evaluated Through Measurements of Acoustic Speech

Engineers find tell-tale signs in speech patterns of the depressed.


October 31 • 8:00 AM

Who Wants a Cute Congressman?

You probably do—even if you won’t admit it. In politics, looks aren’t everything, but they’re definitely something.


October 31 • 7:00 AM

Why Scientists Make Promises They Can’t Keep

A research proposal that is totally upfront about the uncertainty of the scientific process and its potential benefits might never pass governmental muster.


October 31 • 6:12 AM

The Psychology of a Horror Movie Fan

Scientists have tried to figure out the appeal of axe murderers and creepy dolls, but it mostly remains a spooky mystery.


October 31 • 4:00 AM

The Power of Third Person Plural on Support for Public Policies

Researchers find citizens react differently to policy proposals when they’re framed as impacting “people,” as opposed to “you.”


October 30 • 4:00 PM

I Should Have Told My High School Students About My Struggle With Drinking

As a teacher, my students confided in me about many harrowing aspects of their lives. I never crossed the line and shared my biggest problem with them—but now I wish I had.


October 30 • 2:00 PM

How Dark Money Got a Mining Company Everything It Wanted

An accidentally released court filing reveals how one company secretly gave money to a non-profit that helped get favorable mining legislation passed.


October 30 • 12:00 PM

The Halloween Industrial Complex

The scariest thing about Halloween might be just how seriously we take it. For this week’s holiday, Americans of all ages will spend more than $5 billion on disposable costumes and bite-size candy.


October 30 • 10:00 AM

Sky’s the Limit: The Case for Selling Air Rights

Lower taxes and debt, increased revenue for the city, and a much better use of space in already dense environments: Selling air rights and encouraging upward growth seem like no-brainers, but NIMBY resistance and philosophical barriers remain.


October 30 • 9:00 AM

Cycles of Fear and Bias in the Criminal Justice System

Exploring the psychological roots of racial disparity in U.S. prisons.


October 30 • 8:00 AM

How Do You Make a Living, Email Newsletter Writer?

Noah Davis talks to Wait But Why writer Tim Urban about the newsletter concept, the research process, and escaping “money-flushing toilet” status.



October 30 • 6:00 AM

Dreamers of the Carbon-Free Dream

Can California go full-renewable?


October 30 • 5:08 AM

We’re Not So Great at Rejecting Each Other

And it’s probably something we should work on.


October 30 • 4:00 AM

He’s Definitely a Liberal—Just Check Out His Brain Scan

New research finds political ideology can be easily determined by examining how one’s brain reacts to disgusting images.


October 29 • 4:00 PM

Should We Prosecute Climate Change Protesters Who Break the Law?

A conversation with Bristol County, Massachusetts, District Attorney Sam Sutter, who dropped steep charges against two climate change protesters.


October 29 • 2:23 PM

Innovation Geography: The Beginning of the End for Silicon Valley

Will a lack of affordable housing hinder the growth of creative start-ups?


October 29 • 2:00 PM

Trapped in the Tobacco Debt Trap

A refinance of Niagara County, New York’s tobacco bonds was good news—but for investors, not taxpayers.


October 29 • 12:00 PM

Purity and Self-Mutilation in Thailand

During the nine-day Phuket Vegetarian Festival, a group of chosen ones known as the mah song torture themselves in order to redirect bad luck and misfortune away from their communities and ensure a year of prosperity.


October 29 • 10:00 AM

Can Proposition 47 Solve California’s Problem With Mass Incarceration?

Reducing penalties for low-level felonies could be the next step in rolling back draconian sentencing laws and addressing the criminal justice system’s long legacy of racism.


October 29 • 9:00 AM

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.


October 29 • 8:00 AM

America’s Bathrooms Are a Total Failure

No matter which American bathroom is crowned in this year’s America’s Best Restroom contest, it will still have a host of terrible flaws.


Follow us


Levels of Depression Could Be Evaluated Through Measurements of Acoustic Speech

Engineers find tell-tale signs in speech patterns of the depressed.

We’re Not So Great at Rejecting Each Other

And it's probably something we should work on.

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.

Incumbents, Pray for Rain

Come next Tuesday, rain could push voters toward safer, more predictable candidates.

Could Economics Benefit From Computer Science Thinking?

Computational complexity could offer new insight into old ideas in biology and, yes, even the dismal science.

The Big One

One town, Champlain, New York, was the source of nearly half the scams targeting small businesses in the United States last year. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.