Menus Subscribe Search

Quick Studies

robo eyes

(Photo: ARTEMENKO VALENTYN/Shutterstock

Computers See Human Pain Better Than You

• March 21, 2014 • 1:20 PM

(Photo: ARTEMENKO VALENTYN/Shutterstock

A new study reveals that expression recognition software performs way better than humans at discriminating between real and fake emotion.

Computers can kick our butts at math, logic, and chess—by now, that’s a given. But reading emotions, most of us probably would like to believe, is a skill reserved for humans. Isn’t that a big part of what separates us from machines in the first place?

Well, not anymore. In a study published this week in Current Biology, researchers led by the University of California-San Diego’s Marian Bartlett pitted humans against computers in a battle to see who could best distinguish between genuine and faked facial expressions of pain. We lost, by a lot.

In the experiment, more than 150 participants were shown short videos of the faces of people who either dunked their arms in ice water or pretended to dunk their arms in ice water. The group was asked to gauge the authenticity of each pained reaction, and succeeded in weeding out the fakers from the true sufferers only 51.9 percent of the time—no more accurate than if they simply had left their guess to chance.

Faked-Pain-imageWhich video screenshot shows this woman experiencing actual pain? (Photo: University of California-San Diego) (Answer: B)

Next, the researchers showed the same videos to computers with special expression recognition software. The computers’ accuracy? Eighty-five percent.

That the humans performed so poorly actually is no surprise. Scientists have known for a while that even trained physicians can’t reliably differentiate between real and faked pain expressions.

But the computers’ results were unprecedented. Bartlett and her colleagues call the success of the recognition software “a significant milestone for machine vision systems.” While computers’ logical prowess has been demonstrated for decades, the machines “have significantly underperformed compared to humans at perceptual processes, rarely reaching even the level of a human child.”

The secret to computers’ improvement, the researchers explain, is their newly refined ability to exploit one of our own physiological quirks. Two distinct motor pathways control our facial movements, one for the expressions we choose to make and the other for expressions we make spontaneously in reaction to something. When we attempt to mimic an emotion like pain, the former pathway directs our features based on what it estimates that emotion is supposed to look like, without any definitive blueprint to follow. Inevitably, small differences crop up that are too subtle for the naked eye, but not the digital lens.

“The single most predictive feature of falsified expressions of pain is the dynamics of the mouth opening,” which alone can account for 72 percent of the accuracy, the researchers write.

It’s not hard to spin the computers’ emotional savviness as a harbinger of machine domination, but Bartlett and her colleagues prefer to look at more practical applications. These include preventing insurance fraud by catching patients who lie to their doctors, improving homeland security, and exposing students who only pretend to pay attention in class.

Heightened surveillance of our expressions could have big costs, too, of course. The software, like many new technologies, leaves us with a big question: How much do we really want computers to know?

Paul Bisceglio
Editorial Fellow Paul Bisceglio was previously an editorial intern at Smithsonian magazine and a staff reporter at Manhattan Media. He is a graduate of Haverford College and completed a Fulbright scholarship at the University of Warwick in Coventry, United Kingdom. Follow him on Twitter @PaulBisceglio.

More From Paul Bisceglio

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

August 27 • 6:00 AM

Speaking Eyebrow: Your Face Is Saying More Than You Think

How we gesture—or how we involuntarily move our hands, face, and eyes while speaking—takes on different “accents” depending on our cultural background.


August 27 • 4:00 AM

The Politics of Anti-NIMBYism and Addressing Housing Affordability

Respected expert economists like Paul Krugman and Edward Glaeser are confusing readers with their poor grasp of demography.


August 26 • 4:00 PM

Marching in Sync May Increase Aggression

Another danger of militarizing the police: Marching in lock step doesn’t just intimidate opponents. It impacts the mindset of the marchers.


August 26 • 3:03 PM

The Best Reporting on the Federal Push to Militarize Local Police With Riot Gear, Armored Vehicles, and Assault Rifles

A few facts you might have missed about the flow of military equipment and tactics to local law enforcement.


August 26 • 2:00 PM

How the Other 23 Percent Live

Almost one-fourth of all children in the United States are now living in poverty, an increase of three million kids since 2005.


August 26 • 12:00 PM

Why Sports Need Randomness

Noah Davis talks to David Sally, one of the authors of The Numbers Game: Why Everything You Know About Soccer Is Wrong, about how uncertainty affects and enhances the games we watch.


August 26 • 10:00 AM

Honor: The Cause of—and Solution to—All of Society’s Problems

Recent research on honor culture, associated with the American South and characterized by the need to retaliate against any perceived improper conduct, goes way beyond conventional situations involving disputes and aggression.



August 26 • 8:00 AM

The Transformative Effects of Bearing Witness

How witnessing inmate executions affects those who watch, and how having an audience present can also affect capital punishment process and policy.



August 26 • 7:15 AM

Being a Couch Potato: Not So Bad After All?

For those who feel guilty about watching TV, a new study provides redemption.


August 26 • 6:00 AM

Redesigning Birth Control in the Developing World

How single-use injectable contraceptives could change family planning in Africa.


August 26 • 4:15 AM

How Gay Men Feel About Aging

Coming to terms with growing old can be difficult in the gay community. But middle-aged men are inventing new strategies to cope.


August 25 • 4:00 PM

What to Look for In Dueling Autopsies of Michael Brown

The postmortem by Michael Baden is only the beginning as teams of specialists study the body of an 18-year-old African American killed by police in Ferguson, Missouri.


August 25 • 2:00 PM

Thoughts That Can’t Be Thought and Ideas That Can’t Be Formed: The Promise of Smart Drugs

Are we asking the right questions about smart drugs? Marek Kohn looks at what they can do for us—and what they can’t.


August 25 • 12:00 PM

Does Randomness Actually Exist?

Our human minds are incapable of truly answering that question.


August 25 • 10:31 AM

Cesareans Are Still Best for Feet-First Babies

A new study confirms that surgery is the safest way to deliver a breech fetus.


August 25 • 10:00 AM

What Can Hurricanes Teach Us About Socioeconomic Mobility?

Hurricane Katrina wrought havoc on New Orleans but, nine years later, is there a silver lining to be found?


August 25 • 8:00 AM

How Low Voter Turnout Helps Public Employees

To a surprising degree, as voter turnout goes down, public employee compensation goes up.


August 25 • 6:00 AM

Beyoncé Isn’t an Anti-Feminist Terrorist

A new book called Staging the Blues shows she’s embracing a tradition of multi-dimensional stardom, rather than one racist trope.


August 25 • 4:00 AM

A Tale of Two Abortion Wars

While pro-life activists fight to rescue IVF embryos from the freezer, pregnant women in their third trimester with catastrophic fetal anomalies have nowhere to turn.


August 22 • 4:00 PM

The Invention of the Illegal Immigrant

It’s only fairly recently that we started to use the term that’s so popular right now.



August 22 • 2:00 PM

What Can U.S. Health Care Learn From the Ebola Outbreak?

A conversation with Jeanine Thomas, patient advocate, active member of ProPublica’s Patient Harm Facebook Community, and founder and president of the MRSA Survivors Network.


August 22 • 1:22 PM

Two Executions and the Unity of Mourning

The recent deaths of Michael Brown and James Foley, while worlds apart, are both emblematic of the necessity for all of us to fight to uphold the sanctity of human dignity and its enduring story.


Follow us


Subscribe Now

Being a Couch Potato: Not So Bad After All?

For those who feel guilty about watching TV, a new study provides redemption.

How Gay Men Feel About Aging

Coming to terms with growing old can be difficult in the gay community. But middle-aged men are inventing new strategies to cope.

Cesareans Are Still Best for Feet-First Babies

A new study confirms that surgery is the safest way to deliver a breech fetus.

The Impossibility of the Night Shift

Many night workers get “shift-work sleep disorder.” And no one knows how to treat it.

How the Brains of Risk-Taking Teens Work

There's heightened functional connectivity between the brain's emotion regulator and reason center, according to a recent neuroscience paper.

The Big One

One in two full-time American fast-food workers' families are enrolled in public assistance programs, at a cost of $7 billion per year. July/August 2014 fast-food-big-one

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.