Menus Subscribe Search

Quick Studies

robo eyes

(Photo: ARTEMENKO VALENTYN/Shutterstock

Computers See Human Pain Better Than You

• March 21, 2014 • 1:20 PM

(Photo: ARTEMENKO VALENTYN/Shutterstock

A new study reveals that expression recognition software performs way better than humans at discriminating between real and fake emotion.

Computers can kick our butts at math, logic, and chess—by now, that’s a given. But reading emotions, most of us probably would like to believe, is a skill reserved for humans. Isn’t that a big part of what separates us from machines in the first place?

Well, not anymore. In a study published this week in Current Biology, researchers led by the University of California-San Diego’s Marian Bartlett pitted humans against computers in a battle to see who could best distinguish between genuine and faked facial expressions of pain. We lost, by a lot.

In the experiment, more than 150 participants were shown short videos of the faces of people who either dunked their arms in ice water or pretended to dunk their arms in ice water. The group was asked to gauge the authenticity of each pained reaction, and succeeded in weeding out the fakers from the true sufferers only 51.9 percent of the time—no more accurate than if they simply had left their guess to chance.

Faked-Pain-imageWhich video screenshot shows this woman experiencing actual pain? (Photo: University of California-San Diego) (Answer: B)

Next, the researchers showed the same videos to computers with special expression recognition software. The computers’ accuracy? Eighty-five percent.

That the humans performed so poorly actually is no surprise. Scientists have known for a while that even trained physicians can’t reliably differentiate between real and faked pain expressions.

But the computers’ results were unprecedented. Bartlett and her colleagues call the success of the recognition software “a significant milestone for machine vision systems.” While computers’ logical prowess has been demonstrated for decades, the machines “have significantly underperformed compared to humans at perceptual processes, rarely reaching even the level of a human child.”

The secret to computers’ improvement, the researchers explain, is their newly refined ability to exploit one of our own physiological quirks. Two distinct motor pathways control our facial movements, one for the expressions we choose to make and the other for expressions we make spontaneously in reaction to something. When we attempt to mimic an emotion like pain, the former pathway directs our features based on what it estimates that emotion is supposed to look like, without any definitive blueprint to follow. Inevitably, small differences crop up that are too subtle for the naked eye, but not the digital lens.

“The single most predictive feature of falsified expressions of pain is the dynamics of the mouth opening,” which alone can account for 72 percent of the accuracy, the researchers write.

It’s not hard to spin the computers’ emotional savviness as a harbinger of machine domination, but Bartlett and her colleagues prefer to look at more practical applications. These include preventing insurance fraud by catching patients who lie to their doctors, improving homeland security, and exposing students who only pretend to pay attention in class.

Heightened surveillance of our expressions could have big costs, too, of course. The software, like many new technologies, leaves us with a big question: How much do we really want computers to know?

Paul Bisceglio
Editorial Fellow Paul Bisceglio was previously an editorial intern at Smithsonian magazine and a staff reporter at Manhattan Media. He is a graduate of Haverford College and completed a Fulbright scholarship at the University of Warwick in Coventry, United Kingdom. Follow him on Twitter @PaulBisceglio.

More From Paul Bisceglio

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

August 1 • 4:00 PM

The Gaps in Federal Law That Are Making It Easy for Lenders to Sue Soldiers

Courts are required to appoint attorneys for service members if they are sued and can’t appear. But the law says little about what those lawyers must do. Some companies have taken advantage.


August 1 • 2:22 PM

Warmer Parenting Makes Antisocial Toddlers More Empathetic

Loving care may be the best antidote to callous behavior in young children.


August 1 • 2:00 PM

The Federal Health Insurance Exchange Remains Surprisingly Active

New federal data, obtained by ProPublica under the Freedom of Information Act, shows nearly one million insurance transactions since mid-April.



August 1 • 6:00 AM

The Idea of Racial Hierarchy Remains Entrenched in Americans’ Psyches

New research finds white faces are most closely associated with positive thoughts and feelings.


August 1 • 4:00 AM

How and Why Does the Social Become Biological?

To get closer to an answer, it’s helpful to look at two things we’ve taught ourselves over time: reading and math.



July 31 • 4:00 PM

Thank You for Your Service: How One Company Sues Soldiers Worldwide

With stores near military bases across the country, the retailer USA Discounters offers easy credit to service members. But when those loans go bad, the company uses the local courts near its Virginia headquarters to file suits by the thousands.


July 31 • 2:00 PM

A New York State of Fracking

Court cases. A governor’s moratorium. Pending health study. A quick guide to the state of fracking in New York.


July 31 • 11:17 AM

How California Could Power Itself Using Nothing but Renewables

We don’t need fossil fuels.


July 31 • 8:00 AM

Should Athletes Train Their Memories?

Sure, but it probably won’t help.


July 31 • 6:00 AM

Universal Basic Income: Something We Can All Agree on?

According to Almaz Zelleke, it’s not a crazy thought.


July 31 • 4:00 AM

Medical Dramas Produce Misinformed, Fatalistic Viewers

New research suggests TV doctor dramas leave viewers with skewed impressions of important health-related topics.


July 30 • 4:00 PM

Still the World’s Top Military Spender

Although declining in real terms, the United States’ military budget remains substantial and a huge drain on our public resources.



July 30 • 2:04 PM

The Rise of the Nuisance Flood

Minor floods are afflicting parts of Maryland nearly 10 times more often than was the case in the 1960s.


July 30 • 2:00 PM

The (Mostly Awful) Things You Learn After Investigating Unpaid Internships for a Year

Though the intern economy remains opaque, dialogue about the role of interns in the labor force—and protections they deserve—is beginning to take shape.


July 30 • 12:00 PM

Why Coffee Shortages Won’t Change the Price of Your Frappuccino

You’re so loyal to Starbucks—and the company knows it—that your daily serving of caffeine is already marked up beyond the reach of any fluctuations in supply.



July 30 • 10:00 AM

Having Difficult Conversations With Your Children

Why it’s necessary, and how to do it.


July 30 • 8:00 AM

How to Make a Convincing Sci-Fi Movie on a Tight Budget

Coherence is a good movie, and its initial shoot cost about the same amount of money as a used Prius.


July 30 • 6:00 AM

Are You Really as Happy as You Say You Are?

Researchers find a universal positivity bias in the way we talk, tweet, and write.


July 30 • 4:00 AM

The Declining Wage Gap for Gay Men

New research finds gay men in America are rapidly catching up with straight married men in terms of wages.


July 30 • 2:00 AM

LeBron James Migration: Big Chef Seeking Small Pond

The King’s return to Cleveland is a symbol for the dramatic shift in domestic as well as international migration.


July 29 • 4:00 PM

Are Children Seeking Refuge Turning More Americans Against Undocumented Immigrants?

A look at Pew Research Center survey data collected in February and July of this year.


Follow us


Subscribe Now

Warmer Parenting Makes Antisocial Toddlers More Empathetic

Loving care may be the best antidote to callous behavior in young children.

The Rise of the Nuisance Flood

Minor floods are afflicting parts of Maryland nearly 10 times more often than was the case in the 1960s.

America’s Streams Are Awash With Pesticides Banned in Europe

You may have never heard of clothianidin, but it's probably in your local river.

How Textbooks Have Changed the Face of War

War is more personal, less glorious, and more hellish in modern textbooks than in the past. But there’s still room for improvement.

The Big One

One in two full-time American fast-food workers' families are enrolled in public assistance programs, at a cost of $7 billion per year. July/August 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.