Menus Subscribe Search

Follow us


software

(PHOTO: ISAK55/SHUTTERSTOCK)

Should All Software Engineers Be Required to Take an Ethics Course?

• September 06, 2013 • 8:00 AM

(PHOTO: ISAK55/SHUTTERSTOCK)

Facebook outing students. Google collecting personal information from wireless networks. A dating app used for stalking. The creators of a new three-day ethics program believe these incidents could have been avoided.

When Irina Raicu first read about a new software program designed to take just a few details about a person, such as gender and hair color, whether or not the person has tattoos, and the number of minor offenses they’ve committed, and accurately predict how likely he or she would be to commit a felony, she got worried.

Not because Raicu, the Internet ethics program manager at Santa Clara University’s Markkula Center for Applied Ethics, is planning to switch to a career outside the law. She was troubled by something Jim Adler, the program’s creator, told a Bloomberg News reporter:

It’s important that geeks and suits and wonks get together and talk about these things … because geeks like me can do stuff like this, we can make stuff work—it’s not our job to figure out if it’s right or not. We often don’t know.

All too often, Raicu said, the geeks and suits and wonks simply don’t get together—at least not until the damage has already been done.

Like when Facebook inadvertently outed a few University of Texas students who had joined Queer Chorus, a student choir group. The president of the chorus added students to the group’s Facebook page, not realizing it would automatically notify all of their Facebook friends—some of whom the students hadn’t yet come out to, including family members who didn’t take the news well, to put it mildly.

Facebook added additional explanations in the Help Center and has since added additional privacy controls, but for at least those students, it was too late.

That’s part of the reason why Raicu thinks the geeks need an education in professional ethics, and worked with the Markkula Center to create a three-day crash course meant to be taken before creating new programs that could potentially affect the lives of consumers.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Irina Raicu said. But that doesn’t mean they’re not there.

Software engineers used to work in big companies where they had checks on the choices they made. “Now, we’re talking about two guys in hoodies in a garage,” Raicu said. They deploy the code now and fix it later. “That’s why we need to get them thinking about this early.”

Software engineering students are required to take the same engineering ethics course any engineering student would, said Shannon Vallor, the software ethics curriculum’s primary author and an associate professor of philosophy at Santa Clara.

In 2000, ABET, the organization that accredits university engineering programs, started formally requiring that every program teach engineering ethics. But Raicu said she doesn’t know of a single engineering ethics course that’s targeted to the challenges specific to software engineering. The classic case studies in engineering textbooks­—such as the Challenger explosion, or the fire-prone Ford Pintos—deal with catastrophic human injuries and deaths that might have been prevented.

That makes sense given the National Society for Professional Engineers’ First Fundamental Canon, which states that an engineer’s most basic ethical duty is “to hold paramount the safety, health, and welfare of the public.” But for software engineers, who build lines of code, not rockets and cars, it’s not so obvious what that duty means. Coders who studied computer science or an entirely unrelated field might never have seen an ethics course at all.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Raicu said. But that doesn’t mean they’re not there. Programmers’ work can also have much greater reach than that of other kinds of engineers, making consequences even more difficult to anticipate, Vallor added.

There’s no ethics checklist, and there probably never will be. Instead, Vallor and Raicu hope to make ethics part of the software development process, something engineers constantly return to as they see how their work is being used.

In other words, they don’t think that if Mark Zuckerberg and company had sat down and had an intellectual discussion about privacy rights when Facebook was in its dorm room infancy, all of our problems—past, present, and future—would be solved.

“Users will always do things with technology that we didn’t anticipate,” Vallor said. “Ethics isn’t a due diligence where you check off the boxes and you’re done.”

Sometimes ethical issues prompt action. After the outcry when Google revealed that Street View vehicles had been “wardriving”—collecting and storing personal information from unsecured wireless networks—in 2010, the company temporarily grounded Street View cars, appointed a director of privacy to monitor engineering, trained employees on responsible data collection and use, and added stronger privacy protections for its projects. But often there’s simply an apologetic acknowledgement coupled with a resigned sigh to the effect that technology simply moves faster than laws and social norms. Eventually people will adapt.

That struck Raicu as odd. “At some point, it became acceptable that instead of technology meeting our needs, it creates needs and we’ll catch up.” she said. “Why not make technology that’s responsive to what we need and want?”

Any technology creates disruption. Just ask the horse and buggy industry. The difference, Raicu said, is that with software, most people don’t understand the changes under way. It’s hard for people to discuss privacy and the Internet when they don’t really know what’s being collected, or how. She hopes programmers eventually get better at communicating with non-geeks, and take more responsibility for ethical choices before problems get to the lawyers.

The Markkula Center’s course module was released earlier this month and so far seven schools have signed on. Vallor is already working on a follow-up edition, including more case studies.

For example, there’s the Girls Around Me app, which picked up personal data from nearby phones to identify and message single women in the users’ vicinity. It was pulled from Apple’s App Store, but only after an outcry from smartphone users who saw it as less a tool for dating than stalking.

Or Twitter’s new in-tweet “report abuse” button. How can programmers promote free speech without making it so users have no remedy for harassment?

What do Vallor and Raicu hope for? For starters, a more carefully considered approach to development—just because coders can do something doesn’t necessarily mean that they should—combined with more dialogue between the geeks and, well, everybody else.

“These kids are smart, but they’re not used to thinking about ethics in the context of their profession,” Raicu said. “We’re hoping that if we can get professors to talk about this, at least for a day, students will take it from there.”

Lauren Zumbach
Lauren Zumbach is a freelance journalist based in Chicago. She has written for Hemispheres, Forbes India, and the Jakarta Globe. Follow her on Twitter @laurenzumbach.

More From Lauren Zumbach

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 31 • 6:12 AM

The Psychology of a Horror Movie Fan

Scientists have tried to figure out the appeal of axe murderers and creepy dolls, but it mostly remains a spooky mystery.


October 31 • 4:00 AM

The Power of Third Person Plural on Support for Public Policies

Researchers find citizens react differently to policy proposals when they’re framed as impacting “people,” as opposed to “you.”


October 30 • 4:00 PM

I Should Have Told My High School Students About My Struggle With Drinking

As a teacher, my students confided in me about many harrowing aspects of their lives. I never crossed the line and shared my biggest problem with them—but now I wish I had.


October 30 • 2:00 PM

How Dark Money Got a Mining Company Everything It Wanted

An accidentally released court filing reveals how one company secretly gave money to a non-profit that helped get favorable mining legislation passed.


October 30 • 12:00 PM

The Halloween Industrial Complex

The scariest thing about Halloween might be just how seriously we take it. For this week’s holiday, Americans of all ages will spend more than $5 billion on disposable costumes and bite-size candy.


October 30 • 10:00 AM

Sky’s the Limit: The Case for Selling Air Rights

Lower taxes and debt, increased revenue for the city, and a much better use of space in already dense environments: Selling air rights and encouraging upward growth seem like no-brainers, but NIMBY resistance and philosophical barriers remain.


October 30 • 9:00 AM

Cycles of Fear and Bias in the Criminal Justice System

Exploring the psychological roots of racial disparity in U.S. prisons.


October 30 • 8:00 AM

How Do You Make a Living, Email Newsletter Writer?

Noah Davis talks to Wait But Why writer Tim Urban about the newsletter concept, the research process, and escaping “money-flushing toilet” status.



October 30 • 6:00 AM

Dreamers of the Carbon-Free Dream

Can California go full-renewable?


October 30 • 5:08 AM

We’re Not So Great at Rejecting Each Other

And it’s probably something we should work on.


October 30 • 4:00 AM

He’s Definitely a Liberal—Just Check Out His Brain Scan

New research finds political ideology can be easily determined by examining how one’s brain reacts to disgusting images.


October 29 • 4:00 PM

Should We Prosecute Climate Change Protesters Who Break the Law?

A conversation with Bristol County, Massachusetts, District Attorney Sam Sutter, who dropped steep charges against two climate change protesters.


October 29 • 2:23 PM

Innovation Geography: The Beginning of the End for Silicon Valley

Will a lack of affordable housing hinder the growth of creative start-ups?


October 29 • 2:00 PM

Trapped in the Tobacco Debt Trap

A refinance of Niagara County, New York’s tobacco bonds was good news—but for investors, not taxpayers.


October 29 • 12:00 PM

Purity and Self-Mutilation in Thailand

During the nine-day Phuket Vegetarian Festival, a group of chosen ones known as the mah song torture themselves in order to redirect bad luck and misfortune away from their communities and ensure a year of prosperity.


October 29 • 10:00 AM

Can Proposition 47 Solve California’s Problem With Mass Incarceration?

Reducing penalties for low-level felonies could be the next step in rolling back draconian sentencing laws and addressing the criminal justice system’s long legacy of racism.


October 29 • 9:00 AM

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.


October 29 • 8:00 AM

America’s Bathrooms Are a Total Failure

No matter which American bathroom is crowned in this year’s America’s Best Restroom contest, it will still have a host of terrible flaws.



October 29 • 6:00 AM

Tell Us What You Really Think

In politics, are we always just looking out for No. 1?


October 29 • 4:00 AM

Racial Resentment Drives Tea Party Membership

New research finds a strong link between tea party membership and anti-black feelings.


October 28 • 4:00 PM

The New Health App on Apple’s iOS 8 Is Literally Dangerous

Design isn’t neutral. Design is a picture of inequality, of systems of power, and domination both subtle and not. Apple should know that.


October 28 • 2:00 PM

And You Thought Your Credit Card Debt Was Bad

In Niagara County, New York, leaders took on 40-year debt to pay for short-term stuff, a case study in the perverse incentives tobacco bonds create.



Follow us


We’re Not So Great at Rejecting Each Other

And it's probably something we should work on.

Chronic Fatigue Syndrome and the Brain

Neuroscientists find less—but potentially stronger—white matter in the brains of patients with CFS.

Incumbents, Pray for Rain

Come next Tuesday, rain could push voters toward safer, more predictable candidates.

Could Economics Benefit From Computer Science Thinking?

Computational complexity could offer new insight into old ideas in biology and, yes, even the dismal science.

Politicians Really Aren’t Better Decision Makers

Politicians took part in a classic choice experiment but failed to do better than the rest of us.

The Big One

One town, Champlain, New York, was the source of nearly half the scams targeting small businesses in the United States last year. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.