Menus Subscribe Search

Follow us


software

(PHOTO: ISAK55/SHUTTERSTOCK)

Should All Software Engineers Be Required to Take an Ethics Course?

• September 06, 2013 • 8:00 AM

(PHOTO: ISAK55/SHUTTERSTOCK)

Facebook outing students. Google collecting personal information from wireless networks. A dating app used for stalking. The creators of a new three-day ethics program believe these incidents could have been avoided.

When Irina Raicu first read about a new software program designed to take just a few details about a person, such as gender and hair color, whether or not the person has tattoos, and the number of minor offenses they’ve committed, and accurately predict how likely he or she would be to commit a felony, she got worried.

Not because Raicu, the Internet ethics program manager at Santa Clara University’s Markkula Center for Applied Ethics, is planning to switch to a career outside the law. She was troubled by something Jim Adler, the program’s creator, told a Bloomberg News reporter:

It’s important that geeks and suits and wonks get together and talk about these things … because geeks like me can do stuff like this, we can make stuff work—it’s not our job to figure out if it’s right or not. We often don’t know.

All too often, Raicu said, the geeks and suits and wonks simply don’t get together—at least not until the damage has already been done.

Like when Facebook inadvertently outed a few University of Texas students who had joined Queer Chorus, a student choir group. The president of the chorus added students to the group’s Facebook page, not realizing it would automatically notify all of their Facebook friends—some of whom the students hadn’t yet come out to, including family members who didn’t take the news well, to put it mildly.

Facebook added additional explanations in the Help Center and has since added additional privacy controls, but for at least those students, it was too late.

That’s part of the reason why Raicu thinks the geeks need an education in professional ethics, and worked with the Markkula Center to create a three-day crash course meant to be taken before creating new programs that could potentially affect the lives of consumers.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Irina Raicu said. But that doesn’t mean they’re not there.

Software engineers used to work in big companies where they had checks on the choices they made. “Now, we’re talking about two guys in hoodies in a garage,” Raicu said. They deploy the code now and fix it later. “That’s why we need to get them thinking about this early.”

Software engineering students are required to take the same engineering ethics course any engineering student would, said Shannon Vallor, the software ethics curriculum’s primary author and an associate professor of philosophy at Santa Clara.

In 2000, ABET, the organization that accredits university engineering programs, started formally requiring that every program teach engineering ethics. But Raicu said she doesn’t know of a single engineering ethics course that’s targeted to the challenges specific to software engineering. The classic case studies in engineering textbooks­—such as the Challenger explosion, or the fire-prone Ford Pintos—deal with catastrophic human injuries and deaths that might have been prevented.

That makes sense given the National Society for Professional Engineers’ First Fundamental Canon, which states that an engineer’s most basic ethical duty is “to hold paramount the safety, health, and welfare of the public.” But for software engineers, who build lines of code, not rockets and cars, it’s not so obvious what that duty means. Coders who studied computer science or an entirely unrelated field might never have seen an ethics course at all.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Raicu said. But that doesn’t mean they’re not there. Programmers’ work can also have much greater reach than that of other kinds of engineers, making consequences even more difficult to anticipate, Vallor added.

There’s no ethics checklist, and there probably never will be. Instead, Vallor and Raicu hope to make ethics part of the software development process, something engineers constantly return to as they see how their work is being used.

In other words, they don’t think that if Mark Zuckerberg and company had sat down and had an intellectual discussion about privacy rights when Facebook was in its dorm room infancy, all of our problems—past, present, and future—would be solved.

“Users will always do things with technology that we didn’t anticipate,” Vallor said. “Ethics isn’t a due diligence where you check off the boxes and you’re done.”

Sometimes ethical issues prompt action. After the outcry when Google revealed that Street View vehicles had been “wardriving”—collecting and storing personal information from unsecured wireless networks—in 2010, the company temporarily grounded Street View cars, appointed a director of privacy to monitor engineering, trained employees on responsible data collection and use, and added stronger privacy protections for its projects. But often there’s simply an apologetic acknowledgement coupled with a resigned sigh to the effect that technology simply moves faster than laws and social norms. Eventually people will adapt.

That struck Raicu as odd. “At some point, it became acceptable that instead of technology meeting our needs, it creates needs and we’ll catch up.” she said. “Why not make technology that’s responsive to what we need and want?”

Any technology creates disruption. Just ask the horse and buggy industry. The difference, Raicu said, is that with software, most people don’t understand the changes under way. It’s hard for people to discuss privacy and the Internet when they don’t really know what’s being collected, or how. She hopes programmers eventually get better at communicating with non-geeks, and take more responsibility for ethical choices before problems get to the lawyers.

The Markkula Center’s course module was released earlier this month and so far seven schools have signed on. Vallor is already working on a follow-up edition, including more case studies.

For example, there’s the Girls Around Me app, which picked up personal data from nearby phones to identify and message single women in the users’ vicinity. It was pulled from Apple’s App Store, but only after an outcry from smartphone users who saw it as less a tool for dating than stalking.

Or Twitter’s new in-tweet “report abuse” button. How can programmers promote free speech without making it so users have no remedy for harassment?

What do Vallor and Raicu hope for? For starters, a more carefully considered approach to development—just because coders can do something doesn’t necessarily mean that they should—combined with more dialogue between the geeks and, well, everybody else.

“These kids are smart, but they’re not used to thinking about ethics in the context of their profession,” Raicu said. “We’re hoping that if we can get professors to talk about this, at least for a day, students will take it from there.”

Lauren Zumbach
Lauren Zumbach is a freelance journalist based in Chicago. She has written for Hemispheres, Forbes India, and the Jakarta Globe. Follow her on Twitter @laurenzumbach.

More From Lauren Zumbach

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 22 • 2:00 PM

Turning Public Education Into Private Profits

Baker Mitchell is a politically connected North Carolina businessman who celebrates the power of the free market. Every year, millions of public education dollars flow through Mitchell’s chain of four non-profit charter schools to for-profit companies he controls.


October 22 • 12:00 PM

Will the End of a Tax Loophole Kill Off Irish Business and Force Google and Apple to Pay Up?

U.S. technology giants have constructed international offices in Dublin in order to take advantage of favorable tax policies that are now changing. But Ireland might have enough other draws to keep them there even when costs climb.


October 22 • 10:00 AM

Veterans in the Ivory Tower

Why there aren’t enough veterans at America’s top schools—and what some people are trying to do to change that.


October 22 • 8:00 AM

Our Language Prejudices Don’t Make No Sense

We should embrace the fact that there’s no single recipe for English. Making fun of people for replacing “ask” with “aks,” or for frequently using double negatives just makes you look like the unsophisticated one.


October 22 • 7:04 AM

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.


October 22 • 6:00 AM

How We Form Our Routines

Whether it’s a morning cup of coffee or a glass of warm milk before bed, we all have our habitual processions. The way they become engrained, though, varies from person to person.


October 22 • 4:00 AM

For Preschoolers, Spite and Smarts Go Together

New research from Germany finds greater cognitive skills are associated with more spiteful behavior in children.


October 21 • 4:00 PM

Why the Number of Reported Sexual Offenses Is Skyrocketing at Occidental College

When you make it easier to report assault, people will come forward.


October 21 • 2:00 PM

Private Donors Are Supplying Spy Gear to Cops Across the Country Without Any Oversight

There’s little public scrutiny when private donors pay to give police controversial technology and weapons. Sometimes, companies are donors to the same foundations that purchase their products for police.


October 21 • 12:00 PM

How Clever Do You Think Your Dog Is?

Maybe as smart as a four-year-old child?


October 21 • 10:00 AM

Converting the Climate Change Non-Believers

When hard science isn’t enough, what can be done?



October 21 • 8:00 AM

Education Policy Is Stuck in the Manufacturing Age

Refining our policies and teaching social and emotional skills will help us to generate sustained prosperity.


October 21 • 7:13 AM

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you’ve (almost) got yourself a low-cost way to remove arsenic from drinking water.


October 21 • 6:00 AM

Fruits and Vegetables Are About to Enter a Flavor Renaissance

Chefs are teaming up with plant breeders to revitalize bland produce with robust flavors and exotic beauty—qualities long neglected by industrial agriculture.


October 21 • 4:00 AM

She’s Cheating on Him, You Can Tell Just by Watching Them

New research suggests telltale signs of infidelity emerge even in a three- to five-minute video.


October 21 • 2:00 AM

Cheating Demographic Doom: Pittsburgh Exceptionalism and Japan’s Surprising Economic Resilience

Don’t judge a metro or a nation-state by its population numbers.


October 20 • 4:00 PM

The Bird Hat Craze That Sparked a Preservation Movement

How a fashion statement at the turn of the 19th century led to the creation of the first Audubon societies.


October 20 • 2:00 PM

The Risk of Getting Killed by the Police If You Are White, and If You Are Black

An analysis of killings by police shows outsize risk for young black males.


October 20 • 12:00 PM

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they’re motivated by love while their enemies are motivated by hate.


October 20 • 11:00 AM

My Dog Comes First: The Importance of Pets to Homeless Youth

Dogs and cats have both advantages and disadvantages for street-involved youth.


October 20 • 10:00 AM

Homophobia Is Not a Thing of the Past

Despite growing support for LGBT rights and recent decisions from the Supreme Court regarding the legality of same-sex marriage, the battle for acceptance has not yet been decided.


October 20 • 8:00 AM

Big Boobs Matter Most

Medical mnemonics are often scandalous and sexist, but they help the student to both remember important facts and cope with challenging new experiences.


October 20 • 6:00 AM

When Disease Becomes Political: The Likely Electoral Fallout From Ebola

Will voters blame President Obama—and punish Democrats in the upcoming mid-term elections—for a climate of fear?


October 20 • 4:00 AM

Coming Soon: The Anatomy of Ignorance


Follow us


My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you've (almost) got yourself a low-cost way to remove arsenic from drinking water.

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they're motivated by love while their enemies are motivated by hate.

How to Water a Farm in Sandy Ground

Physicists investigate how to grow food more efficiently in fine-grained soil.

Unlocking Consciousness

A study of vegetative patients closes in on the nature of consciousness.

The Big One

One company, Amazon, controls 67 percent of the e-book market in the United States—down from 90 percent five years ago. September/October 2014 new-big-one-5

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.