Top
Best
New

Posted by ilamont 23 hours ago

OpenAI’s head of ethics leaves less than a year after joining(www.ft.com)
https://archive.ph/W48UV

https://aimagazine.com/news/why-did-openai-head-of-ethics-ch...

441 points | 426 commentspage 2
fwipsy 20 hours ago|
> In recent times, Johannes Heidecke, Head of OpenAI's Safety Systems team, also left the company – as did OpenAI’s Chief Futurist Joshua Achiam.

It's OK though, they don't need an ethics team because everyone at OpenAI is ethical:

> “AI ethics doesn’t live with one owner or team at OpenAI and ethical considerations are deeply embedded into the model-building process driven by a number of teams across research."

fsuts 13 hours ago||
Surprised she left as probably had stock options.

But she was Meta before so can’t be a question of her principles, so indicates a personal reason

mikeryan 19 hours ago||
Every OpenAI news cycle the board members who were unceremoniously dumped in the wake of trying to fire Sam prior to the transition to a “for profit” company seem to be proven right.
riazrizvi 3 hours ago||
I guess working on ethics for Meta's social media recommendation and flagging algorithms isn't meeting the moment or need of OpenAI where LLMs are breaking out of sandboxes and there's a pressing question of what is okay for an LLM to conversationally engage in bc lawsuits. Seems to me they need someone with more of a language and AI background.
wxw 15 hours ago||
> Previously, she was chief ethicist at Meta.

She spent 6 years at Meta. I get the sense there are other factors at play than "ethics departments are just PR stunts". There's no way she isn't already aware of that. Unfortunately, the article is light on any other details.

alexashka 13 hours ago||
She probably had the epiphany that life is short and she's already rich.

It takes a surprising amount of time for nepo babies to realize life is about more than making sure you're doing at least as good as other nepo babies you grew up with.

fn-mote 11 hours ago||
> She probably had the epiphany that life is short and she's already rich.

This is a very optimistic take. Most people don’t take this route, so without evidence I don’t think it should be a first guess.

No information does not mean “everything was good”. Usually the opposite.

beloch 15 hours ago|||
If "ethics departments are just PR stunts", then Bakalar would have been a terrible hire for OpenAI. Facebook's grudging and lacklustre response to their role in the Rohingya genocide would have happened mostly under her watch. While she was there, Meta went from being a company that lacks ethics to a company that lacks ethics and is widely perceived as lacking ethics. Perhaps she was the only person in the room raising ethical issues, but it's clear nobody at Meta listened to her if she was.

It's possible she came to view her role at Meta as having enabled the company to continue its bad behaviour and decided against doing the same thing at OpenAI. Alternatively, things at OpenAI could be so bad that an ethicist who stuck with Meta for 6 years decided she couldn't stay any longer. Either way, from a PR perspective, this is spherically awful for OpenAI.

This comes at a time when there is huge pushback against all AI companies due to, in large part, ethical concerns. As with Flock, there is the threat that physical infrastructure, such as data-centres, could be attacked if nothing is done to win back public opinion. OpenAI would be wise to take Bakalar's departure seriously.

cm2012 14 hours ago|||
She made Meta the most serious of all the ad platforms on transparency, then. I work in the industry and Meta led the field then in public ad libraries, political restrictions, mandatory ad disclosures, etc.
teiferer 14 hours ago||||
> This comes at a time when there is huge pushback against all AI companies due to, in large part, ethical concerns.

I don't think ethics is fueling the outrage. It's people not wanting big noisy data centers close to their communities, driving up utility costs. Nobody would care if these things stood in Africa. Just like people don't want wind turbines close by but have no issue with them being abroad or in $remote_location or uranium mines polluting a far away country.

kmeisthax 14 hours ago||
Sir, what you have described is an ethics concern.
teiferer 14 hours ago||
2nd level, yes. The concern about what people are having concerns about.
dtmooreiv 14 hours ago||||
An aside, but what does "spherically awful" mean?
m-ee 14 hours ago|||
Bad no matter which side you look at it. Fritz Zwicky coined the term as spherical bastard
randysalami 14 hours ago|||
All-around awful?
bigyabai 14 hours ago||||
People say this, like "oh you'll never get a job in this industry again!" but seem to ignore that these incidents count as professional experience. It's possible that she was screened on the Rohingya situation when she was interviewing for the position, or mentioned it when she was asked about challenging or conflicting narratives she received from the executives. It's likely that her response was what qualified her for the job at OpenAI, there were probably hundreds of candidates that had never even come close to that level of damage control.

Again, look at Sam Altman and tell me with a straight face that he's hiring goody-two-shoes to fill these seats. He knows where the puck is headed, OpenAI's use by the state will be ugly and they need "ethicists" to help assuage the PR disaster. Considering that Meta's still afloat, she didn't completely abdicate her responsibility there. She might be just what OpenAI needs to avoid being lambasted for military and surveillance use.

kmeisthax 14 hours ago|||
From everything I've read in Careless People, basically everything people like us complained about with Facebook was already known internally, people raised concerns about it, and Zuck brushed them off because he is, ultimately, a petty tyrant who wants nothing more than to be loved, and who has surrounded himself with people who are willing to sell that love for power.

Also, you should read Careless People, if only because Facebook is trying its darnedest to censor the author.

As for OpenAI, I already hated the company pre-Sam Altman takeover because AI safety seemed like an excuse to brush away ethics concerns (e.g. "stealing training data is fine because if we don't withhold model weights the model might do something evil"). Post-Sam, I hate the company because they are now ignoring both the AI safety and ethics concerns.

...if you're wondering what the difference is, AI safety is roughly "making sure the AI doesn't do something bad" and AI ethics is "making sure we don't do something bad making the AI". There's a bit of a rivalry between the two, mainly because the former group managed to present their concerns in more business-palatable ways and thus won all the CxO level arguments. Even the most decelerationist AI safety takes are ultimately criti-hype: OpenAI's model breaking containment and hacking HuggingFace is an awful safety outcome, but it's also good marketing for an industry beleaguered by bubble concerns. You can't turn "AI is trained on stolen data" into hype.

throwa356262 15 hours ago||
[flagged]
stock_toaster 9 hours ago|||
Wow. Someone could be "chief ethicist at Meta" under Zuckerberg for 6 years, but couldn't make it even a single year under Altman.

That's an interesting data point.

mtlynch 12 hours ago||||
Strangely, a few years ago, Facebook hired a rabbi and appointed him "Director of Responsible Innovation."[0]

He did an interview on Search Engine that I thought was interesting,[1] but it definitely seemed like there was more to the story than just, "Facebook needed to be ethical, and this guy was so good at ethics that he decided to help out."

[0] https://chochmat.org/rabbi-zvika-krieger/

[1] https://www.searchengine.show/what-does-it-feel-like-to-beli...

aaroninsf 15 hours ago|||
This 100%.

Even in the target-rich environment of late-stage kleptocratic surveillance capitalism, it is hard to pick out a less ethical firm which has done more moral and direct harm, to more people, with as durable a record of defying all attempts and internal and external at harm reduction.

Never use their products. Never partner. Never participate.

jstummbillig 14 hours ago||
People love stories. The reasons why people leave companies are plentiful, even in normal times and unextraordinary circumstances, and a high profile job in a frontier lab today ticks neither box.
smarm52 15 hours ago||
Must be tough to do the job when the entire company is aligned against you.
coldtea 3 hours ago||
OpenAI's "head of ethics"? Does the Serial Killer Guild have such a position too?
abc42 6 hours ago||
I've thought of AI ethics as trying to answer the question of what kind of life we are creating here. Sort of like if a chicken factory farm employed an ethicist.
p0w3n3d 5 hours ago|
Marketing and management - the root of 50-80% of evil in the word (or as Christians say: greed - second deadly sin)
More comments...