Top
Best
New

Posted by ilamont 1 day ago

OpenAI’s head of ethics leaves less than a year after joining(www.ft.com)
https://archive.ph/W48UV

https://aimagazine.com/news/why-did-openai-head-of-ethics-ch...

465 points | 440 commentspage 5
jongjong 6 hours ago|
Wow. How much does this job pay? Google says $550k to $1.3 million.

For that kind of money, my AI paymaster could do no wrong.

Imagine going to work and getting paid $2300+ USD per day to sit on your ass all day thinking about ethics without having to produce any deliverables. This would be a dream job for me.

If anyone questioned my morals, I'd be like; "They're paying me $550k per year" and the other person would be like "Ahhh ok, my bad! Your logic is starting to make sense now!"

yieldcrv 12 hours ago||
They also completed a tender offer today, so their fake job just made a lot of money and they left
2PqboPPmKegvanx 23 hours ago||
the only shocking thing to me is that they still had even a single one.
d--b 22 hours ago|
Think she's been replaced by an LLM?
kimjune01 13 hours ago||
unfortunately, knowing about ethics doesn't compel you to ethical behavior
not_an_AI 4 hours ago||
I, for one, am shocked that the head of ethics at an AI company has achieved human-level job tenure.
fidotron 1 day ago||
> Before working at OpenAI, she was Meta’s chief ethicist
yreg 23 hours ago||
Where is she going next? Nestle?
jnwatson 22 hours ago|||
Philip Morris.
dgellow 22 hours ago||
ExxonMobile (energy division)
namelosw 19 hours ago||||
Palantir
pixel_popping 21 hours ago|||
Straight to Cocomelon, catch them young'
cyanydeez 1 day ago|||
So more of an ethicist-for-pay than for the challenge of it.
pants2 1 day ago|||
I'd think an ethicist at Meta/OpenAI involves extremely challenging mental gymnastics
outside1234 1 day ago||
Severance in real life
Avicebron 1 day ago||||
Rubber stamp for hire?
onion2k 23 hours ago|||
I'd accept a few hundred grand to reply to emails with "No, the torment nexus is a net benefit.."
sph 17 hours ago|||
That’s exactly the situation they found themselves in, and you are admitting you have no more spine and moral compass than them.

Or are you telling us in the hope someone makes you such an offer?

onion2k 8 hours ago||
[dead]
dgellow 22 hours ago||||
They finally found a way to automate that role with GPT!
cyanydeez 20 hours ago|||
gotta be more verbose if you want the CEO to think you're worth it. Try this:

"Although the torment nexus may torment us in the short term, over the long term there will be fewer people to torment as we improve the capitalization of human's torment so that fewer people will be available to torment duing to the reduction in overall torment-forces globally, and thus, with less people being tormented, surely that will increase the over all torment reduction of the nexus. Win-win: less tormented people means less torment!

Arch-TK 17 hours ago||
It adds up...
Tade0 1 day ago|||
Or someone to assess the impact of all those anti-human ideas shape rotators come up with.
nixon_why69 1 day ago||||
Any ethicist for a corporation is clearly a PR move, right?

Like, a pure researcher for a corporation might have some genuine overlap and shared interests where breakthroughs in the research benefit both parties, but an ethicist?? For a legal construct that's defined by and bound to sociopathically pursue profit? Come on now.

wavemode 21 hours ago|||
It depends on the kind of company, and the context. An ethicist at a company doing drug/medical research probably mostly oversees that the company's research practices are legal and safe (and that participants give informed consent).

At typical corporation, something like a Chief Ethics and Compliance Officer (CECO) would be largely focused on legal compliance - making sure company personnel aren't engaged in bribery, fraud, insider trading etc. The value of this role (and the medical example) is to prevent lawsuits and/or prosecution.

For a company like Meta, an ethicist is likely concerned with the inherent ethical concerns of running a social media company, which impacts the mental health of its users, many of whom are minors. For AI companies, the ethics of releasing models that are capable of doing dangerous things. In name, the job probably involves giving recommendations about how to ethically implement features in the platform to minimize harm. In practice, the job probably accomplishes very little.

2PqboPPmKegvanx 23 hours ago||||
>Any ethicist for a corporation is clearly a PR move, right?

I think a lot of it depends on the size of the company. Startup? Sure, maybe it's a real thing.

Gigantic company like a member of FAANG or MANGOS? absolutely a PR move.

andor 23 hours ago|||
Companies are not bound to sociopathically pursue profit. It would be in their long-term interest to care about stakeholders outside the boardroom, and until a certain person with tiny hands started a war on anything remotely "woke", the market rewarded ESG metrics.
nixon_why69 23 hours ago||
Your point was true prior to 1980 or so, but it's a cultural average. We've had multiple generations of business leaders now trained on seeing the corporate legal entity as only caring about shareholder value and being proud of it and even perversely principled about it.
andor 23 hours ago||
It's true that this is happening a lot. And I think this is one of the reasons why ethicists still want to get involved in these companies: it should be easier to make a company do the right thing from the inside, why else would they hire for these positions? They join with idealism and probably don't get very far in terms of real impact.
nixon_why69 23 hours ago||
> They join with idealism and probably don't get very far in terms of real impact.

I can't disagree with that, reminds me of the quote from the movie Rounders: If you've been at the table for 30 minutes and you don't know who the sucker is, you ARE the sucker.

cindyllm 22 hours ago||
[dead]
jofzar 1 day ago||||
It's silicon valley, literally everything is for pay or be homeless
ltbarcly3 1 day ago||
That's everywhere, there are homeless people everywhere. The difference is Silicon Valley feels so guilty about it's wealth it refuses to do the normal things that societies do to prevent people from living like animals because 'rights' or something, so they let drug addicts live in their common spaces without treatment. This normally isn't tolerated in a functioning society where people are pressured into behaviors that are less self destructive.

When someone isn't competent to make decisions for themselves it's ok to pressure them into engaging in behavior that will lead them to get to a condition where they can start to make decisions for themselves. In Silicon Valley they have let their guilt be leveraged by a corrupt government system that lets grifters steal billions of dollars per year in 'homelessness funding'. Those same grifters fund political groups and bribe politicians. Anyone that questions it is accused of wanting to murder homeless people.

nixon_why69 23 hours ago|||
No, it's actually very unusual to have tons of homeless people next to spectacular wealth, California is a global outlier in this phenomenon.

There are many, many places in the world that are much poorer and don't have homeless encampments all over the place.

ltbarcly3 23 hours ago||
I literally said that.
nixon_why69 23 hours ago||
You said "there are homeless people everywhere", which is technically true but omits quantity, and especially quantity compared to wealth.

I'm not as positive as you are about what makes California (and Seattle) create/attract so many, but it's definitely an outlier compared to "everywhere".

esseph 20 hours ago|||
I'm not as positive as you are about what makes California (and Seattle) create/attract

The weather is pretty nice, much more stable than in the east coast.

ltbarcly3 23 hours ago|||
Yes, if you didn't understand my point: there are homeless people in every society, but most do not have as many as silicon valley because they pressure them into accepting the help necessary to restore their ability to make rational decisions. Rational people do not choose to live outside on the sidewalk like rats, people who are drug addicted and who have untreated mental illness do.
nixon_why69 23 hours ago|||
I'd just be really skeptical of thinking I have the true understanding and solution to this issue.

Like, do you know many addicts or seriously mentally ill? Have you tried pressuring them into being better? How did it work out?

amanaplanacanal 22 hours ago|||
All it takes to be homeless is not being able to afford housing, drugs or mental illness are not required. You really think all it takes is "choosing" and housing will appear for you?
dgellow 22 hours ago||
Also, drug consumption and mental disorders is very often a result of being homeless. Try having bad sleep in your comfortable home for a few days in a row and see how quickly your mental stability deteriorates and how many bad decisions you start to take (anyone who has insomnia periods will attest)
ltbarcly3 14 hours ago||
This is not substantiated by data or even a plausible theory. The kinds of mental disorders that lead to homelessness are not something you can "catch" from your environment.
dgellow 13 hours ago||
You mean like PTSD? Something that is literally a result of your environment?
bulbar 1 day ago||||
That's not how it works at all. You can't pressure people into becoming a productive member of society.

What you can do when it already happened is kill them or make them die in some ways, jail them or try to support and/or treat them.

I hope it goes without saying that letting them just die or killing or jailing them is not an option in a western society.

Prevention is much more favorable of course. For example, don't let people become homeless easily. But even then, a significant amount will become homeless.

ltbarcly3 23 hours ago||
Until you accept that they didn't 'easily become homeless' the problem will continue. They used drugs and spiraled, usually over the course of many months or years, forced all their friends to turn their backs on them, got kicked out of any living situations they had access to because of drug/alcohol use or theft to support the same and finally ended up on the street.

On the street they have access to almost endless support, at least in Silicon Valley, but much of that support is contingent on things like not openly using heroin or not repeatedly getting so intoxicated that they defecate or vomit on themselves, so they refuse it.

I don't care how liberal you are, no society is functioning when it allows people to get on BART and pee on themselves and defecate on the cloth seats and walk up and down the aisles dripping feces and urine on the floor. That is allowed and nothing is done about it for fear of upsetting homeless 'rights' groups who are funded by the tax dollars meant to help homeless people.

amanaplanacanal 22 hours ago||
Perhaps you aren't aware, but only about a third of homeless people are drug addicts, from the surveys I've seen.
ltbarcly3 14 hours ago|||
Here is how you get to 1/3:

1. Widen the definition of 'homeless' to cover people that nobody would consider homeless in every day language. Include anyone who is staying with a friend, living in corporate housing, staying with a family member, etc. Include anyone you possibly can that is unlikely to be a drug addict.

2. Narrow the definition of homeless. Don't consider people that almost everyone does consider homeless. Make sure to target the subgroups of homeless people that are very likely to use drugs.

3. Narrow the definition of drug use. Make it as hard as possible to count someone as having used drugs. Raise the evidentiary bar so high that even when you have evidence they are a drug addict it doesn't qualify them as a "drug addict" by the studies definition. Bury that definition so it's technically there but you have to go through the study carefully to find it.

Lets pick a study in a big important journal and check it for the above:

How about CASPEH: "Illicit Substance Use and Treatment Access Among Adults Experiencing Homelessness," JAMA, 2025

JAMA is a very prestigious journal:

Who counts as a substance user: Only meth, nonprescription opioids, cocaine/crack count as addictions. Cannabis, alcohol, benzos, hallucinogens, inhalants are excluded.

Someone who has a valid prescription to opiates, even if they are being abused, cannot be methodologically counted as a drug user. THIS INCLUDES METHADONE.

What counts as addict: "Regular" = 3+ times per week. A twice-weekly meth user is 'occasional use'. They might take a gram and stay up for 3 days twice a week, but they are 'occasional user' and don't count in the 37% addict number quoted by this paper.

What counts as addict: Last 6 months only. If you admit you used fentanyl every day for the last 10 years but claim you got clean 181 days ago, you are not a drug user according to this study. If they have been diverted from heroin onto methadone 181 days ago you do not count.

How did they check? They asked each person face to face whether they used drugs and which ones and how often and just took their word for it.

The real numbers from the raw data the study used:

41.6% of homeless self reported 2x per week or more hard drug use before they became homeless. an additional 23.2% claimed they started regular use after becoming homeless.

That's about 65% already from their own data, 2x what the headline pretends.

Excluding high use subgroups: to be included in the data, the homeless person had to prove they were giving informed consent. Then they additionally had to be willing and able to spend 45 minutes or so filling out the survey. The people with psychosis or who were intoxicated at the time of the interview were excluded. How many people have you walked past and they were incoherent, unconscious, or high? They were ignored in this study.

salemh 21 hours ago|||
[dead]
YackerLose 1 day ago||||
Homeless people are a better way to keep cowardly minions (I mean, valuable employees) in line than cops. The homeless are an important part of capitalist power structures. They are a visible reminder of the consequences for not meeting quarterly goals.
estearum 1 day ago|||
No, homeless people are not everywhere.

Homelessness is created by high rents. High rents are created by high local productivity. The people who are productive enough to make it over the rent-bar are housed, and their marginal productivity above the rent-bar serves to raise the rent-bar (talk to any landlord about how they set rent prices: it's the local wages, stupid). This then pushes a greater proportion of people below the rent-bar, and then they are homeless.

There are few places in the world more productive per square foot than Silicon Valley, ergo one must be extremely productive in order to remain housed there, ergo it has an extremely bad homelessness problem.

That's why people making $200k+ (an extremely productive person by national standards) need public housing assistance in Silicon Valley (https://www.reuters.com/article/world/palo-alto-considers-su...). Which of course actually just... raises the rent again...

The charities may be full of grift and whatnot, but you can remove them entirely and you will not solve the fundamental problem.

shafyy 1 day ago||
> High rents are created by high local productivity.

Wrong. High rents have many reasons and also good policies to get them down and have affordable housing for more people, also in otherwise expensive and popular cities.

vlovich123 23 hours ago|||
OP has the demand part of the equation if supply remains fixed. The reason supply remains fixed is the US as a whole made policy changes in the 1970s that slowed down construction, specifically zoning laws and environmental laws swept the country. The 2008 recession also cancelled what little construction remained ongoing for a long time.

When you combine that with spiking wealth in Silicon Valley, you’ve got the perfect storm in Silicon Valley. With OpenAI and Anthropic both based in SF, it’s going to be worse than ever once they IPO.

estearum 23 hours ago|||
The equilibrium for new housing construction will always be "just enough to keep it expensive by local standards [i.e. by local wages]." That's especially true with rising labor, material, and capital costs.

It was actually the post-war housing boom that was abnormal, fueled by aggressive federal funding of suburban buildout. US municipalities are now broadly doomed to bankruptcy trying to maintain sprawling infrastructure that was never cost-effective to create in the first place.

Look at Austin TX. Influx of new building, prices stabilized, and now construction is dropping off a cliff. No one can afford to build into a stable or potentially falling local market. Construction will start again when local productivity grows enough for people to bid the prices back up again.

shafyy 52 minutes ago|||
Fundamentally, housing should not be a free market area that is profit-driven. Housing, like energy, food, healthcare and public transport is a basic need.

Therefore, government policies making sure people with lower income can still get housing in a city they grew up in, where they work, live and have family, is important.

Yes, one part of this is also building new housing and making sure that housing is built efficiently in terms of cost (but not throwing them on the free market, but making sure a certain % of it is desginated as social housing).

estearum 46 minutes ago||
Ah, so your prior comment about productivity not driving high rents is similar to how government paying for healthcare just makes it not-expensive!
estearum 23 hours ago|||
Nope.

Rents cannot (at meaningful scale) exceed local productivity, or else there will be widespread vacancies and landlords will reduce their rents.

Rents cannot (at meaningful scale) fall below local productivity, or else landlords will simply raise their rents.

Go talk to a landlord about how they site prices.

Step 1. Look up income of your target demographic

Step 2. Eat 30% of their income

Can you show me a place with high local productivity and low rent?

Can you show me a place with high rent and low local productivity (that's not e.g. a vacation destination for people with high productivity elsewhere)?

You can certainly artificially suppress prices with rent control. But that just gets fed back into the system in the form of reduced supply, so it ends up raising rents on the non-controlled housing stock anyway.

kbelder 19 hours ago|||
Assume you have an area with a certain productivity and rent. Population and housing are growing at a certain rate.

Now make a law that makes construction cheaper. Or make a law that makes construction more expensive. What happens to rent and mortgages, even though productivity hasn't changed at all?

Productivity (or, rather, wealth) of the occupants is a very strong factor, but it is still just one of multiple factors.

estearum 16 hours ago||
You think you can make a law that sets the price of housing above local wages and stays there?

No, you actually cannot do this in any lasting way.

The price of land would fall to the level required to make it construction viable again. Or the city would be abandoned, which is not generally the outcome since cities have so much shared capital investment that cannot be moved elsewhere.

don_esteban 22 hours ago||||
> Can you show me a place with high local productivity and low rent?

Put the following prompt into your favourite AI and enjoy the reading:

"How do rents relate to productivity in the area? How does Vienna compare to San Francisco?"

estearum 21 hours ago||
Vienna? World famous for publicly-funded housing construction?

Try this one: "Create a simple analysis approximating how much higher rents would be in Vienna if not for the aggressive public subsidization of supply"

In any case, Vienna has a good system! But it's not that it avoids high productivity → high rent, it's that it splits rent into subsidy costs and rent.

In other words, the amount of subsidy + rent required will grow with local productivity.

don_esteban 19 hours ago||
My point is: Your post reeked by defeatist 'nothing can be done against market forces'.

Yes, it can be done, and if we want to have a reasonable future, it should be done.

estearum 16 hours ago||
So you were responding to an assumption that's not actually in my comment?

Vienna's solution is fine but has escalating costs and isn't necessary. Land Value Tax is better.

ltbarcly3 14 hours ago|||
> Rents cannot (at meaningful scale) exceed local productivity

Manipulating the real estate market via direct economic manipulation, collusion, or regulatory capture is so common that the entire concept of manipulating the market to earn higher profits is called https://en.wikipedia.org/wiki/Rent-seeking.

It's not just that it can, it's that it does so often it's taught in Econ 101. That you don't know this implies you have never taken an economics class or that you forgot what you were taught, and in the meantime certainly have not spent any real effort in learning about economic theory. I think you read a lot of Ayn Rand and right wing libertarian popular books about the free market and how it's perfect. Stop posting confident nonsense.

estearum 13 hours ago||
No, what's happening here is you misunderstood the quoted text, silly.

The claim is not that rents are always at their optimal or most efficient level - they're not! The claim is that you cannot (at meaningful scale) charge people who earn $1,000/month in income $2,000/month in rent to live in a place. They will have to move.

Did you take any arithmetic classes?

And any case, you should stop mind-reading. You're bad at it. I'm not a Randian nor a right-winger nor a libertarian nor free-market idealist.

ltbarcly3 10 hours ago||
Lets say I own 50 properties and I want to charge $2000 a month, and right now I can't because the people willing to rent my properties only make $1000 a month. I can bribe politicians to not allow any new construction of properties which rent between $2000 and $4000 per month. Then I wait 10 years. Now I can charge $2000 a month because I'm not renting to the people that made $1000 a month 10 years ago, I'm renting to the people who have $2000 a month to pay for rent but can't find any other units. This is called rent-seeking. You should read about it.

Your mistake was thinking that I, the corrupt landlord who pays bribes, cares about a macro analysis of every all the properties, or that some analysis about the current distribution of incomes and possible rents will stop me from doing exactly what you say is impossible. I don't own every property in the city, especially the ones that aren't built because I capture zoning, so arguments about average GDP and average rent and whatever else do not stop me. Your analysis is useless.

estearum 1 hour ago||
> Then I wait 10 years [for local productivity to increase, and then I can charge higher prices]

This is the only feature that's relevant. If productivity goes up, you can charge more. If it does not, you cannot.

You may do some corruption or some zoning or some whatever else you want, but at the end of the day, if productivity goes up you can charge more and if it does not you cannot charge more.

Hope that clarifies!

nilamo 22 hours ago|||
Just because the ethicist says something is a bad idea, doesn't mean anyone else is obligated to make a change.

ie: blaming her for anything instead of the decision makers is... really weird?

kelseyfrog 22 hours ago||
No influence, same toil? One must imagine her happy.
nilamo 22 hours ago||
Why must I imagine that? We're assuming it's a position where you're screaming pointlessly into the void, and never accomplish anything. That sounds miserable, I'd leave, too.
kelseyfrog 20 hours ago||
One Must Imagine Sisyphus Happy is the concluding sentence of Albert Camus' essay The Myth of Sisyphus. It parallels her situation.
fHr 1 day ago|||
lmao
ulfw 1 day ago||
What a joke really. The 'position' itself and the companies who pretend to care about ethics
Surac 22 hours ago||
The point that such a position even existed shows how bad there ethic is
jrflowers 14 hours ago||
I feel like being head of ethics and working for a CEO that keeps talking about inventing a genie would drive a person insane
brcmthrowaway 20 hours ago||
Because she already made enough money to FIRE..
chrismarlow9 17 hours ago|
If money was the goal I suspect she would have made the first year and get some shares but Im throwing some assumptions in there
parpfish 1 day ago|
their only ethicist left? gasp!

now they are exactly like every other company that has zero ethicists on staff and expect the employees to weigh the ethical ramifications of their work.

podgietaru 1 day ago||
What companies do you think expect their employees to weigh the ethical ramifications of their work?

I’d argue a lot of them expect the opposite. To suppress the ethical concerns.

Even in recent memories you had Mark Zuckerberg telling his employees to use pirated sources. And executives at fossil fuel companies have to act unethically.

asadotzler 18 hours ago||
Food testing? Hospitals? Childcare? Pharmacists? How about "clergy"? I could go on and on.

Do you believe that no one in management in these fields pushes the importance of ethics?

podgietaru 16 hours ago||
I think that individuals are capable of making ethical choices. I think that relying on individuals within for-profit businesses to make ethical decisions for the entire company is absolutely insane.

Food-testing: There's literally a parasite going around right now. Look at the response from some of the for profit businesses that was allowed to happen.

Hospitals: It is not ethical to deny patients care based on their insurance.

Clergy: The cover up of child sexual abuse scandals.

Childcare: lots of examples of sub-par care given to save money.

jdiff 1 day ago||
I think we can look upon the collective works of the corporations of the world and agree that the employees do not do that, nor are they expected to.
More comments...