Posted by secretslol 1 day ago
Step 2: The platform becomes the ultimate knowledge base with community-curated answers on virtually any question related to software development.
Step 3: Another company scraps the community-driven database to train its model.
Step 4: The model is so efficient that people start asking questions of the model, killing in the process any traffic to the platform that helped to create it in the first place.
Step 5: Profit. People who spent years asking, answering, and curating programming knowledge for free are now paying for that knowledge repacked in the model weights. The original knowledge base is essentially dead.
Question: What programming knowledge base will be used to train future models?
Are we at the Skynet moment where people will be totally cut out of the loop from now on?
But it is hardly unique, and it concerns the community more than the platform itself. Many communities with anonymous access end up toxic. It is nothing new and dates back to early BBSs and FidoNet, where a hostile attitude reached unbelievable levels.
Sure thing, the LLMs will be more polite than humans. For now...
This is revisionist history. People told SO that they were leaving for YEARS because of how incredibly toxic it had become. It was already giving outdated answers before ChatGPT shipped, because new questions/potentially updated answers were [Closed] [Dupe] immediately.
Their answer was essentially "We aren't a Q&A site, we're trying to be a knowledge base! So closing all questions on a Q&A-stylized site, and extremely abrasive moderation, is working as intended."
They entirely did this to themselves. The community was toxic, their policies were toxic, and they didn't listen when warned as such repeatedly - just doubled down.
The Monica affair was one of the first symptoms.
In 2023, Stack Overflow had already started making unpopular pro-AI moderation decisions, and in 2024, they started mass banning everyone who deleted their questions and answers in protest. I don't think it's wholly incorrect to say "AI killed Stack Overflow" when the death blow came from crazy pro-AI decisions from the admin.
The title of this thread is "What AI did to stackoverflow in a graph." That's a narrative. At least before the mods change it.
You cannot reply to a post to either provide correction or solution because you don't have enough "points" to do so.
You were forced to complete an insane list of requirements just to comment. Let that sink in.
Contributors responded by going to delete their own respective contributions en masse. Upon doing so, were banned by the platform mid-process which then led to people going back to revise their contributions to be false rather than deleted.
I guess that’s “LLM related”
Their goal (loosely described) was so that if you pulled up the front page of the site, you'd find questions that are interesting to read and answer.
If you, as a professional visiting the site went to it and found the front page with things that were trivially answered by reading the documentation or "how do I draw a triangle with stars?" ( https://stackoverflow.com/q/10932962/ type things) you, as a professional, are less likely to stick around.
In the period, Stack Overflow was reducing the ability for people to curate content and trying to boost "welcoming". https://stackoverflow.blog/2018/04/26/stack-overflow-isnt-ve...
Part of this is that much of the early writing style was intended to mirror technical writing. In reading https://learn.microsoft.com/en-us/powershell/scripting/devel... one doesn't find "Hope that helps" at the end of the page.
It takes a while for a person to understand the norms of writing for a given audience. In the early days, people either came to it with that mindset or were able to be given more attention and guidance as to what the expectations for the site were. When Stack Overflow become extremely popular with college students and people outsourcing their work ( https://news.ycombinator.com/item?id=48960245 ) the ability for the... for lack of a better term "elders" of the site to try to get people to understand how the site worked and its expectations.
Many of the new users expected Stack Overflow to work much like forums - with a back and forth between people and a chat like environment... that wasn't so. The use of the curation tools to try to help onboard a person were deemed as unfriendly and "toxic" started getting tossed around.
Stack Overflow corporate, trying to be sensitive to the broader cultural movements at the time and the "we need to make this a more inclusive space" made it harder to curate and began a campaign of removing or limiting curation tools as part of "welcoming".
During this time, there was one tool that was enhanced in its effectiveness. If you had a gold badge on a tag you could close it as a dup of another question categorically. Rather than "this question is poorly written and it is unclear what you are asking" (requiring 5 close votes from different people - that would never happen if it didn't happen in the first few minutes because few went to the review queues) they could close the question as a duplicate of what it might be.
That didn't help things when it came to the perception of the site. It was a last ditch effort to try to make it so that the front page was the well asked questions.
Combining the reduction of curation tools, labeling their use as gatekeeping, the growing ratio of new users to elders, and corporate quite literally saying that those people who were doing the curation were the bad guys... well, a lot of them left or reduced their activity.
That in turn made it so that it was harder to find the well asked questions and fewer people were around to answer questions. Note I write "well asked" not "valid" - a lot of people claim to have a valid question but don't ask it in a way that is well suited to the Q&A format.
Combine that again with reductions in staff, various awful "experiments" in the name of improving engagement. That was akin to firing half of a construction team at a house while having them add a new patio... all the while the basement is flooded.
And so you've got what is there today. Very few curators left compared to 2016. Few caring answer new difficult questions. The easy college homework questions (how do you draw a triangle) and the outsourcing of work to free labor is now done with an LLM... and there's no coming back from that. ... And few people believe in the mission goal of Stack Overflow - and those who do, don't believe Stack Overflow corporate believes in that mission goal.