Top
Best
New

Posted by nafnlj 12/12/2025

Google de-indexed Bear Blog and I don't know why(journal.james-zhan.com)
433 points | 189 commentspage 3
Popeyes 12/12/2025|
Had the same issue - we have a massive register of regulated services and Google was a help for people finding those names easily.

But in August suddenly "Page is not indexed: Crawled – currently not indexed" shot up massively. We've tried all sorts to get them back into the index but with no help. It would be helpful if Google explained why they aren't indexed or have been removed. As with the blogpost every other search engine is fine.

AznHisoka 12/12/2025|
What url is your website if you dont mind sharing?
eikowagenknecht 12/13/2025||
I‘m running a very small personal website / blog as well (https://eikowagenknecht.com) where I‘ve been writing about mostly home automation related things that I couldn’t see properly documented before, but also other topics sometimes. A typical page would be a migration guide for Home Assistant from a Pi 4 to Pi 5.

These niche posts had their steady stream of visitors for years now, coming almost exclusively from Google. But August 25 2025, from one day to the other it dropped by about 95 percent and it has been that way ever since, from 1000 visitors per month to maybe 50. Nothing I tried SEO wise could fix it.

Now I don’t need visitors for anything, but I‘m kind of sad that people who were clearly finding my content useful (I got lots of thank you mails and things like that) can’t find it any more.

Nowadays, I get more traffic from Bing, Yandex.ru, DDG and Brave than from Google..

terrycody 12/13/2025||
This is a known Google soft penalty in order to contain spam contents and domains, but unfortunately, this thing penalized a lot of good, clean, and legit blogs, and when you caught this penalty, in 99% cases, you will never recovered.

It will only shows 1,2,3,4,5,6,7,8,9,11, or simialr numbers when you site:yourdomain on Google.

I found this thing around 2019, and it still exists till today.

A way to identify this: first post more than 20-30 articles on your blog, and if after several months, it still shows only several pages when you site: your domain, then it mostly caught this thing.

More info: https://www.blackhatworld.com/seo/anyone-site-only-4-results...

pentagrama 12/13/2025||
> Every time I published a new post, I would go to GSC and request indexing for the post URL, and my post would be on Google search results shortly after, as expected.

I doubt this is the actual cause, but I can’t think of any other plausible explanation. One possibility is that repeatedly requesting manual indexing in GSC (Google Search Console), while the same URLs were also being discovered automatically through the sitemap, may have unintentionally triggered a spam or quality signal in Google’s indexing system.

This kind of duplicated or aggressive indexing behavior could be misinterpreted by the algorithm, even if the content itself was legitimate.

subpixel 12/12/2025||
Bearblog.dev keeps subdomains out of search indexes until it approves them, as a measure against hosting the sort of things that would get the whole system de-indexed.

My guess is that they are more successful at suppressing subdomains than at getting them indexed. After all, they are not in control of what search engines do, they can only send signals.

For reference, I have a simple community event site on bearblog.dev which has been up for months and is not in any search index.

nmeofthestate 12/12/2025||
A weird thing: on the hacker news page, in firefox mobile, all the visited links are grey, but the link to this blog post won't turn grey even when visited.
Havoc 12/12/2025||
Parts of Google are all Blackbox-y. Never know when computer says no. And if they had usable ways to contact a human they’d just tell you they don’t know either
arjie 12/12/2025||
Google is blackboxy about this and I understand why. SEO is an arms race and there's no advantage to them advertising what they use as signals of "this is a good guy". My blog (on Mediawiki) was deranked to oblivion. Exactly zero of my pages would index on Google. Some of it is that my most read content is about pregnancy and IVF and those are sensitive subjects that google requires some authorship credibility on. That's fair.

But there were other posts that I thought were just normal blog posts of the form that you'd expect to be all right. But none of the search engines wanted anything to do with me. I talked to a friend[0] who told me it was probably something to do with the way MediaWiki was generating certain pages and so on, and I did all the things he recommended:

* edit the sitemap

* switch from the default site.tld/index.php/Page to site.tld/fixed-slug/Page

* put in json+ld info on the page

* put in meta tags

The symptoms were exactly as described here. All pages crawled, zero indexed. The wiki is open to anonymous users, but there's no spam on it (I once had some for an hour before I installed RequestAccount). Finally, my buddy told me that maybe I just need to dump this CMS and use something else. I wondered if perhaps they need you to spend on their ads platform to get it to work so I ran some ads too as an experiment. Some $300 or so. Didn't change a thing.

I really wanted things to be wiki-like so I figured I'd just write and no one would find anything and that's life. But one day I was bored enough that I wrote a wiki bot that reads each recently published page and adds a meta description tag to it.

Now, to be clear, Google does delay reinstatement so that it's not obvious what 'solved' the problem (part of the arms race), but a couple of days later I was back in Google and now I get a small but steady stream of visits from there (I use self-hosted Plausible in cookie-free mode so it's just the Referer [sic] header).

Overall, I get why they're what they are. And maybe there's a bunch of spammy Mediawiki sites out there or something. But I was surprised that a completely legitimate blog would be deranked so aggressively unless a bunch of SEO measures were taken. Fascinating stuff the modern world is.

I suspect it has to do with the Mediawiki because the top-level of the domain was a static site and indexed right away!

0: https://news.ycombinator.com/user?id=jrhizor

econ 12/12/2025|
I never really use it but there is a lot in the Yahoo index that google refuses to index.

https://search.yahoo.com/search?p=blog.james-zhan.com&fr=yfp...

guerrilla 12/12/2025|
I thought Yahoo! was just Bing now. The real Yahoo! died ages ago.
econ 12/13/2025||
I don't know and don't doubt it but the results don't match. (For me at least)
More comments...