I give it about 50/50 the internet goes down or becomes effectively unusable for weeks, maybe months, at some point in the next 5 years given abysmal commitment to cybersecurity from almost every company that exists.

Some kid with the right prompt will supply chain attack a dependency of a dependency of firmware for border routers just to watch the world burn, or runaway AI swarms will saturate all bandwidth. Or a Linux kernel zero-click vuln. So many ways this can happen.

Better to prepare a bit and never need it.

From the site:

>Survival LLM >It Can be wrong

thank you!

The required specs seemed a bit high to me, and I was just looking for alternatives.

I found Project Nomad (https://projectnomad.us) which looks more polished. Any other suggestions?

Great idea, I do a lot of work testing small LLM's in this space and agree if you add some guardrails and train a small embedder, you won't need these large models, as your info is static, you can ship it all as one.

Or try these with your trained embedder: https://ollama.com/library/minicpm-v4.6 https://ollama.com/library/bonsai-2

If every single example posted has hallucinations and the response is "it's your fault for not checking the sources" then it's obvious that an LLM isn't the right tool for the job. A search engine works perfectly fine for these kinds of datasets.

It's pretty cool. But if it's such a small model and small corpus, isn't it almost just as good just to have a static wikipedia-style copy of those key sources (WikiMed, MedlinePlus, Ready.gov, CDC etc.)? Maybe if they (and that could be static too), gave you a "what's going on?" question and then told you what you might not know - i.e. "power is out" -> "make sure you open your fridge as little as possible", "if you have backup battery ensure you turn power hungry devices off" etc.?

Back in 2018 I was working on a project for educating schools in certain parts of Africa and Middle East, on AI. The issue was it had to be air-gapped (no internet guarantees) and small/portable. I ended up downloading Wikipedia (not all of it), and then created a lightweight inverted index (for search) and TextRank (for summaries). The whole thing was on a Raspberry Pi, and installed in a small plastic enclosure. We had many of these and could easily ship them. There was an "AI Learning Module" as well we built, that started with Scratch, and then moved into Python. But if I was to do it all over today, I would probably add a tiny LLM and maybe a small ASR and a TTS model too, and you basically have a completely self-contained AI knowledge assistant in a cigarette box. The point being, you basically also have a "survival AI" you can take with you. Of course you still need electricity...

I went through a category 5 hurricane that took down everything. Prepared by downloading as much as I could ahead of time but it wasn’t enough. This, or something similar, would have been a blessing.

Love this. And as a trend, I'd love to see more local/small task-specific models/agents. Experts at helping you with that one thing, leaving the everything-and-the-kitchen-sink to the frontier models/agents

Emergencies = No Internet

What about no power? You gonna run your generator for your local model? What are we doing here? Have we lost our way completely?