The author is factually incorrect here. Moving information out of the model weights and into the input of the model's context window in no way ensures that the model will accurately output content that was input from the context. This is true even when RAG is used to input exactly the correct data.

I know is editorialized, but a more accurate title to this content would be either :

Models Are Getting Ignorant on Purpose

or

Models Are Getting Less Knowledgeable on Purpose

I'd wager most people have less. In 2022 a 3080 might have 12 GB if you were lucky, 10 if you weren't -- and you paid for the privilege. A current RTX 5080 is only 16GB.