I don't know who's right, but the dichotomy is interesting.
[1]: The capability to continually learn new information (associative, meaningful, and verbatim). (from the publication)
You need context from internal system state that isn’t faked with a giant context window.