Top
Best
New

Posted by robotswantdata 6/30/2025

The new skill in AI is not prompting, it's context engineering(www.philschmid.de)
915 points | 518 commentspage 8
joe5150 7/1/2025|
Surely Jim is also using an agent. Jim can't be worth having a quick sync with if he's not using his own agent! So then why are these two agents emailing each other back and forth using bizarre, terse office jargon?
pwarner 6/30/2025||
It's an integration adventure. This is why much AI is failing in the enterprise. MS Copilot is moderately interesting for data in MS Office, but forget about it accessing 90% of your data that's in other systems.
HarHarVeryFunny 7/1/2025||
I guess "context engineering" is a more encompassing term than "prompt engineering", but at the end of the day it's the same thing - choosing the best LLM input (whether you call it context or a prompt) to elicit the response you are hoping for.

The concept of prompting - asking an Oracle a question - was always a bit limited since it means you're really leaning on the LLM itself - the trained weights - to provide all the context you didn't explicitly mention in the prompt, and relying on the LLM to be able to generate coherently based on the sliced and blended mix of StackOverflow and Reddit/etc it was trained on. If you are using an LLM for code generation then obviously you can expect a better result if you feed it the API docs you want it to use, your code base, your project documents, etc, etc (i.e "context engineering").

Another term that has recently been added to the LLM lexicon is "context rot", which is quite a useful concept. When you use the LLM to generate, it's output is of course appended to the initial input, and over extended bouts of attempted reasoning, with backtracking etc, the clarity of the context is going to suffer ("rot") and eventually the LLM will start to fail in GIGO fashion (garbage-in => garbage-out). Your best recourse at this point is to clear the context and start over.

hnthrow90348765 6/30/2025||
Cool, but wait another year or two and context engineering will be obsolete as well. It still feels like tinkering with the machine, which is what AI is (supposed to be) moving us away from.
hobs 6/30/2025|
Probably impossible unless computers themselves change in another year or two.
dboreham 7/1/2025||
The dudes who ran the Oracle of Delphi must have had this problem too.
ninetyninenine 7/1/2025||
We do enough "context engineering" we'll be feeding these companies the training data they need for the AI to build it's own context.
alganet 6/30/2025||
If I need to do all this work (gather data, organize it, prepare it, etc), there are other AI solutions I might decide to use instead of an LLM.
simonw 6/30/2025||
What kind of alternative AI solutions might you use here?
alganet 6/30/2025||
Classifiers to classify things, traditional neural nets to identify things. Typical run of the mill.

In OpenAI hype language, this is a problem for "Software 2.0", not "Software 3.0" in 99% of the cases.

The thing about matching an informal tone would be the hard part. I have to concede that LLMs are probably better at that. But I have the feeling that this is not exactly the feature most companies are looking for, and they would be willing to not have it for a cheaper alternative. Most of them just don't know that's possible.

joe5150 6/30/2025||
You might as well use your natural intelligence instead of the artificial stuff at that point.
alganet 6/30/2025|||
I'm assuming the post is about automated "context engineering". It's not a human doing it.

In this arrangement, the LLM is a component. What I meant is that it seems to me that other non-LLM AI technologies would be a better fit for this kind of thing. Lighter, easier to change and adapt, potentially even cheaper. Not for all scenarios, but for a lot of them.

coliveira 6/30/2025|||
Yes, when all is said and done people will realize that artificial intelligence is too expensive to replace natural intelligence. AI companies want to avoid this realization for as long as possible.
alganet 6/30/2025||
This is not what I'm talking about, see the other reply.
whimsicalism 6/30/2025||
i think context engineering as described is somewhat a subset of ‘environment engineering.’ the gold-standard is when an outcome reached with tools can be verified as correct and hillclimbed with RL. most of the engineering effort is from building the environment and verifier while the nuts and bolts of grpo/ppo training and open-weight tool-using models are commodities.
iszomer 7/2/2025||
This article reads as if the author pulled this idea straight from the MGS2's ending regarding giving and creating context..
la64710 6/30/2025|
Of course the best prompts automatically included providing the best (not necessarily most) context to extract the right output.
More comments...