Posted by vinhnx 19 hours ago
Like you created you own framework for wen apps before.
"For the AI era" is the necessary buzzword
But there’s not one word of why this is good for LLMs, or how they tested/measured that.
My gut would tell me that a new solution put up against all the vega lite specs it’s already be trained on would be a hard thing to win.
I'm 99% sure the verbosity required in the system prompt to teach non-M$ models this new ever-so-slightly-different-but-not-obviously-necessary chart def abstraction format, and the iterations required to get it right, will outweigh any supposed efficiency gains resulting from using it.
Just stating the obvious.
Used correctly, this hasn't been true for a quite a while. Most inference engines have a form of grammar constrained decoding. See, for example: https://vllm.ai/blog/2025-01-14-struct-decode-intro