We do have that in Exa search:

* Extraction of main content from HTMLs, the index stores markdown representations (free of headers/footers/sidebars/menus etc)

* Serving highlights picking the most relevant part for each result to reduce token usage downstream

* Also serving dynamic highlights where we summarize all the sources at once reducing the token counts even further

see here: https://exa.ai/docs/search/highlights and https://exa.ai/docs/contents/quickstart

They already have that[0] it’s called Markdown for Agents and it works on any URL

[0] https://developers.cloudflare.com/fundamentals/reference/mar...

the >service providers< that CF has partnered with are >direct competitors< to parallelAI, yes

I wish non-fuzzy searching was still trendy. It sucks when I know what I need and remember a bunch of keywords from the page, but search engines return either 0 results or a bunch of results that don't even contain the keywords.

It always did, but who pays it is shifting.

Looks free… until the bill hits.