Posted by darkwater 5 days ago
No more worrying about "rate limiting," subscription hell, or random extended outages (ie, github).
If LLM wants access, might implement payment layer and use 402 http status code and redirect them to payment page ;). Wonder how many people just give agents carte blanche physical (credit card) and virtual access
Is there a test endpoint where one can validate the behavior of their ratelimit detection? Basically I do not want to cause excessive load on your servers just to test my implementation.
I expect to not be the only one, it certainly drives usage KPIs up and lead to this kind of decisions.
Getting that so I do not know exactly what they are doing. From the title I am guessing they are restricting or throttling if downloads exceeds some value.