People trading their unused credits feels more genuine, although still in violation of the agreements. The person who got into YC Startup School who was trying to resell the $2500 of credits was interesting. It wouldn’t be that hard for OpenAI to identify the IP addresses of the relays and start flagging accounts, tracing it back to the source. Risking burning your bridges with YC for a relatively small profit is a questionable decision.
The original article showed discounts ranging all the way up to 98%. At those levels it’s obviously not people reselling anything. It’s either sourced from stolen API keys, bought with stolen credit cards, or acquired through automated sign up of trial accounts if you’re actually getting the API you request.
I would expect a lot of them are reselling a different API. Sign up for Anthropic tokens and get Deepseek responses instead.
But also, resellers only need to make an overall profit including kickbacks from the companies purchasing token history for distillation.
I suspect it's closer to the sub price and anthropic is just milking their API users, but that's something you'd only know from the inside
YC has advised startups in the past that it's easier to sell a single $100k customer than 100 $1k customers.
It would also be relatively surprising to learn that i.e. the Chinese providers are OOMs better at inference than OAI/Anthropic (like their prices would imply if they were in a perfectly competitive market).
DeepSeek's price hike is mostly driven by increased demand, for example. It's not about losses so much as they don't have enough infrastructure and need to reduce demand somehow.
But the API price is likely simply regular supply and demand, charging as much as the market will pay. Corporations are dropping insane amounts because it's still peanuts for many industries. Software has just been ridiculously cheap before AI. So high prices are still low for companies if it eases some bottlenecks.
It's basically asking for being hacked and/or sending you private data to random email addresses! Neither at a 99% discount I'd do it.
I understand if someone, for any reason, cannot access a specific model ... But nowadays, there are so many alternatives that even this doesn't make sense any more.
Here is a more detailed article about how it works:
https://www.chinatalk.media/p/how-to-buy-cheap-claude-tokens...
If your startup needs to run a million records of something, especially public data, through an LLM to extract the data you need, using bootleg tokens to shrink the bill starts feeling tempting.
If you're concerned about the data leaking, the biggest risk is that the API backends are quietly routing your requests to a cheaper model. You might be trying to buy Opus tokens but get Deepseek Flash responses.
Maybe this make sense, but anyway I have to pay a lot of attention at the output I get. Eg: who guarantees there is no prompt/sql injection? Especially if I have to load the output in some internal system.
I mean someone could try to sneak prompt injection into a text field, but the people buying black market resale tokens from third parties aren’t thinking about anything other than getting cheap output.
But otherwise, if a company gives something valuable for creating an account on their platform, expect that people will automate the creation of millions of accounts. If employees of B2B partners get benefits, they will resell them. Accounts will be hacked and resold. The same basic abuse patterns are decades old for online delivery services, loyalty accounts for airline and hotels, etc. There are entire industries dedicated to those spaces as well: large organizations with physical offices, hundreds of employees, HR departments, etc. dedicated to reselling digital benefits on grey markets.
Some companies are tolerant of allowing this to happen. The pessimistic view is that even illegitimate traffic contributes to the KPIs that your investors care about. The slightly less pessimistic view is that fraud prevention will always have trade-offs and false positives, and sometimes the savings of preventing fraud are genuinely outweighed by the false positives. Or maybe it's just Hanlon's razor and they truly never saw it coming.
Edit: https://vectoral.com/blog/token-relay-market mentioned in comment.
TLS terminates at the proxy (say, https://reselltokens.ai), end to end integrity is not enforced. LLM traffic contains tool calls like "bash ...", which are executed on the client machine, they can be manipulated. Secret exfil is also possible.
There are community plugins like this: https://github.com/rheodev/cpa-plugin-privacyfilter
I haven't tried the plugin system myself yet.
Since it modifies logic across the full request/response lifecycle, I unfortunately couldn't implement it cleanly with the existing plugin API.
It is...incredible how many there are. Stripe does far too little in my opinion to help prevent issues like this, even though they have the business intelligence and enough data to do so.
A simpler explanation is that that this is just a resale market.
Some of the abuse is more benign, but there is also real fraud through chargebacks, account takeovers, and stolen credit cards.