Ask HN: What is the cheapest ($/hour) H100 renting service with quick spin-up?

Posted by dtquad 10/27/2024

Something that can be programmatically spun up and turned off in seconds would be ideal.

10 points | 4 comments

uncharted9 10/29/2024|

https://cloud.vast.ai/

Seeing H100 going for $2.138/hr

Gooblebrai 10/27/2024|

I don't know about cheapest but Modal is quite convenient code-wise

huevosabio 10/28/2024||

Modal is excellent for prototyping and experimentation, but I find the queueing and startup times hard to stomach. Perhaps if I had a much bigger load it would be snappier.

codemk8 10/27/2024||

Runpod with its python APIs.