Top
Best
New

Posted by albelfio 23 hours ago

Tinybox – A powerful computer for deep learning(tinygrad.org)
561 points | 325 commentspage 5
orliesaurus 23 hours ago|
I wonder if this is frontpage right now because of the other tiiny (the names are similar) video that went viral ... which turns out wasn't an actual product by the tinygrad linked in this post[1]

[1]https://x.com/ShriKaranHanda/status/2035284883384553953

droidjj 22 hours ago||
Adding this to my list of ~beautifully~ designed things to buy when I win the lottery.
DeathArrow 6 hours ago||
I wonder how much has he sold.
DeathArrow 6 hours ago||
Why do I get the impression that I get more bang for the buck by going through OpenRouter? Of course, not anyone can do that and there are security and other concerns.
raincole 18 hours ago||
How does this thing cool down?
ppap3 21 hours ago||
I thought there was a typo in the price
vlovich123 23 hours ago||
Surprising to see this with AMD GPUs considering how George famously threw up his hands as AMD not being worth working with.
embedding-shape 22 hours ago|
Yeah, and labeling AMD "Driver Quality" as "Good" (for comparison, they label nvidia's driver quality as "Great").
lostmsu 22 hours ago||
Things changed. On my new Ryzen Strix Halo laptop I was able to run training experiments with PyTorch on Windows day 1: https://news.ycombinator.com/item?id=46052535
throwatdem12311 22 hours ago||
Finally, a computer that should be able to run Monster Hunter Wilds with decent performance.

But let’s be real, 12k is kinda pushing it - what kind of people are gonna spend $65k or even $10M (lmao WTAF) on a boutique thing like this. I dont think these kinds of things go in datacenters (happy to be corrected) and they are way too expensive (and probably way too HOT) to just go in a home or even an office “closet”.

oofbey 22 hours ago|
It’s not for people to buy. It’s for companies to buy. Compare to salary, and it’s cheap.
aziaziazi 22 hours ago|||
> What's the goal of the tiny corp? To accelerate. We will commoditize the petaflop and enable AI for everyone.

I had the same feeling as throwadem when reading this. Your comment clarify what they meant by "everyone"

throwatdem12311 22 hours ago||||
What companies are buying this instead of like a Dell server or whatever?
flumpcakes 21 hours ago||
These specs look enormously cheaper than doing it with dell servers. The last quote I had for a bog standard dell server was $50k and only if bought in the next few days or so. The prices are going up weekly.
throwatdem12311 21 hours ago||
So what’s the catch? If it seems too good to be true it probably is.
wmf 18 hours ago||
These are "unsupported" configurations. Nvidia/AMD discourage running multiple gaming/workstation cards and encourage customers to buy $500K SXM/OAM servers.
lostmsu 22 hours ago|||
Hm, I compared my salary with $10M and it doesn't feel cheap. I guess skill issue.
throwatdem12311 22 hours ago||
But how will I make ad-supported youtube videos about how I automated my life with OpenClaw using a $10M boutique AI server to make a few thousand in ad revenue while burning tens of thousands per month on API cost.
mememememememo 17 hours ago||
Give me token/s for favourite models.
gymbeaux 13 hours ago|
$12,000 gets you 1Gb/s networking and vanilla Ubuntu 24.04. Napkin math on the hardware it looks like margins are around 50% which feels like a school fundraiser where everyone pays what is obviously way more than normal retail price for X because "it's for the children."

I'm not sure what tinygrad is but I assume the markup is because the customer is making a conscious choice to support the tinygrad project. But what's unusual is there is apparently no reason whatsoever to buy this hardware, even if you plan on using tinygrad exclusively for your project. At least with System76 hardware I get (in theory) first class support for Pop!_OS.

More comments...