Top
Best
New

Posted by nateb2022 16 hours ago

Kimi-K3 on HuggingFace(huggingface.co)
Related: Kimi-K3 Technical Report [pdf] - https://news.ycombinator.com/item?id=49070985
1262 points | 489 commentspage 3
khanhnguyen8386 12 hours ago|
Can't wait to run this at 0.02 tokens/sec on my CPU so I can get a response just in time for next month.
mattstir 8 hours ago|
Unfortunately I don't think modern consumer CPUs are physically capable of addressing enough RAM to even load the model into memory. We'd have to wait for some random person to make an extremely quantized version before we could reach those blazing speeds
starcast2026 6 hours ago||
I wondering if folks like OpenAI & Anthropic start supporting open models in their api. After some time, keeping users stuck is going to be more important than "models"
great_psy 6 hours ago|
What grip do they have then ? Is Claude code and the suite of other interface that good compared to open source/ competitor offering ?
wojciem 4 hours ago||
I am impressed to see already couple of providers serving Kimi-K3 on openrouter: https://openrouter.ai/moonshotai/kimi-k3
fahrradflucht 7 hours ago||
Its now on Nebius: https://tokenfactory.nebius.com/?modals=endpoint-details&mod...

$3.00 / 1M In; $15.00 / 1M Out; 120 Tok/s

But since for reasons only Nebius knows Token Factory in general does not seam to offer prompt caching (at least not discounted) its essentially useless.

minimaltom 4 hours ago||
HF says activation function is "SiTU-GLU", but I can't find any info on that?

Anyone know / is this a typo?

Even the python code for inference seems to use normal activations.

lightningdev1 4 hours ago|
It stands for Sigmoid Tanh Unit Gated Linear Unit. Check the tech report/paper (page 7): https://github.com/MoonshotAI/Kimi-K3/blob/main/k3_tech_repo...
minimaltom 2 hours ago||
Thanks! I had a clanker graph it with sliders, its a very interesting function to play with! seems like it has the negative 'hump' typical of a GELU coupled with the saturation of a sigmoid.

Its interesting that saturation is ideal at this scale, i thought we were all in on self-activating functions (i.e. swish) but in fairness all those papers lacked ablations at scale nor discussion of stability.

apexalpha 11 hours ago||
This has to be one of the craziest uploads on the internet up until now.

Raw fucking intelligence at your disposal, free to download.

If you'd describe what's happening now to someone from five years ago they'd think you're hallucinating or mad.

seydor 7 hours ago|
I think we felt the same when Apache or MySql was releasing back in ancient times.
bobbyswiss 5 hours ago||
Apache and Mysql aren't general purpose brains
wwwhizz 15 hours ago||
That would be 7/27.
linzhangrun 14 hours ago||
China uses YYYY/MM/DD, which is logical.
kalleboo 10 hours ago|||
What China (and Japan) uses is YYYY年MM月DD日, which IMO is the superior date format since it's self-explanatory - the sections are spelled out right there!
_zoltan_ 14 hours ago|||
the only logical format.

signed: a hungarian :)

egeozcan 14 hours ago|||
For me, the only format that doesn't make sense is the MM/DD/YYYY, together with its rarely seen worse sibling, MM/DD/YY (07/27/26).
Jarmsy 13 hours ago|||
Let's just go with YM/DY/MD (27/26/07)
esperent 11 hours ago||
But only for Americans, and make them weirdly dogmatic about it.
Tepix 10 hours ago|||
Agreed. It's objectively mixing the order (medium/small/large)
calebm 8 hours ago||||
You can sort dates and they are in order with this format.
JSR_FDED 14 hours ago||||
lpszReleaseDate ;-)
fithisux 12 hours ago||
LoL
layer8 10 hours ago|||
You mean a Big Endian.
broodbucket 15 hours ago|||
20270727 if we're improving dates :)
spider-mario 13 hours ago|||
Jumbling together year, month and day and having to separate them by counting digits is not an improvement for human readability. (And you have the year wrong.) Any of “27 July 2026”, “July 27, 2026” or “2026-07-27” would be superior.
broodbucket 13 hours ago||
It's good because it's an actual standard instead of 7/27 which is backwards for half the world. Besides, I'm actually from the future and they delayed the model a year, learning from Anthropic that good models are actually about to bring the end of society.
fragmede 14 hours ago||||
ISO 8601 ftw
c7b 14 hours ago||||
270727 if we want to save tokens :)
darkwater 14 hours ago||
Y2K100 bug for you, then ;)
m00dy 14 hours ago|||
Looks like another LeetCode problem about checking for anagrams.
ra 15 hours ago|||
or 27/7 for the rest of the world
psychoslave 14 hours ago|||
Most life forms don’t use any calendar actually.
embedding-shape 13 hours ago||
Don't even have to go that far, outside of white-collar jobs and some groups weirdly obsessed with scheduling, most people don't use calendars at all, but their manager/boss/significant-other does that for them :)
LeonM 14 hours ago|||
No, 27-7 for the rest of the world.

The separator is often the only way to distinguish American notation from ISO, so please use a dash for dd-mm-yy and a forward slash for mm/dd/yy

casparvitch 14 hours ago|||
Have never seen 27-7, as someone in rest-of-world
MikePlacid 8 hours ago||
In my time it was “27/VII 1986” in Russia.
pavo-etc 14 hours ago||||
This is so confidently wrong it's funny. In Australia dd/mm/yy is the default.
distances 14 hours ago||||
I've never seen dd-mm-yy. It's usually dd.mm.yy, dd.mm.yyyy, or yyyy-mm-dd, with some dd/mm/yy sprinkled in for general confusion.
letier 14 hours ago||||
Or 27.7. in some other places.
kuboble 14 hours ago||||
Nope,

There are quite some countries around the world using d/m/y

https://en.wikipedia.org/wiki/List_of_date_formats_by_countr...

Algeria, Belgium, Brazil, Chile...

ashwoods 14 hours ago||||
Not really. Spain's traditional format is dd/mm/yyyy with slashes. This applies for a good chunk of Europe. Germany/Austria uses dot, I think nordic countries embraced the dash. While you might see more adoption in offical/digital contexts, I just double checked a few popular spanish websites, all slashes.
layer8 10 hours ago||||
27–7 would be 20.
konart 12 hours ago|||
You mean 27.7
walrus01 13 hours ago||
Or 11/Shrawan 2083 if you're in Nepal
vinhnx 9 hours ago||
Less than 2 hours left to the Kimi moment. It’s been more than 2 years since the DeepSeek moment that shook the world.
onesandofgrain 8 hours ago|
Coreweaves gonna boom
binyu 7 hours ago|
Did the link change or anything?

Getting 404 Sorry, we can't find the page you are looking for.

jorisw 7 hours ago|
It's up.
More comments...