Why don't machine learning research agents overfit?

Posted by Betelbuddy 2 hours ago

Why don't machine learning research agents overfit?(www.amazon.science)

52 points | 27 comments

diddid 55 minutes ago|

I always get annoyed when people misinterpret Occam’s razor. It’s not that the simplest is more likely to be correct, it’s that you should prefer it, because it’s simple.

It’s just like the Hopper quote. She said it’s better to ask for forgiveness during the fog of war, doing something you thought was right, not to do something you knew they were going to say no to and now you are trying to get away with something.

srean 23 minutes ago||

I think you should get less annoyed.

> It’s not that the simplest is more likely to be correct, it’s that you should prefer it, because it’s simple.

I don't know what Occam meant, but if you accept the formalism of PAC learning, it is more likely to be correct

http://www.cse.buffalo.edu/~hungngo/classes/2008/694/papers/...

http://cs.ecs.baylor.edu/~hamerly/courses/5325_10s/papers/le...

p-e-w 14 minutes ago||

There are also various metaphysical theories that posit that the universe is algorithmically generated in some sense or the other, and from many of those theories it follows that simplicity is a fundamental feature of reality, which yields an even stronger version of Occam’s Razor.

beckhamc 23 minutes ago|||

And sadly, in academia, complexity (opposite of Occam's razor) is what gets you published.

gowld 46 minutes ago|||

That's not true. It's pretty clear that she meant "do something you knew they were going to say no to and now you are trying to get away with something."

https://youtu.be/wHdHCoeUbU4?t=861s

> So I want to tell something to all the young people here on many many occasions you'll find it is much easier to apologize than it is to get permission. You do it then when somebody comes after you and say are you supposed to do that, "oh gee I didn't know I wasn't supposed to do that" ... so just remember it's frequently much easier to apologize than it is to get permission do it

She goes on further, explaining how to deceive your superiors to manipulate them to get what you want.

diddid 8 minutes ago|||

But I still don’t think that means eat all the cookies in the cookie jar and then apologize after because nobody would have given permission. That’s still about doing what you believe to be right. She even frames the fallout as “where you supposed to do that?” and not “you shouldn’t have done that”.

neutronicus 31 minutes ago|||

Damn no wonder she got a supercomputer named after her

sillyfluke 33 minutes ago||

>It’s just like the Hopper quote.

Not sure about Hopper, as I recall biographers of Lawrence of Arabia certainly made it seem like he was using the fog of war to do things he knew his superiors may object to.

Regardless, even if its misinterpreted it still has a kernal of truth and separate utility than your version, that is: the people in the field closest to the action have an operational awareness that may result in better decisions in times of urgency.