Posted by lukasschwab 14 hours ago
Happy to answer any questions. We have a discord https://marin.community/
"Oh, theres a process."
Great. Where is it documented?
"in a spreadsheet."
Which spreadsheet?
"Well, theres the old spreadsheet, new spreadsheet, and the spreadsheet that Karen maintains."
Where's Karen?
"She left in 2021."
I don't get to break out my academic voice that often these days, so I appreciate the indulgence.
The Marin project from Stanford (and I believe now ran by Openathena, the authors of this blog post) is really promising and cool: https://marin.community/
Precise and very clearly written.
I could also imagining them happening as state projects for the sake of competitiveness.
If we can help people automate drudgery while giving them a real say in what gets built and control over how their work is used, I think there’s a possibility of a much better outcome than the current trajectory. I’m not sure we’re in that world, but I think we should try.
The relevant question here is whether you want open-weight models — projects like Open Athena — to remain or become competitive in the same range of specialties.
I also wonder when the NSA starts sharing their wiretaps/etc with labs for 'national security'. Probably already happening, to be honest.
What would this benefit the NSA? If they share wiretap records with labs such as Anthropic, then suddenly anyone who can jailbreak a model gets access to this data. You don't need to train a model on data to understand or interpret it, as far as I know - providing others (esp. AI labs) with sensitive data is a breach of security, or I am not understanding.
NSA doesn't have to post train Fable. Maven works well enough and that same infra. can be used for Fable. I imagine that's what's going to happen in 2 years once the current admin. moves out.
The next iteration of AI assisted devs will not have all the devs use the same harness and model like most do now.
Instead, devs will build their own post trained models that are experts of their own domain, that have their secret sauce..
I imagine any dev would want most of those models to be something they can self host because of multiple reasons - one of them being that their employers or customers might not agree to use a cloud hosted or managed model. Plus, costs. And control.
Post training is in the future because we haven't yet reached a shared agreement on what that first "good enough" model will be like - and also because the current AI scape is in a state of flux where post training will have a lot of churn.