oscarmoxon

4 ms·

1.
How we Built Private Post-Training and Inference for Frontier Models(workshoplabs.ai)
7 points by oscarmoxon 7mo ago|1 comments
2.
by oscarmoxon 7mo ago
Some of this exists already in pockets (Common Crawl, The Pile, RedPajama are all volunteer/open efforts). I suppose there's no equivalent of the "edit this page and see the impact" like with have with Wikipedia. Contrib
3.
by oscarmoxon 7mo ago
Agree that this makes it unlikely we see frontier training data OS'd but this is a separate problem from software and infrastructure transparency, which has none of those constraints. Training stack, the parallelism decisions, document
4.
by oscarmoxon 7mo ago
Agree, this feels like a distinction that needs formalising... Passive transparency: training data, technical report that tells you what the model learned and why it behaves the way it does. Useful for auditing, AI safety, interoperability.
5.
by oscarmoxon 7mo ago
Compute costs are falling fast, training is getting cheaper. GPT-2 costs pocket change to train, and now it costs pocket train to tune >1T parameter models. If it was transparent what costs went into the weights, they could be commodifie
6.
by oscarmoxon 7mo ago
The framing here is undersold in the broader discourse: "open weights" is a ruse for reproducibility. What you have is closer to a compiled binary than source code. You can run it, you can diff it against other binaries, but you c
7.
by oscarmoxon 1y ago
Personally, I love this theory. The thought of natural assembly and selection at the level of Black Holes is alluring. Not sure what The Black Mirror Hypothesis ( https://curtjaimungal.substack.com/p/when-you-fall-into-a
8.
by oscarmoxon 1y ago
They're also littering the London tube system with ads - there's definitely been a lottery win or a series A.
9.
by oscarmoxon 1y ago
The fact that the machines generated this Wikipedia page for their version of events makes this artwork. https://claude.ai/public/artifacts/b0e14755-0bd9-4da6-8175-c...
10.
Overlay hundred-year-old British maps on modern satellite imagery(maps.nls.uk)
1 points by oscarmoxon 2y ago|1 comments
11.
by oscarmoxon 2y ago
The National Library of Scotland has an impressive web tool that allows you to overlay detailed historical Ordnance Survey (OS) maps (dating back to 1841 for this instance) onto modern satellite imagery. The interface lets you adjust transp
12.
by oscarmoxon 2y ago
by this metric, Midjourney produce 1,920,000,000 images/day, that would put it on-par with Google at 8.9bn searches/day!
13.
The Technology Emits the Genius(oscarmoxon.com)
2 points by oscarmoxon 2y ago|1 comments
14.
Emergent Complexity(oscarmoxon.com)
1 points by oscarmoxon 2y ago|0 comments