4 ms·
You use clean room everywhere in the article and clear room in the title. Is this on purpose?
by airza 7mo ago
You use clean room everywhere in the article and clear room in the title. Is this on purpose?
- lazide 7mo agoLiterally nothing about it is either, either.
- rustyhancock 7mo agoYes for a moment I thought clear room might mean something else for LLMs. Essentially they can't do clean room anything! You might as well hire the entire former mid level of a businesses programming team and claim it's clean room work
- steve1977 7mo agoWindows NT is not VMS! Trust me!
- rustyhancock 7mo agoHad to Google this but I do love a deep cut reference! https://www.itprotoday.com/server-virtualization/windows-nt-and-vms-the-rest-of-the-story https://www.itprotoday.com/server-virtualization/windows-nt-...
- HarHarVeryFunny 7mo agoAt first I thought it was brain slip in the HN title, then I saw TFA also said "clear", so thought it was perhaps a sarcastic jab at the original "clean" room story it is commenting on, but maybe in the end just an error ? In any case, an interesting experiment.
- HarHarVeryFunny 7mo agoIt would also be interesting to see how well the best open weights models such as Kimi K2.5 can do on a task like this with the same prompting to first gather specs, etc, etc. In fact this would make for an interesting benchmark - writing entire non-trivial apps based on the same prompt. Each model might be expected to write and use it's own test cases, but then all could be judged based on a common set of test cases provided as part of the benchmark suite.