3 ms·
By far the most interesting part (after the 400% speed up in some cases) is the methodology: rather than hill climb on operations, they forced a language reason
by vessenes 1y ago
By far the most interesting part (after the 400% speed up in some cases) is the methodology: rather than hill climb on operations, they forced a language reasoning step between iterations to encourage diversity of search. This seems to have worked. Very very interesting.
- lucidrains 1y agooh wow, I was looking for use of islands or map-elites that I missed this.. thought it was the blandest mimetic evolution possible
- vessenes 1y agoJust anecdotally I feel like hill climbing on operations is just so slow; I’m not saying it doesn’t work, but it always feels one step away from brute force search. I really like the idea of just throwing stuff at the LLM and giving it access to old strong variants in context.
- deleted 1y ago[deleted]
- deleted 1y ago[deleted]