3 ms·
Related commentary on "self-play" by Subbarao: https://twitter.com/rao2z/status/1728121216479949048 https://twitter.com/rao2z/status/1728121216479949048 From t
by ignoramous 3y ago
Related commentary on "self-play" by Subbarao: https://twitter.com/rao2z/status/1728121216479949048 https://twitter.com/rao2z/status/1728121216479949048
From the article:
FunSearch uses an evolutionary method powered by LLMs, which promotes and develops the highest scoring ideas. These ideas are expressed as computer programs, so that they can be run and evaluated automatically.
The user writes a description of the problem in the form of code. This description comprises a procedure to evaluate programs, and a seed program used to initialize a pool of programs.
At each iteration, FunSearch selects some programs from the current pool. The LLM creatively builds upon these, and generates new programs, which are automatically evaluated. The best ones are added back to the pool of existing programs, creating a self-improving loop.
For websearch, I (evaluator) use pplx.ai and phind.com in a similar manner. Ask it a question (seed) and see what references it brings up (web links). Refine my question or ask follow-ups (iterate) so it pulls up different or more in-depth references (improve). Works better in unearthing gems than sifting through reddit or Google.
Given Tech Twitter has amazing content too, looking forward to using Grok for research, now that it is open to all.