4 ms·
For anyone interested I've been working a very similar idea of LLMs for blackbox optimization: https://github.com/sshh12/llm_optimize https://github.com/sshh12/
by sshh12 3y ago
For anyone interested I've been working a very similar idea of LLMs for blackbox optimization: https://github.com/sshh12/llm_optimize https://github.com/sshh12/llm_optimize
- lachlan_gray 3y agoThis is awesome. I was working on something similar (but got distracted) except my strategy was evolutionary. The idea was that the LLM had to figure out what it’s optimizing for itself. I find that as soon as an LLM has an explicit definition of what it’s doing, the exploration/exploitation ratio swerves into exploitation and it gets stuck
- sytelus 3y agoThis is very nicely done and much more clear to follow than the paper. One question: Does LLM get to evaluate the code using tool or guess the return value of f(x)?
- sshh12 3y agoThanks! The LLM only sees the result of f(x). So like in the code writing example, the code is actually executed with `eval()`.