5 ms·
The most interesting part of this paper to me is that they let the agent guess how efficient it’s own solutions were and only had the model experimentally verif
by finitestateuni 3y ago
The most interesting part of this paper to me is that they let the agent guess how efficient it’s own solutions were and only had the model experimentally verify it’s guesses in 0.002% of cases. This allowed the model to search much faster than another program that didn’t guess and had to run every program.
- Zamicol 3y agoThat sounds like intuition.
- Filligree 3y agoIntuition is the only thing we've figured out how to automate. Reason turns out to be higher hanging fruit.
- the_other 3y agoLike humans’ “slow” and “fast” thinking, then?
- fragmede 3y agoIf you tell ChatGPT "show your work", you get better answers
- Filligree 3y agoThere's likely a connection. Either way, I like to describe AIs like ChatGPT / diffusion models, etc. as operating 100% on intuition. It gives people a better intuition of their weaknesses... For GPT you can kind of prompt it to do chain-of-thought reasoning, but it doesn't work very well; not if you compare it to what humans do. Once again it seems like what we thought was hard, is easy; what we thought was easy and computer-like turns out to be hard.
- munchler 3y agoThe Google Bard folks have a blog post today making exactly that connection: https://blog.google/technology/ai/bard-improved-reasoning-google-sheets-export/ https://blog.google/technology/ai/bard-improved-reasoning-go...
- deleted 3y ago[deleted]
- tux3 3y agoThis is the same sort of "more guesses faster beats smarter guesses slower" that made afl-fuzz by far the best at exploring large search spaces in program fuzzing Fast search often beats accurate search. Sometimes adding clever heuristics or more complex scoring "works" but slows down the search enough that it's an overall loss. Another kind of a bitter lesson, perhaps
- lqr 3y agoBut why isn't the proposed method an instance of smart guessing? It reduces oracle complexity with heuristics. The heuristic is "build a machine learning model of the objective function and use it to fake oracle queries most of the time."
- blackbear_ 3y agoThis is actually quite common to optimize stuff in several disciplines. You essentially fit a surrogate model (keyword if you want to look up more) to whatever you want to optimize, then use the model to guide the procedure, making sure that the model is correct every one in a while.
- dsign 3y agoI've been wondering about a similar approach for biomolecular simulations, where exact computations are still a hard bottleneck. I wonder if something like this could give us a few orders of magnitude more speed.