4 ms·
Could you elaborate what does "compiling orchestration prompt" mean?
by krzyk 5mo ago
Could you elaborate what does "compiling orchestration prompt" mean?
- throawayonthe 5mo agoa guess but i think they mean take the orchestration prompt and prompt yet another llm to turn that prompt into code..?
- Frost1x 5mo agoWhen you get some abstraction working you concretize it in something deterministic, or sort of “cache” that knowledge bit (aka write me a function, class, library, whatever). In the future, the nondeterministic path now has a deterministic piece to lean on as it explores the problem space. Rinse, repeat, eventually you have a mostly deterministic system now. Leave flexibility in space where you need that nondeterminism.
- LikesPwsh 5mo agoRather than telling the LLM "loop through these files", tell it "write a script to loop through these files", then hard-code that script somewhere.
- whattheheckheck 5mo agoThe models will eventually be able to know that they need to do that to get the thing done from natural language
- suttontom 5mo ago"The models will eventually..." Yeah but they haven't, and it's been years now. Also who cares? We have problems right now that need to be solved.
- renticulous 5mo agoFirst we gave LLMs access to bash commands. Now we give them access to customized commands which they can reuse. It's English language extending its claws into deterministic programming language. Now can we please have backtracking and dynamic programming like thinking loop built into English language or such orchestration prompts.
- deleted 5mo ago[deleted]