3 ms·
This is great point, actually - "you hit the nail on the head" :-) and I would like to reply. I am running a very long sessions with LLMs via custom python scr
by Gerard22Aug 1mo ago
This is great point, actually - "you hit the nail on the head" :-) and I would like to reply.
I am running a very long sessions with LLMs via custom python scripts. Technically, one may call them "harness" but that would be just laughable ... It's literally python script using direct API calls (Vertex in my case) and maintaining the "living session" with all turns etc and also doing the explicit caching. I'm not using LLMs for coding. That hopefully answers another comment regarding why I brought up MD – this is how LLMs output responses to my prompts.
And this is the thing: I fully control input and output and I just know it can't use any other tool. It also, as I said, runs on separate hardware if it is "obliterated" model or runs in GCP for me.
In my setup it is impossible for LLM to get anything hidden with one-shot or gain a shell, as you mentioned.
Did I understand you correctly or I missed something?
Thanks for your points.