3 ms·
I'd thought to share this quick tutorial to get an actual autonomous agent running on your local and doing some simple tasks. Still in progress trying to figure
by avetiszakharyan 1y ago
I'd thought to share this quick tutorial to get an actual autonomous agent running on your local and doing some simple tasks. Still in progress trying to figure ou right MLX settings or proper model version to do it, but the framework around this approach is solid, so i hought i'd share!
- nottorp 1y agoNow how do you feed it an existing codebase as part of your prompt? Does it even support that (prompt size etc).
- avetiszakharyan 1y agoYe you can just run it in a folder, and ask it to look around, it can execute bash commands, do anything that Claude Code can do. it will read all the codebase if it has to
- pylotlight 1y agoTypically I'd use tools for that as context will be finite, but I hear it does a decent job at tool calling too so should see solid perf there.
- avetiszakharyan 1y ago8b was very bad at tool calling. 30b does an "ok" job but requires the wrapper to do a lot of job, like for example the model will be very random, either have multiple tool_call ags, or have multiple tool calls in one tag inconsistant. but "handle-able"