I'm finding the interface to be the biggest hurdle too. I was talking to Grok about the possibility of using an LLM as a personal assistant that would gradually

I'm finding the interface to be the biggest hurdle too. I was talking to Grok about the possibility of using an LLM as a personal assistant that would gradually learn my preferences and the context of my work. It explained that LLMs are stateless, so any context that you want it to have, you have to feed back in with the prompt. I'd need to build a wrapper of sorts around the LLM, that would save our conversations and feed them back in each session, saying "Here's everything we've said before; use that as context for this new prompt." I can script that, but the payload would just keep growing, and if you're scripting this around an API, which would be the only way to make it work, the per-token charges for all that context are going to stack up. That doesn't seem workable unless you're running your own local LLM. It'd be the same thing with having it process files. Sure, I can script something that does "Take all the files in a directory, give them to an LLM in a way that lets it distinguish where files start and end, and have it process them in some way and spit out the results." But that's a fair amount of work, so it's not worth it unless I come up with a task the LLM can do that I can't do with grep and other utilities. So I'm still just sort of chatting with it, bouncing ideas off it and having it do some useful research and summarization, but still looking for ways to use it that feel like it's really having an impact on my productivity.