I use GPT-4 to assist in some programming, and it's useful. But I've been struggling to figure out where LLMs make sense as something integrated into a larger p

I use GPT-4 to assist in some programming, and it's useful. But I've been struggling to figure out where LLMs make sense as something integrated into a larger product. As an end-user, where I can directly ask them for something specific ("write a function that...") that I can both inspect, double check, and further refine before accepting, they make sense to me. But as an integrated aspect of some system, I haven't been able to come up with any compelling, or even mildly useful usecases. Also, is anyone using the local, non-OpenAI LLMs for anything useful? They've always been slower and measurably worse than OpenAI's GPTs for me.