5 ms·
GPT doesn't work that way. Any such shell would have to send a GPT request for every single keystroke, and you'd hit the API ratelimit very quickly. It would al
by LeoPanthera 4y ago
GPT doesn't work that way. Any such shell would have to send a GPT request for every single keystroke, and you'd hit the API ratelimit very quickly. It would also be very expensive.
- LanternLight83 4y agoMaybe a solid use case for local models are they're optimized for consumer hardware-- someone clever could preserve as much context as possible between requests
- throwaway280382 4y agoWell, eventually, better models will be made and they can be used locally