But such small models are too dumb to be acceptable for conversation. Far more likely that there will be an API call to an actually large model in the cloud. If

But such small models are too dumb to be acceptable for conversation. Far more likely that there will be an API call to an actually large model in the cloud. If you really don't have any network connection, you are simply out of luck. It's not as if transferring a little bit text would require a lot of bandwidth anyway.