3 ms·
Except this is a pretty good case for using an SBC: 1. they're fairly low power and 2. the LLM speed is less of an issue because SMSs like this don't warrant
by nmstoker 2y ago
Except this is a pretty good case for using an SBC:
1. they're fairly low power and
2. the LLM speed is less of an issue because SMSs like this don't warrant an instant reply anyway so if it takes 2 or 3 minutes to generate that's fine