2 ms·

There’s also ggml, which is quite impressive considering they get whisper and other models to run on a phone.