Never heard of Bonsai before, but that looks great and promising for local on-device inference. Yet, seems like there is still another year for improvements.

Never heard of Bonsai before, but that looks great and promising for local on-device inference. Yet, seems like there is still another year for improvements. I like local models (but not mainly using them) for offline needs.