11 ms·
Wow, the latency on requests feels great!! I’m really curious: is this running entirely with Python?
by arktiso 3y ago
Wow, the latency on requests feels great!! I’m really curious: is this running entirely with Python?
- TheEzEzz 3y ago100% Python but with a good deal of multiprocessing, speculative decoding, etc. As we move to production we can probably shave another 100ms off by moving over to a compiled system, but Python is great for rapid iteration.