3 ms·
Vectorizing the entire eCFR for $3.00 and 22 minutes
- jkb79 5y agoGreat blog post, throughput is very often overlooked when talking about model inference.
- dmitrykan 5y agoThis is fantastic work, Max! I like where you're going with this unit economy. It is increasingly more and more common that companies need ways of productizing their deep learning models with tight SLA constraints and tight budgets. I think, one of the logical steps could be integration with vector databases / frameworks and measuring gains there in client setups.