3 ms·
This is just not correct. Also nobody is making optimization startups because if you cared you’d have an in house team working on it.
by saagarjha 11mo ago
This is just not correct. Also nobody is making optimization startups because if you cared you’d have an in house team working on it.
- numbers_guy 11mo agoThere are a few "optimization startups". But in this context I find it a bit ironic that pretty much everyone is working with the same architecture, and the same hardware for the most part, so actually there isn't really that much demand for bespoke optimizations.
- ACCount37 11mo agoAnd when you have enough spending to account for 1%+ of revenue for the AI hardware companies? You can get the engineers from those very hardware companies to do bespoke optimizations for your specific high load use cases. That's something a startup would struggle to match.
- saagarjha 11mo agoThose that are serious are paying through the nose for their engineers to work on these optimizations. Your competitor working on "the same hardware" does not magically make your MFU go up.
- jeffreygoesto 11mo agoThat is unfortunate, because these are special skills you may but find inhouse. I know some guys that did it inhouse for a long time, toured from project to project in the right phase and saved bigcorp lots of money. Now they are doing it publicly. https://efficientware.net/how-we-work/ https://efficientware.net/how-we-work/
- saagarjha 11mo agoUsually large companies attract or develop these skills by their scale. I do think there a lot of smaller companies that are underserved in this area, though.