2 ms·
I wonder if there's room for model caching. Sacrifice some personalization for near similar results so you aren't hitting the model so often.
by lajamerr 4y ago
I wonder if there's room for model caching. Sacrifice some personalization for near similar results so you aren't hitting the model so often.
- mgraczyk 4y agoYeah we did lots of things like this at Instagram. Can be very brittle and dangerous though to share any caching amongst multiple users. If you work at Facebook you can search for some SEVs related to this lol