3 ms·
Models aren't just big bags of floats you imagine them to be. Those bags are there, but there's a whole layer of runtimes, caches, timers, load balancers, class
by TeMPOraL 7mo ago
Models aren't just big bags of floats you imagine them to be. Those bags are there, but there's a whole layer of runtimes, caches, timers, load balancers, classifiers/sanitizers, etc. around them, all of which have tunable parameters that affect the user-perceptible output.
- natebc 7mo agoThere really always is a man behind the curtain eh?
- TeMPOraL 7mo agoIt's still engineering. Even magic alien tech from outer space would end up with an interface layer to manage it :). ETA: reminds me of biology, too. In life, it turns out the more simple some functional component looks like, the more stupidly overcomplicated it is if you look at it under microscope.
- coldtea 7mo agoOften it's literally just that: https://www.msn.com/en-us/money/other/ai-startup-backed-by-microsoft-revealed-to-be-700-indian-employees-pretending-to-be-chatbots/ar-AA1G0F69 https://www.msn.com/en-us/money/other/ai-startup-backed-by-m...