3 ms·
I work at a big tech company and there is a complete ban on coding using LLMs. The fear is sending our code for the model to learn in the future. This is also w
by shmatt 4y ago
I work at a big tech company and there is a complete ban on coding using LLMs. The fear is sending our code for the model to learn in the future. This is also why then hype around GTP4-powered Office is overhyped. Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets
Until an on-prem solution is offered, many of these companies won't get anything out of the technology
The layoffs at big tech are caused by un-even profit generating, Where 5% or 20% of the company generate 99.9% of income. The rest are essentially startups being funded by rich VCs. Eventually if you don't find PMF the VC cuts the funding
- walthamstow 4y ago> Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets Aren't they already doing this, if your documents are in Sharepoint or Google Drive? I have assumed so, but with no basis
- maeil 4y agoFor big companies, that on-prem solution is coming sooner rather than later. For small companies, plenty of them (likely the large majority) will be very willing to take the "risk" for the save in labour costs.
- blackbear_ 4y ago> Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets. Which is why Microsoft will be able to charge outrageous fees for enterprise plans that keep employees' queries to GPT private and out of future training sets. I do not think on prem will be successful, though, the hardware requirements are fairly substantial and specialized.
- dougmwne 4y agoHow do you reconcile what you just said with the massive popularity of cloud services? The source code is already sitting in the same data center the LLM GPUs are sitting in. Of course there are some businesses too paranoid to use the cloud, but even intelligence agencies are on board these days.
- xdennis 4y agoProbably because people view the cloud as their data in someone else's hands, but AI companies view data as fair game for ingestion, since "they just learn like humans, and you allow humans to view your data, right?".
- frenchy 4y agoWith cloud services, there's some expectation that your stuff is private. Copilot is like doing all your cloud development with an anonymous FTP server.