5 ms·
The market is definitely there for enterprise LLMs. Everyone is using GPT for work. I use it to provide stubs for memos and to brainstorm - but the real value c
by 40acres 3y ago
The market is definitely there for enterprise LLMs. Everyone is using GPT for work. I use it to provide stubs for memos and to brainstorm - but the real value comes from replace internal “tribal knowledge” with an AI who knows your org in and out.
- mrkramer 3y ago>The market is definitely there for enterprise LLMs. Also in the news: https://www.cnbc.com/2023/05/02/chegg-drops-more-than-40percent-after-saying-chatgpt-is-killing-its-business.html https://www.cnbc.com/2023/05/02/chegg-drops-more-than-40perc... >but the real value comes from replace internal “tribal knowledge” with an AI who knows your org in and out I bet Microsoft is already working on that.
- fakedang 3y agoWe already have something developed like that in our company (~30 pax employee owned wealth management firm). It's.... interesting. We currently use GPT-4 combined with an internal knowledge base we had earlier since the beginning, and we practically have to fire our chief of staff and the admin team. Just kidding, but it's made her team's work a ton easier that she can devote more time to the nitty-gritty hard stuff. The interesting part is that I had a bit of a personality touch added as part of its context, so the AI's character is quite.... villainous. Enterprise self-hosted ChatGPT is going to be huge.
- jeremycarter 3y agoI am about to release a self hosted GPT that works with OpenAI and Azure OpenAI. It has several enterprise features, mostly around authentication/authorisation. I'll let you know when it drops or you can be a beta tester if you like!
- fakedang 3y agoNoted. Just a few questions, what do you mean by "works with OpenAI"? I thought those were closed systems, so is the system basically pretrained and the weights saved? I'm pretty sure that if it were even possible, it would still be misuse per their terms and conditions? Currently we use an initial semantic search for context injection, which is then passed to GPT for completions. If any LLAMA company were to make that second pretrained bit self-hostable for some license fee, I know a bunch of companies in finance of all sizes which would readily pounce on that tool. But I'm fairly certain that's not what Open AI wants to do.
- moonchrome 3y agoI've seen fine tuning attempts on internal documents - it's terrible (eg. mixing up stuff between locations/teams, making shit up) They are now trying to build a search index and feeding it in-context results. Honestly not seeing much value over a search index, but hey if it makes the internal data easily searchable under the banner of AI hype it's a win.
- brandall10 3y agoThere's something like 5-6 companies in the W23 batch tackling this space.
- unixhero 3y agoWe just ordered a white label instance from Open AI. It will consume some terabytes of data and hopefully be the oracle we need.
- nextworddev 3y agoThey offer white label instance? TIL
- jacquesm 3y agoYes they do. Also, these are completely without any of the safeguards that the public instances have. This 'on the record' by a Microsoft regional CEO that was pushing this pretty hard.
- nextworddev 3y agoSick. So they get pretty much the "base" model? That's almost too powerful
- bagels 3y agoCan you point us to how you did this?
- croes 3y agoSo employees share their knowledge to get replaced by an AI?
- amitport 3y agoone could argue that sharing knowledge was not exactly in employee interest even before AI. (it makes it easier for some junior to replace you some day)
- hammyhavoc 3y ago"Everyone" is exaggeration at best.
- hospitalJail 3y agoIt kind of boggles my mind that there are people who arent using LLMs yet. Sure its not everyone, but the people who arent using them are signaling a major red flag IMO. They are resistant to change, even if they don't understand the technology, what else are they resisting from their managers/leadership team? Further, I think of the people in my life who have refused to even try it, they all seem to have a screw or two loose, even if they are making 200k/yr successful. All IMO of course, but in tech, I imagine something needs to be 'off' to never try it. EDIT: Seems I'm getting criticism from people who are using it for inappropriate use cases. I don't use a screwdriver to hammer nails.
- SpaceManNabs 3y ago> It kind of boggles my mind that there are people who arent using LLMs yet. maybe it is easier to go through actual verified information than to double check everything an AI says. I only use LLMs to restate information that I can half piece together so I can remember the missing bits (like a math proof or derivation), or to point me to recommendations of actual resources. And even those two things i am very wary off.
- hospitalJail 3y ago>maybe it is easier to go through actual verified information than to double check everything an AI says. Wrong tool for the job. You don't ask it information questions. Ask it brainstorming questions.
- hammyhavoc 3y agoThey're wildly inappropriate for most things. For similar anecdata, see blockchain fever where everybody shoehorned it in wherever they could, even when a traditional database made more sense. Consistent conditional logic makes more sense than a risk-laden hallucinating LLM for a lot of workflows. "Everyone" doesn't need to hammer nails because there's more than just one career and industry. The acceptable quality of the job output varies drastically too. "It kind of boggles my mind" that people can't see beyond their own life.