7 ms·
I wonder why companies like IBM are jumping on the LLM bandwagon and training/releasing models that have no chance of competing with Llama/Mistral? To me it jus
by hustwindmaple1 2y ago
I wonder why companies like IBM are jumping on the LLM bandwagon and training/releasing models that have no chance of competing with Llama/Mistral? To me it just looks like a complete waste of $$ because nobody will use them in any serious scenarios
- paxys 2y agoIBM made $60 billion in revenue last year. Where do you think it all came from? The same companies/governments that buy their overpriced crap are going to buy these new LLMs as well.
- breezeTrowel 2y agoThese are open weight models released under an Apache 2.0 license. There's nothing to buy.
- kkielhofner 2y agoIBM is a sales and services org. Their customers aren’t going to build their own RAG and agent frameworks, vector DBs, data ingest pipelines, finetunes, high scale inference serving solutions, etc, etc. There’s an incredible amount of stuff to buy.
- hustwindmaple1 2y agoRight, but they can just use Llama/Mistral for free, instead of their inferior models, which I'm sure take quite a bit of resources to train in the first place.
- kkielhofner 2y agoYes but using someone else's models doesn't make them an "AI company".
- paxys 2y agoWho is going to host them?
- Brajeshwar 2y agoWhen they pitch potential clients for their services, their slides on LLM, AI, ML, etc., must be their own. Whether they use it or not for the services does not matter. These are like the side projects that service companies release to help them close their clients.
- mhh__ 2y agoIBM do a mixture of shovelware and extremely hardcore tech so they could honestly go either way with this.
- propter_hoc 2y ago> mixture of shovelware and extremely hardcore tech Citation needed All I've seen from them in my professional experience is actually legacy mainframe maintenance.. Not shovelware, but very far from hardcore tech.
- starspangled 2y agohttps://research.ibm.com/semiconductors#publications https://research.ibm.com/semiconductors#publications https://research.ibm.com/blog/albany-semiconductor-research-ibm https://research.ibm.com/blog/albany-semiconductor-research-... etc IBM doesn't have fabs, but they still do R&D into semiconductors that very much target future commercial processes. They do a fair bit on quantum computing too, to name just a couple of things.
- mistrial9 2y agono - here is an example from Aug 2019 EE Times: PALO ALTO, Calif. – IBM defined at (trade show ed.) Hot Chips a new interface for the 2020 version of its Power 9 CPUs. The Open Memory Interface (OMI) will enable packing on a server more main memory at higher bandwidth than DDR, and as a potential Jedec standard could rival GenZ and Intel’s CLX. OMI basically removes the memory controller from the host, relying instead on a controller on a relatively small DIMM card. Microchip’s Microsemi division already has a DDR controller running on cards in IBM’s labs. The approach promises to deliver up to 4TBytes memory on a server at about 320GBytes/second or 512GB at up to 650GB/s sustained rates.
- andsoitis 2y ago“The South Korean technology giant Samsung Electronics was awarded a total of 6,165 United States patents in 2023, the most of any company. Qualcomm ranked second among companies, with 3,854 U.S. patents granted, followed by the likes of Taiwan Semiconductor Manufacturing Company and IBM.” — https://www.statista.com/statistics/274825/companies-with-the-most-assigned-patents/ https://www.statista.com/statistics/274825/companies-with-th...
- halJordan 2y agoOn the other hand i spend my time wondering why people like you think someone should just throw away their ideas simply because there's already someone in the niche.
- xarope 2y agoEnterprises think differently. They want data provenance, privacy, ability to mitigate/transfer risk etc. If IBM is willing to offer that, there will be enterprises that bite.
- _lvbh 2y agoLlama and Mistral are already local & fulfill these requirements
- rolisz 2y agoYes, but nobody got fired for buying IBM
- antod 2y agoYeah if something you install doesn't work, you get the blame. If IBM supplies something that doesn't work (likely), you get to blame them instead.
- szszrk 2y agoBetween "works" and "doesn't work" there is a full rainbow of possible answers, KPIs, yearly reviews in a network of matrix reporting. There will be market for their services. Maybe a different one, but there will be.
- morgante 2y agoThat's a pretty outdated phrase, even in enterprise.
- Jedd 2y ago> ... models that have no chance of competing with ... I've not seen any proper evaluations for Granite against, say, Llama or Mistral. Until we do it's probably too early to say they can't compete, at least in some areas where others perform poorly.
- abdullin 2y agoThey are Ok-ish. Previous Granite models were on the level of first llama in my benchmarks. I’m expecting this version to be roughly comparable to llama 2
- logicchains 2y ago>I wonder why companies like IBM are jumping on the LLM bandwagon and training/releasing models that have no chance of competing with Llama/Mistral Did you even read the benchmarks they post on that link? Assuming they're not outright lying, their 8B model is superior to Llama/Mistral models of the same size for coding tasks.
- cess11 2y agoSame reason they jumped on the clown bandwagon, it's the kind of offering it's expected to have when you're a company like that. Huge size, leading research departments, big enterprise customers. They've been doing "AI" for ages. Notably Watson over the last couple of decades or so.
- jujube3 2y agoWhat is "the clown bandwagon"?
- papruapap 2y agoprob getting some reputation in AI space will help them to sell watsonx. tbf, watson predates Transformers paper.