7 ms·
The Threat to OpenAI
- bookofjoe 2y agohttps://archive.ph/qLgvp https://archive.ph/qLgvp https://www.wsj.com/tech/ai/ai-chatgpt-nvidia-apple-facebook-383943d1?st=d352fr7x3ue69mu&reflink=desktopwebshare_permalink https://www.wsj.com/tech/ai/ai-chatgpt-nvidia-apple-facebook...
- thorum 2y agoIf the rumors about the upcoming Strawberry and Orion models from OpenAI are true - supposedly capable of deep research, reasoning and math - they probably don’t have much to worry about. Not to mention they still have the only fully multimodal model.
- forrestthewoods 2y agoModels are only state of the art for 12 to 18 months. There’s not a model in existence today that will have any value in 5 years. They will all be obsolete. Thus far no one has any moat on their model.
- willy_k 2y agoNot on the model but most companies don’t sell models, they sell products and that use models. GPT-3 became obsolete at some point but ChatGPT hasn’t, and has some level of moat with their ecosystem. And cloud providers have moats via lock in, just for blanket products instead of any one model.
- krackers 2y agoAccording to that recent The Information report, Orion is supposed to be just a regular LLM except trained with synthetic data generated via Strawberry. Anthropic et al. have also been working on ways to generate synthetic data (as seen in the success of Sonnet 3.5) so I don't really know if that's going to be a big lead. And of course the ever-hyped strawberry is supposed to be some sort of tree-of-thought type thing I think, or maybe it's related to https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2203.14465. Either way, nothing so far has come out that it's a completely novel training technique or architecture, just a gpt-4 scale model with different post-processing.
- CuriouslyC 2y agoI'm not sure why people act so mystified about Q*, the name gives it away, it's an obvious reference to A*, the only question is what the nodes in the graph are and what they're using as a Heuristic function.
- fzzzy 2y agoIt's not. It's Quiet STaR.
- imtringued 2y agoIt is in reference to this: https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2403.09629 https://arxiv.org/abs/2403.09629
- Eliezer 2y agoQ* is also a term from reinforcement learning.
- llmfan 2y ago"just a regular LLM except [trained on very different data]." I'm not saying there's some big moat, anyone can read https://arxiv.org/pdf/2305.20050 https://arxiv.org/pdf/2305.20050, but not all synthetic data is created equal. Strawberry I'm sure generates beautiful, valid chain-of-thought reasoning data. Wouldn't surprise me if OpenAI is just significantly ahead of the competition.
- GaggiX 2y agoWhat is the only fully multimodal model? The GPT-4o checkpoint available to the public can see images but not generate them (it can generate prompts for Dalle 3 to use). OpenAI has an internal model with this capability, but if you don't make it a actual product, it doesn't really matter.
- HeatrayEnjoyer 2y agoIt's even more modal than that, 4o accepts text, image, audio, and video input, and produces text, image, or audio output. Video input isn't available yet and was only briefly demoed. Image and video output haven't been demonstrated publicly at all yet. Rapid productization isn't the priority of most ML devs.
- GaggiX 2y agoOpenAI has a few examples of image output being produced directly by the GPT-4o checkpoint they have. >Rapid productization isn't the priority of most ML devs. It depends if they need money or not, Google has not publish a single image generator that is not a demo.
- martinald 2y agoYes I generally agree with this. Ironically it seems as all the "AI wrappers" look like they have more of a moat than the models (as UX etc is actually quite hard), which is not what I expected at all when the LLM boom started. I think a lot of LLM usage is actually pretty 'simple' at the moment - think tagging, extracting data, etc. This doesn't require the very top state of the art models (though Llama3.1 is very close to that). Hopefully OpenAI have some real jumps forward in the bag otherwise I am struggling to see how they can justify the valuations being floated around.
- CuriouslyC 2y agoThe wrappers don't really have much of a moat either, OpenAI is just bad at front-end dev, so their velocity there is low.
- panarky 2y agoSince most of their code is GPT-generated, their velocity should increase with better models.
- wslh 2y agoI think the problem with valuations is the never ending financial history of hypes. The hype is correlated with the technology or industry but follows its own speculation hype. Even if the valuations and speculations are correct, they could be correct in years with ups and downs. If the dot com era is a good example it took half a decade or more to materialize. Other aspects that are not well studied yet is how online advertisement will be affected if most people around the world end up using a single interface such as ChatGPT. How SEO/SEM/Ads will work in that world? Does someone look at what sites benefit being listed in ChatGPT (e.g. Wikipedia).
- sillysaurusx 2y agoOne killer feature is OpenAI’s vector database. I was surprised you can throw gigabytes of documents at it and chatgpt can see it all. It’s hard to simulate that via context window. That’s not necessarily a moat, but OpenAI is still shipping important features. I wonder how hard it is for Claude et al to replicate.
- greatpostman 2y agoLack of releases from OpenAI make me more bullish on them. Clearly they have something big they’re working on, they don’t care about competing with current models
- jsheard 2y agoThey still need to catch up to their own announcements, Sora was revealed over 6 months ago with no general availability in sight.
- greatpostman 2y agoEven more bullish from me, they have something
- KeplerBoy 2y agoReleasing powerful, novel models like Sora shortly before a major election is just asking for trouble. I believe they are restraining themselves in order to stay somewhat in control of the narrative. Donald Trump spewing ever more believable video deep fakes on twitter would backfire in terms of regulation.
- jazzyjackson 2y agoBesides, isn't it over the top expensive for a few seconds of video ? Election is a factor but even without it I don't know if there's much of a business plan there, what would they have to charge, $20 / minute? Then how many minutes of experimenting before you get a decent result?
- KeplerBoy 2y agoI wonder if it'll be cheaper per frame than the image generators.
- resource0x 2y agoDoes the same bullish logic apply to cold fusion?
- simonw 2y ago> "An apples-to-apples comparison of those numbers with ChatGPT isn’t possible, but OpenAI says the ChatGPT service now has 200 million weekly active users." Is that the first time the 200 million weekly active users number has been reported? UPDATE: No, Axios had this a couple of days ago https://www.axios.com/2024/08/29/openai-chatgpt-200-million-weekly-active-users https://www.axios.com/2024/08/29/openai-chatgpt-200-million-... > "OpenAI said on Thursday that ChatGPT now has more than 200 million weekly active users — twice as many as it had last November"
- usaar333 2y agoThat's actually kind of slow? Even Facebook in 2008 (at these user counts) was growing faster, doubling monthly active every 8 months
- Destiner 2y agonot a single word about anthropic/claude? makes you wonder about the level of journalism at wsj et. al.
- atleastoptimal 2y agololl these people just don't know how far ahead OpenAI is They aren't releasing their best stuff because they genuinely don't know how to make it safe for the public ChatGPT is still dominating and so will what comes up next. All these AI wrapper companies just give them more business
- deleted 2y ago[deleted]
- breadwinner 2y agoWhy hasn't anyone mentioned https://www.perplexity.ai https://www.perplexity.ai yet? I am blown away by its accurate answers. The main difference between ChatGPT and Perplexity is that in addition to better answers it also gives you links to the source. Tools like Perplexity will turn Google into Altavista in the next 2 to 3 years.
- throwup238 2y agoOpenAI launched SearchGPT via waitlist recently which does the same thing as Perplexity. I don’t use the latter so I don’t know how it compares but the OpenAI version been working fine for me. Kagi has also had similar functionality for a while too, which works with their Lens feature and has a fast mode if you add a question mark to the end of a regular search query. It’s not much of a competitive moat compared to having the model itself.
- amiantos 2y agoI did some side by sides and repeated perplexity queries to SearchGPT when I got access about a week ago and I thought SearchGPT was a lot worse, in some cases just plainly misunderstanding a question or surfacing the wrong info. Just my anecdotal data, but feels about right for its beta status. Assumably Perplexity must have a little bit of secret sauce that OpenAI has to figure out.
- staticman2 2y agoKagi doesn't really have a similar function. The Kagi GPT feature only reads a small snippet of the web results, while Perplexity gets a large excerpt of the actual web site. I've tested this by having the AI read back to me the prompt given to it it used to answer the question.
- root_axis 2y agoChatGPT gives you links to online sources for nearly a year now.
- airstrike 2y ago
- fsndz 2y agoThe thing is, the killer app of the generative AI space—at least for large language models (LLMs)—might already be ChatGPT. While people are still searching for the next big application in this field (https://www.lycee.ai/blog/build-killer-app-of-generative-ai https://www.lycee.ai/blog/build-killer-app-of-generative-ai), it's possible that it has already been built. ChatGPT includes a human-in-the-loop design, avoiding the complexities of agentic workflows. You ask questions, get answers, iterate, and use the code interpreter if necessary. It’s like having a thought partner. Given the issue of hallucinations in LLMs, this might be the only feasible user experience. Users must be aware of the potential for hallucinations and have a way to iterate until the desired output is achieved. How else could this be done effectively except through a chat interface? We need to cut through the noise quickly and start leveraging the true value of LLMs (https://www.lycee.ai/blog/llm-noise-value-openai https://www.lycee.ai/blog/llm-noise-value-openai).
- ben_w 2y agoThe counterpoint is that "free" ChatGPT looks really good, and that's hard to monetise because of all the other free chat interfaces. My guess is that ChatGPT is the free advert for the real product, which is their API and in particular the fine-tuning. Using the language comprehension of an LLM as part of a bigger system, RAGging them, forcing the output to comply with continuous tests, etc. does still provide other business opportunities not available to a fully general-purpose chat system with no limits to the kind of content it can produce. If you're trying to make a system that always produces valid SQL, you want it to not just pass a syntax checker but also be valid for the specific schema it's being asked about; you definitely don't want it running fully automated if there's a chance it will append "Let me know if there's anything else I can help you with!" to the end of the query. But this isn't a mere statement of the problem, people are doing that kind of thing with these tools: https://twimlai.com/podcast/twimlai/building-real-world-llm-products-with-fine-tuning-and-more/ https://twimlai.com/podcast/twimlai/building-real-world-llm-...
- fsndz 2y agoWe all know the saying: "If it's free, you're the product." I believe the free version of ChatGPT is primarily a data acquisition tool that OpenAI uses to fine-tune its models and conduct reinforcement learning from human feedback (RLHF) to enhance their usefulness. In machine learning, data is key, and OpenAI is outpacing its competitors largely due to the vast amount of data it can gather from free ChatGPT users. It's already possible to perform Retrieval-Augmented Generation (RAG) on ChatGPT, from simple to complex cases. However, I'm somewhat skeptical about use cases that involve integrating large language models (LLMs) as part of a larger system. While these applications can help build new features, they may not lead to the creation of a 'killer app' in the generative AI space. Take text-to-SQL, for example: it's a useful tool, but you still need a human to audit the generated SQL. You can't blindly trust an LLM to create flawless SQL queries. Therefore, text-to-SQL remains more suitable for technical users rather than those with limited data analytics skills. Otherwise, it could lead to confusion. Imagine a scenario where the commercial director and the marketing director have differing views on last year's sales because they each received different answers from a chatbot. That would be a nightmare. We haven't even managed to make simple dashboards universally acceptable, so diving into hallucination-driven data analytics seems premature. Even with RAG implementations in companies and tools like text-to-SQL, the user interface often remains a chat application. I haven't seen much variation in this regard. While there's a lot of talk about the need to reimagine user interfaces, there's little to show for it so far. Chat interfaces seem to be the most suitable format for LLMs, and ChatGPT is likely the 'killer app' in this domain. OpenAI will likely explore further monetization strategies in the future, perhaps by incorporating ads in some manner. https://www.lycee.ai/blog/ai-reliability-challenge https://www.lycee.ai/blog/ai-reliability-challenge
- bionhoward 2y agoFor most businesses the answer is simple and obvious: don’t ever use OpenAI because they force you to implicitly agree never to train on your logs Not to be all “this idea is 2000 years old” but the idea to neglect externals is 2000 years old and we really ought to beware getting hooked on external intelligence
- cokeandpepsi 2y ago[dead]
- gdiamos 2y agoIf it isn’t already obvious - hardware to run these models is the moat
- leoh 2y agoThe fascinating thing here that I think caught many of us by surprise— and certainly myself — is realizing that building capable LLMs so far is essentially elastic with respect to capital. I don’t think this was immediately obvious when OpenAI first launched ChatGPT. I also don’t think this is true in general for software (though there are other cases).
- RevEng 2y agoThat simply means money and that's easy to come by. Proprietary technologies, good will, brand name recognition - those are things that are hard to replicate. If all it takes is buying enough GPUs then there is little preventing a competitor from simply buying their way in to the market.
- singularity2001 2y agowhen Apple studio comes with a one terabyte integrated ram option the hardware to run even the best llama model will become widely available. For now we are stuck with a medium llama model which is still surprisingly good
- bbstats 2y agoWhat is OpenAI? Some sort of Claude competitor?
- bilsbie 2y agoOffshoot question but what’s my best free option to upload a 40 page pdf and ask questions? I hit a size limit on Claude.
- Squarex 2y agoaistudio.google.com by far. It would handle 10000 pages for free or even more with it’s 2M context window.
- manishsharan 2y agoGemini Advanced seems very promising with 1 Million token context window. https://one.google.com/explore-plan/gemini-advanced https://one.google.com/explore-plan/gemini-advanced I haven't tried it as I use Claude primarily.
- pbalcer 2y agoI've been using Gemini-1.5-Pro-2M through Poe for creating e-book recaps and just generally interactively jogging my memory about a prior entry of a book in a series when a new one comes out. It's been working surprisingly well, even for very large books.
- Sparkyte 2y agoThe greatest threat to any AI platform is the AI itself. I think people put to much reliance on the information generated and don't test or scrutinize the data provided. Right at this given moment it is much better are correcting grammar like an advanced spell checker, but as long as context is missing or the ability for the AI to visualize the information in a contextualized manner it just is limited to spitting out information it consumes and while that is good enough in most cases it doesn't raise the floor any higher on what companies want it to do which is replace human labor. Also the lack of foresight of giving over a business entirely to AI is also a massive problem as your employees are typically also your customers and largest word of mouth advertisers. I've worked on many products I've self promoted because I was excited for by which my own team and partnered teams worked on. You can't make AI ethusiastic about your products like employees. But don't get me wrong, AI is here for the future and it will help us all achieve our business goals, but for a business to be dependent on AI and campaigning that will only doom it.
- ethanol-brain 2y ago> it is much better are correcting grammar Mmmhm
- anips 2y agoI think there are many layers to this discussion. AI models are already commodity, but, their usage drives the demand for cloud and compute. The big players are Microsoft and Google, and they will win in this race. Microsoft owns 49% of OpenAI already. Google is quietly working on reducing the size of its models. They recently came up with a very small model that outperforms chatGPT 3.5; I have also built a wrapper (as you call it) called opencraftai.com, and for me, its a win if the models improve and get commoditised.
- reportgunner 2y agoSo what's the "threat" ? Is it the people that claim that they are working on things that will be a threat to openai? As usual when AI is the topic it's just people having some claims and author not being able to back it up with anything.