11 ms·
GPT-4 is coming next week – and it will be multimodal, says Microsoft Germany
- oidar 4y ago> Kenn explained what multimodal AI is about, which can translate text not only accordingly into images, but also into music and video. Interesting that they are broadening instead of deepening the text side of GPT - maybe they are running into problems on that side and are building the feature set with low hanging fruit on adjacent areas.
- xen2xen1 4y agoOr it matches their search needs?
- thatguyman 4y agoit is interesting. i believe they may be hitting a wall as well
- flangola7 4y agoA paper from a week ago found that models trained on multiple data modes perform an order of magnitude better than text-only models of the same or even larger size.
- dwallin 4y agoCan you share a link to this paper?
- gwoolhurme 4y agoGenuinely curious, what does it mean in this context to perform better? (hopefully that doesn't come across as snarky as text sometimes does).
- jerrygenser 4y agoSome of these large models are able to do zero shot learning and perform tasks they weren't explicitly trained on since the training objective is very general. Being able to perform more advanced types of zero shot learning tasks would be comparable and further the accuracy on those tasks can be evaluated
- dmix 4y agoAny chance this could improve coding LLMs like Co-pilot? Or would that sort of thing be limited to source code feeds (not that Github has a shortage).
- refulgentis 4y agoThe next big step for coding LLMs will be context window increases, leaked docs have OpenAI pricing for up to 16K I believe, 4x the current maximum. Now you're talking "write a class" instead of this line and maybe sometimes a method
- williamcotton 4y agoIt can already reliably write a todo web browser application. With 16k and some other techniques, I’m guessing it could write a custom CMS database backed web application.
- flangola7 4y agoNot 16k, 32k. 8x the current window.
- refulgentis 4y agoNice
- dmix 4y agoWhat is 16k referring to here
- eob 4y agoI figure it’s a stand-in for embodiment.
- fiso64 4y agoAre you referring to PALM-E? It didn't have any positive transfer for NLP tasks, in fact the unfrozen model performed slightly worse after the finetune. That being said, PALM-E wasn't really a multimodal model from the start, it's still basically just a text model with a visual one glued on top. Whether a truly multimodal model will be better at reasoning and data efficiency is still an open question though.
- lumost 4y agoThere is substantial evidence that cross training on multiple tasks improves performance. ChatGPT struggles with intuition about the world, if it has image/video knowledge than it can potentially reason about what happens when you flip a plate upside down.
- mortenjorck 4y agoI wonder if there’s any reason this wouldn’t also apply in reverse: could a corpus of textual training data from which the role of a hand can be derived (including the fact that it naturally has five fingers) help DALL-E reliably render hands correctly?
- lumost 4y agoAlmost certainly. There is a vast corpus of text which references hands and what they are used for. Likewise there is a vast corpus of images which include hands. A sufficiently advanced statistical model can infer that any image with 6 fingers is a fabrication provided that it has learned how to classify fingers and has enough linguistic knowledge. Contrast this situation with a primarily image based model which will struggle to differentiate what situations detailed hands appear in compared with a patterned rug. There is an interesting “takeoff” point where models are able to generate enough “interesting” data to train themselves. Asking chatGPT for ml training data on various tasks makes me think we are close to that inflection point.
- noah_buddy 4y agoCan’t wait for AI to tell people with atypical bodies that they don’t exist.
- lumost 4y agoDefinitely a bias, chatGPT will likely believe that only individuals with figures similar to models are real.
- IIAOPSW 4y ago
- inconceivable 4y agoi think it's likely that they hired a diversified AI team with expertise in multiple areas and they're all working on their own areas. parallel efforts.
- fizx 4y agoThere's no more text to train on. Also, amazingly, transfer learning works better than anyone could have hoped! As an analogy, imagine that you could show that football players learned musical instruments 50% quicker than non-athletes. That would be amazing! But LLMs can write music and training them on music makes them better writers. It's almost like intelligence & skills are completely general!
- CuriouslyC 4y agoThat's just not true. There's no more super cheap data, but there's still probably about 5x the data we are currently feeding these models just waiting to be scanned and OCRd, and most of it is higher quality (if less topical).
- osigurdson 4y agoThe fact that AI requires so much data does make me think that we are somehow on the wrong track. Evolution didn't scan every atom on earth in order to produce a brain. FSD is a good example of this. It is ridiculous to me that we need to show the car videos of every possible situation in order for it to know how to drive.
- MattRix 4y agoIt’s not the wrong track, it’s just very early and specialized. As you get more multi-modal models with better ability to learn/remember on the fly, they will require less and less data to train.
- osigurdson 4y agoI'm pretty sure we will look back and laugh about how this was done in 50 years. No disrespect to anyone working in the area now of course, but I think better, more natural approaches will emerge.
- ihatepython 4y ago> The fact that AI requires so much data does make me think that we are somehow on the wrong track. I know the entire AI industry on the wrong track, but there's nothing that can be done about it. Sometimes you just have to wait for the crash and burn, and then things can change. It's like being at the ocean and trying to stop a wave from crashing after it has already formed, you just have to let it resolve itself of its own volition. As Einstein said, stupidity is infinite.
- highwayman47 4y agoIf this is true, wouldn't it be reported elsewhere? Also, what does this mean: GPT4 is coming to what?
- MichaelMoser123 4y agoOnce GPT-4 has been released, how long would it take OpenAI to start using the new language model in ChatGPT?
- MattRix 4y agoThey might not do it right away if it’s slower and more expensive to run. ChatGPT has undergone a lot of efforts to optimize it.
- theRealMe 4y agoI’d love to read that article, but I don’t speak German and so have no idea how to get rid of that cookie modal.
- Reptur 4y agohttps://webcache.googleusercontent.com/search?q=cache:janNffeNIwAJ:https://www.heise.de/news/GPT-4-is-coming-next-week-and-it-will-be-multimodal-says-Microsoft-Germany-7540972.html&cd=1&hl=en&ct=clnk&gl=us https://webcache.googleusercontent.com/search?q=cache:janNff...
- bhaney 4y agoThankfully your ad-blocker's element hider should still use your system language!
- djmips 4y agoI don't read German and it wouldn't let me ablehnen (reject) so eventually my only choice was zustimmen (agree). oh well.
- est 4y agoYou can ask New Bing to summarize it for ya.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- etaioinshrdlu 4y agoOpenAI is doing an amazing job fueling hype and intrigue. It is hard to separate what is real and what is imagined. Previously, I heard that Bing Chat was based on GPT4. Is this true or not? Is it publicly known, or not? Certainly the model is far more powerful than what is in ChatGPT. If Bing is GPT4, did they remove its multimodal capabilities? If Bing is not GPT4, what is it? Does there exist a GPT3.5-mega with vastly improved reasoning capabilities and larger context windows? I find the current moment in tech quite confusing.
- htrp 4y agogpt3 is referred to as davinci-003 chatgpt is what they call got3.5-turbo-0301 (current month checkpoint) bingGPT is a allegedly finetuned version of gpt3.5 turbo that is better with search results.... microsoft internally calls it prometheus. You may also hear it referred to as Sydney. i suspect GPT4 is just a bad translation
- famouswaffles 4y agobing is definitely not just a finetuned turbo. and microsoft have said as much.
- MattRix 4y agominor correction: The original davinci is GPT 3 but davinci-003 is GPT 3.5
- irthomasthomas 4y ago>chatgpt is what they call got3.5-turbo-0301 (current month checkpoint) Then why does the chatgpt endpoint show as text-davinci-002-render-sha? It's very confusing.
- htrp 4y agoNo clue... I'm just looking at the developer docs (which I assume OpenAI isn't lying about) > ChatGPT is powered by gpt-3.5-turbo, OpenAI’s most advanced language model. https://platform.openai.com/docs/guides/chat https://platform.openai.com/docs/guides/chat
- woeirua 4y agoIf even half of what we're hearing about GPT 4 comes to fruition then we're going to know in the next year or two tops if the scaling hypothesis is true or not. If it's true, then we're going to have something very similar to the Star Trek computer by the end of the decade at the latest. If it's false, then we're probably going to enter another AI winter this decade.
- smy20011 4y ago2 AI winter so far!
- siva7 4y agoAI winter isn't an issue anymore and won't be - the breakthrough in public perception already happened for its first time at this scale.
- russdill 4y agoI am curious if AI is successful if an AI backlash is coming. Perhaps one of the existing political parties or a new political party taking up the mantle of regulating or outright banning of AI. Or even just attacks on AI researchers and institutions.
- ethanbond 4y agoI mean… the fear/goal of AI success, depending on who you ask, is social and economic upheaval. I suspect there will be a lot of resistance as it “succeeds.”
- russdill 4y agoCould make "AI revolution" take on an entirely different meaning
- pksebben 4y agoit's already happening. Stable diffusion forums regularly get brigaded, and there are lawsuits in the works against stability ai and midjourney. Those lawsuits are nominally about copyright, but one gets the sense that it's really about putting the breaks on developing the tech. I kind of get it, too. If I made my money making art this would scare me. What I wonder is what's gonna happen when it's [ artists, accountants, copywriters, bloggers, designers, programmers, etc, etc, etc]. I see problems coming.
- nl 4y agoI don't really get the obsession with if the MS models is some variant of GPT-3.5 vs GPT-4. It's just a version number, and there aren't really meaningful reasons why something is a 0.5 increment vs a 1.0 release increment, other than "there are lots of changes" where lots ~= something.
- chessgecko 4y agoThe gap in quality between gpt2 and gpt3 was much much larger than the gap between gpt3 and 3.5. If they could get the gap between 2 -> 3 again when moving to 4 it would be crazy
- deleted 4y ago[deleted]
- MattRix 4y agoIt is a big deal because the major version numbers usually represent a new model trained from scratch, vs just a base model that has been given extra training (which is what happened from GPT 3.0 -> 3.5)
- nl 4y agoInstructGPT (which ChatGPT/GPT-3.5) is based on was trained from scratch: > We train three model sizes (1.3B, 6B, and 175B parameters)[1] It does use the same model architecture as GPT-3 though so I guess there is a bit of reasoning there maybe. [1] https://arxiv.org/pdf/2203.02155.pdf https://arxiv.org/pdf/2203.02155.pdf
- justanotheratom 4y agoI call bs
- bob1029 4y agoIn the leaked openai foundry pricing there is a davinci 32k model. I wonder if this is effectively GPT4. 32K tokens is a lot of context.
- musicale 4y agoOld news, I'm already on GPT-6.