3 ms·

I can see hype go through the roof again if someone like OpenAI delivers a model that is as big of a leap as GPT3 to GPT4. Other LLMs have caught up to GPT4, bu

I can see hype go through the roof again if someone like OpenAI delivers a model that is as big of a leap as GPT3 to GPT4. Other LLMs have caught up to GPT4, but surely OpenAI has been using the 2 year lead they had and readying GPT5? There are two AI developments that I'm quite excited for: 1. Very large foundational models (such as GPT5-level LLMs) 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs I think 2024 has been the year for #2, which is why the hype has died down a little. No splash big models that shock the world and make white collar workers shiver. But #2 is crucial to actually deploying LLMs to the masses.

helloworld42024 2y ago
This is spot on.
nuz 2y ago
~3 years since gpt-4 was finished training in 2021
- throw310822 2y ago
  GPT-4 was released in March 2023, one and a half years ago (I point that out because it feels like a different era). Not sure when they finished training it but I'm pretty sure it has nothing to do with (and it's in fact much later than) the training data cutoff, which was in September 2021.
undbfhd 2y ago
> There are two AI developments that I'm quite excited for What about these things excite you? Just the tech hubris of growth at all costs or the hope of some use case that has yet to manifest? > 1. Very large foundational models (such as GPT5-level LLMs) Has work been announced on or a release date been set for a GPT5 or are you just excited it might happen? Why stop there? Go ahead, be excited about MilleniumGPT. Is there evidence that bigger is better forever? > 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs To do what exactly? Write fan letters to olympians for me? Replace all of the real human friendships in my life? To write an annoyingly verbose email from a bullet list that the recipient will be loathe to read and so will feed it into another agent to turn the email back into the same bullet list?
- aurareturn 2y ago
  > What about these things excite you? That they will annoy the hell out of you. ;)
  - undbfhd 2y ago
    [flagged]

helloworld42024 2y ago

This is spot on.

nuz 2y ago

~3 years since gpt-4 was finished training in 2021

throw310822 2y ago
GPT-4 was released in March 2023, one and a half years ago (I point that out because it feels like a different era). Not sure when they finished training it but I'm pretty sure it has nothing to do with (and it's in fact much later than) the training data cutoff, which was in September 2021.

undbfhd 2y ago

> There are two AI developments that I'm quite excited for What about these things excite you? Just the tech hubris of growth at all costs or the hope of some use case that has yet to manifest? > 1. Very large foundational models (such as GPT5-level LLMs) Has work been announced on or a release date been set for a GPT5 or are you just excited it might happen? Why stop there? Go ahead, be excited about MilleniumGPT. Is there evidence that bigger is better forever? > 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs To do what exactly? Write fan letters to olympians for me? Replace all of the real human friendships in my life? To write an annoyingly verbose email from a bullet list that the recipient will be loathe to read and so will feed it into another agent to turn the email back into the same bullet list?

aurareturn 2y ago
> What about these things excite you? That they will annoy the hell out of you. ;)
- undbfhd 2y ago
  [flagged]