8 ms·

The "magic" moment really hit in this, like you're saying. Watching it happen and being like "this is a new thing". Not only does it respond in basically realti

The "magic" moment really hit in this, like you're saying. Watching it happen and being like "this is a new thing". Not only does it respond in basically realtime, it concocts a _whole response_ back to you as well. It's like asking someone what they think about chairs, and then that person being able to then respond to you with a verbatim book on the encyclopedia of chairs. Insane. I'm also incredibly excited about the possibility of this as an always available coding rubber duck. The multimodal demos they showed really drove this home, how collaboration with the model can basically be as seamless as screensharing with someone else. Incredible.

iAMkenough 2y ago
I wonder how long until we see a product that's able to record workstation displays and provide a conversational analysis of work conducted that day by all of your employees.
- heed 2y ago
  gpt-4o can at least summarize short meetings: https://x.com/gdb/status/1790164084425646481?s=46&t=8sSeDIGvOhkrF99aMHKoFg https://x.com/gdb/status/1790164084425646481?s=46&t=8sSeDIGv...
  - bombcar 2y ago
    Zoom offers something like this, but it's really obviously geared toward a certain kind of meeting and has difficulty with anything else.
- dyauspitr 2y ago
  How did my direct reports do today? They did fuck all, especially the ginger.
- deleted 2y ago
  [deleted]
- iforgotpassword 2y ago
  Or comment on your coding in realtime with a snarky undertone. If you give it access to the entire codebase at the same time that could work pretty well. Maybe even add an option to disable the sarcasm.
  - ianmcgowan 2y ago
    "What's your humor setting, TARS?"
- cco 2y ago
  I believe that company is called Recall.ai
- osigurdson 2y ago
  If it can't summarize into a single scalar value, it would be of little use.
- johannboehme 2y ago
  Thanks god i live in the EU and not in a late stage capitalist hell hole XD
nerdponx 2y ago
As goofy as I personally think this is, it's pretty cool that we're converging on something like C3P0 or Plankton's Computer with nothing more than the entire corpus of the world's information, a bunch of people labeling data, and a big pile of linear algebra.
- apantel 2y ago
  This is why it would be such a mistake to kneecap this process over copyright. The models needs ALL the data.
  - QuiDortDine 2y ago
    Okay so we're all agreed that IP laws don't matter and we can have all of OpenAI's data for free? That's a good deal!
    - __MatrixMan__ 2y ago
      What do you mean "have"?
      - QuiDortDine 2y ago
        Is this a trick question? OpenAI blatantly used copyrighted works for commercial purposes without paying the IP owners, it would only be fair to have them publish the resulting code/weights/whatever without expecting compensation. (I don't want to publish it myself, of course, just transform it and sell the result as a service!) I know this won't happen, of course, I am moreso hoping for laws to be updated to avoid similar kerfuffles in the future, as well as massive fines to act as a deterrent, but I don't dare to hope too much.
        seanmcdirmid 2y ago
        This is alleged, and it is very likely that claimants like New York Times accidentally prompt injected their own material to show the violation (not understanding how LLMs really work), and clouded in the hope of a big pay day rather than actual justice/fairness etc... Anyways, the laws are mature enough for everyone to work this out in court. Maybe it comes out that they have a legitimate concern, but the way they presented their evidence so far in public has seriously been lacking.
baq 2y ago
Still patiently waiting for the true magic moment where I don't have to chat with the computer, I just tell it what to do and it does it without even an 'OK'. I don't want to chat with computers to do basic things. I only want to chat with computers when the goal is to iterate on something. If the computer is too dumb to understand the request and needs to initiate iteration, I want no part. (See also 'The Expanse' for how sci-fi imagined this properly.)
- lannisterstark 2y ago
  We'll get there. For me, this is seriously impressive, and I already use LLMs everyday - but a serious "Now we're talkin" moment would be when I'd be able to stand outside of Lowes, and talk to my glasses/earbuds "Hey, I'm in front of lowes, where do I get my air filters from?" and it tells me if it's in stock, aisle and bay number. (If you can't tell, I am tired from fiddling with apps lol)
  - yakz 2y ago
    Lowes wants you to look at the ads in the app. I would guess that most companies will not want to provide APIs that an agent could use to make that kind of query. So, the agent is going to have to use the app just like you would, which looks like it will definitely become possible, but again, Lowes wants the human to see the ads. So they're going to try to break the automation. It's going to take customers demanding (w/$) this kind of functionality and it will probably still take a long time as the companies will probably do whatever they can to maintain (or extend) control.
    - marcosdumay 2y ago
      Do they want a better ad than what the GP was describing? There isn't one they can buy. (But yeah, I guess they will want it, and break any reasonable utility from their stores on the process. That's what everybody does today, I'm not holding my breath for management to grow some competence out of nowhere in the future.)
    - prossercj 2y ago

iAMkenough 2y ago

I wonder how long until we see a product that's able to record workstation displays and provide a conversational analysis of work conducted that day by all of your employees.

heed 2y ago
gpt-4o can at least summarize short meetings: https://x.com/gdb/status/1790164084425646481?s=46&t=8sSeDIGvOhkrF99aMHKoFg https://x.com/gdb/status/1790164084425646481?s=46&t=8sSeDIGv...
- bombcar 2y ago
  Zoom offers something like this, but it's really obviously geared toward a certain kind of meeting and has difficulty with anything else.
dyauspitr 2y ago
How did my direct reports do today? They did fuck all, especially the ginger.
deleted 2y ago
[deleted]
iforgotpassword 2y ago
Or comment on your coding in realtime with a snarky undertone. If you give it access to the entire codebase at the same time that could work pretty well. Maybe even add an option to disable the sarcasm.
- ianmcgowan 2y ago
  "What's your humor setting, TARS?"
cco 2y ago
I believe that company is called Recall.ai
osigurdson 2y ago
If it can't summarize into a single scalar value, it would be of little use.
johannboehme 2y ago
Thanks god i live in the EU and not in a late stage capitalist hell hole XD

nerdponx 2y ago

As goofy as I personally think this is, it's pretty cool that we're converging on something like C3P0 or Plankton's Computer with nothing more than the entire corpus of the world's information, a bunch of people labeling data, and a big pile of linear algebra.

apantel 2y ago
This is why it would be such a mistake to kneecap this process over copyright. The models needs ALL the data.
- QuiDortDine 2y ago
  Okay so we're all agreed that IP laws don't matter and we can have all of OpenAI's data for free? That's a good deal!
  - __MatrixMan__ 2y ago
    What do you mean "have"?
    - QuiDortDine 2y ago
      Is this a trick question? OpenAI blatantly used copyrighted works for commercial purposes without paying the IP owners, it would only be fair to have them publish the resulting code/weights/whatever without expecting compensation. (I don't want to publish it myself, of course, just transform it and sell the result as a service!) I know this won't happen, of course, I am moreso hoping for laws to be updated to avoid similar kerfuffles in the future, as well as massive fines to act as a deterrent, but I don't dare to hope too much.
      - seanmcdirmid 2y ago
        This is alleged, and it is very likely that claimants like New York Times accidentally prompt injected their own material to show the violation (not understanding how LLMs really work), and clouded in the hope of a big pay day rather than actual justice/fairness etc... Anyways, the laws are mature enough for everyone to work this out in court. Maybe it comes out that they have a legitimate concern, but the way they presented their evidence so far in public has seriously been lacking.

baq 2y ago

Still patiently waiting for the true magic moment where I don't have to chat with the computer, I just tell it what to do and it does it without even an 'OK'. I don't want to chat with computers to do basic things. I only want to chat with computers when the goal is to iterate on something. If the computer is too dumb to understand the request and needs to initiate iteration, I want no part. (See also 'The Expanse' for how sci-fi imagined this properly.)

lannisterstark 2y ago
We'll get there. For me, this is seriously impressive, and I already use LLMs everyday - but a serious "Now we're talkin" moment would be when I'd be able to stand outside of Lowes, and talk to my glasses/earbuds "Hey, I'm in front of lowes, where do I get my air filters from?" and it tells me if it's in stock, aisle and bay number. (If you can't tell, I am tired from fiddling with apps lol)
- yakz 2y ago
  Lowes wants you to look at the ads in the app. I would guess that most companies will not want to provide APIs that an agent could use to make that kind of query. So, the agent is going to have to use the app just like you would, which looks like it will definitely become possible, but again, Lowes wants the human to see the ads. So they're going to try to break the automation. It's going to take customers demanding (w/$) this kind of functionality and it will probably still take a long time as the companies will probably do whatever they can to maintain (or extend) control.
  - marcosdumay 2y ago
    Do they want a better ad than what the GP was describing? There isn't one they can buy. (But yeah, I guess they will want it, and break any reasonable utility from their stores on the process. That's what everybody does today, I'm not holding my breath for management to grow some competence out of nowhere in the future.)
  - prossercj 2y ago