4 ms·

I really wonder how the economics of running chatgpt for Bing's request will work. GPT is anything but cheap to run, IIRC, it requires more than four A100 GPU c

by wut42 4y ago

I really wonder how the economics of running chatgpt for Bing's request will work. GPT is anything but cheap to run, IIRC, it requires more than four A100 GPU cards.

rapsey 4y ago
The bill is already largely footed by MS probably. OpenAI and MS are a partnership and they run on azure cloud.
- wut42 4y ago
  Of course- it makes sense to run ChatGPT free now (reminded that it's an experiment) for training & betatesting. But running it even larger, and on a search engine ? It's a magnitude of difference imo, and totally different than a short-time bill for an experiment.
  - waynesonfire 4y ago
    Who gives a shit how much it costs. The value is massive and 10x better than Google results. Are you comprehending what that means? After competing with Google for over 10 years with nothing to show for it, Microsoft is drooling over this technology.
    - coredog64 4y ago
      There’s a very old story about Microsoft and Win 3.x pen computing. One of the leads was explaining that they worked on it, and someone else opined that it was too bad that they didn’t provide anything useful for MS. The lead replied that the goal wasn’t actually pen computing, it was a special teams “block that kick” play that kneecapped a competitor and so achieved its goal. If MS can reduce the absolute firehose of money that ads provide to Google, it will totally be worth it even if it takes lighting money on fire to do it.
  - kyleyeats 4y ago
    They could go after the really expensive keywords and do stuff there. I'm just not sure how they'd make more money from that stuff.
- eternalban 4y ago
  I asked ChatGPT to emulate various OS's, including Linux and DOS. On a linux emulation, I had it curl whatsmyip.com. This bit was in the response: <span id="ipv4">35.230.98.61</span> That's a google property. I wonder if it was trained on google's cloud.
  - blep_ 4y ago
    Or, more likely, it made up a plausible IP address.
    - eternalban 4y ago
      The curls have returned two distinct IPs. Both are google's. How probable is that for a plausible guess? Run the experiment yourself. There was an article a while back that shows the prompt preamble to get you going. See what you get.
      - rapsey 4y ago
        ChatGPT does not actually execute commands. The IP is in some text dataset and it returned that.
        eternalban 4y ago
        “ .. trained on .. “ ^ ["Overall, the specific details of the dataset used to train GPT-3 are not publicly disclosed, so it is not possible to say for certain whether interactive sessions by trainers were used in its creation." - the horse's mouth]
        wut42 4y ago
        As I just said elsewhere it's not going to "run curl commands" in training time. it's trained on a corpus of public data, it's not running commands at all
  - wut42 4y ago

by wut42 4y ago

I really wonder how the economics of running chatgpt for Bing's request will work. GPT is anything but cheap to run, IIRC, it requires more than four A100 GPU cards.

rapsey 4y ago

The bill is already largely footed by MS probably. OpenAI and MS are a partnership and they run on azure cloud.

wut42 4y ago
Of course- it makes sense to run ChatGPT free now (reminded that it's an experiment) for training & betatesting. But running it even larger, and on a search engine ? It's a magnitude of difference imo, and totally different than a short-time bill for an experiment.
- waynesonfire 4y ago
  Who gives a shit how much it costs. The value is massive and 10x better than Google results. Are you comprehending what that means? After competing with Google for over 10 years with nothing to show for it, Microsoft is drooling over this technology.
  - coredog64 4y ago
    There’s a very old story about Microsoft and Win 3.x pen computing. One of the leads was explaining that they worked on it, and someone else opined that it was too bad that they didn’t provide anything useful for MS. The lead replied that the goal wasn’t actually pen computing, it was a special teams “block that kick” play that kneecapped a competitor and so achieved its goal. If MS can reduce the absolute firehose of money that ads provide to Google, it will totally be worth it even if it takes lighting money on fire to do it.
- kyleyeats 4y ago
  They could go after the really expensive keywords and do stuff there. I'm just not sure how they'd make more money from that stuff.
eternalban 4y ago
I asked ChatGPT to emulate various OS's, including Linux and DOS. On a linux emulation, I had it curl whatsmyip.com. This bit was in the response: <span id="ipv4">35.230.98.61</span> That's a google property. I wonder if it was trained on google's cloud.
- blep_ 4y ago
  Or, more likely, it made up a plausible IP address.
  - eternalban 4y ago
    The curls have returned two distinct IPs. Both are google's. How probable is that for a plausible guess? Run the experiment yourself. There was an article a while back that shows the prompt preamble to get you going. See what you get.
    - rapsey 4y ago
      ChatGPT does not actually execute commands. The IP is in some text dataset and it returned that.
      - eternalban 4y ago
        “ .. trained on .. “ ^ ["Overall, the specific details of the dataset used to train GPT-3 are not publicly disclosed, so it is not possible to say for certain whether interactive sessions by trainers were used in its creation." - the horse's mouth]
        wut42 4y ago
        As I just said elsewhere it's not going to "run curl commands" in training time. it's trained on a corpus of public data, it's not running commands at all
- wut42 4y ago