3 ms·

We can already do that. But why give away the keys to a money machine?

giancarlostoro 3y ago
So you can fit all of ChatGPT into a 32GB storage phone? Because my understanding is something like ChatGPT takes terrabytes upon terrabytes of data on-disk and I can't imagine how many servers being piped together to make it churn out coherent sentences... I'm on about all of that on a phone that doesn't cost thousands of dollars. It would mean we have finally reached significant technological advances.
- brianwawok 3y ago
  Okay this is called a moving goalpost. This was my response to > If I can use your AI completely offline on my device on a spaceship orbiting Pluto And the answer was yes. I do not know the exact system requirement of the current ChatGPT, but I am fairly confident 1) ChatGPT no network mode could fit in a half of a server rack, maybe way less. 2) You can fit half a server work on a spaceship that can go to Pluto. My guess is it's more like 1 server worth. Google tells me GPT3 was 1TB which is a very small laptop.
  - giancarlostoro 3y ago
    Is it moving a goal post if I'm just going off on a tangent from one simple remark? I'm just going on a tangent of something I find fascinating as a thought experiment, what will things look like when we can have isolated AIs in our pockets without needing connectivity? The reason I want this is because you could leave your house for a long roadtrip, and have an AI companion that never loses a step. Imagine if your AI had every road memorized and nuances about them, so if GPS signal dies, you can still keep going. Sidenote, ChatGPT uses tens of thousands of GPUs to run its architecture, I think it'll take a little more than just some laptop. Thank you for answering though :) I do think its an invaluable goal to have off-line first AI.
    - brianwawok 3y ago
      I think you are not super familiar with how AI works. It's worth reading up on. For example - The Tesla self driving AI takes many hundreds (thousands?) of computers to build the model. Then it runs in realtime of 1 "GPU" that lives in my car. It's not sending frames in realtime to a supercomputer to process. So for a spaceship - same thing. You don't need to send the thing that makes the model. You just send a finished model and a GPU to run it.

So you can fit all of ChatGPT into a 32GB storage phone? Because my understanding is something like ChatGPT takes terrabytes upon terrabytes of data on-disk and I can't imagine how many servers being piped together to make it churn out coherent sentences... I'm on about all of that on a phone that doesn't cost thousands of dollars. It would mean we have finally reached significant technological advances.

brianwawok 3y ago
Okay this is called a moving goalpost. This was my response to > If I can use your AI completely offline on my device on a spaceship orbiting Pluto And the answer was yes. I do not know the exact system requirement of the current ChatGPT, but I am fairly confident 1) ChatGPT no network mode could fit in a half of a server rack, maybe way less. 2) You can fit half a server work on a spaceship that can go to Pluto. My guess is it's more like 1 server worth. Google tells me GPT3 was 1TB which is a very small laptop.
- giancarlostoro 3y ago
  Is it moving a goal post if I'm just going off on a tangent from one simple remark? I'm just going on a tangent of something I find fascinating as a thought experiment, what will things look like when we can have isolated AIs in our pockets without needing connectivity? The reason I want this is because you could leave your house for a long roadtrip, and have an AI companion that never loses a step. Imagine if your AI had every road memorized and nuances about them, so if GPS signal dies, you can still keep going. Sidenote, ChatGPT uses tens of thousands of GPUs to run its architecture, I think it'll take a little more than just some laptop. Thank you for answering though :) I do think its an invaluable goal to have off-line first AI.
  - brianwawok 3y ago
    I think you are not super familiar with how AI works. It's worth reading up on. For example - The Tesla self driving AI takes many hundreds (thousands?) of computers to build the model. Then it runs in realtime of 1 "GPU" that lives in my car. It's not sending frames in realtime to a supercomputer to process. So for a spaceship - same thing. You don't need to send the thing that makes the model. You just send a finished model and a GPU to run it.