3 ms·
Okay this is called a moving goalpost. This was my response to > If I can use your AI completely offline on my device on a spaceship orbiting Pluto And the an
by brianwawok 3y ago
Okay this is called a moving goalpost. This was my response to
> If I can use your AI completely offline on my device on a spaceship orbiting Pluto
And the answer was yes. I do not know the exact system requirement of the current ChatGPT, but I am fairly confident
1) ChatGPT no network mode could fit in a half of a server rack, maybe way less.
2) You can fit half a server work on a spaceship that can go to Pluto.
My guess is it's more like 1 server worth. Google tells me GPT3 was 1TB which is a very small laptop.
- giancarlostoro 3y agoIs it moving a goal post if I'm just going off on a tangent from one simple remark? I'm just going on a tangent of something I find fascinating as a thought experiment, what will things look like when we can have isolated AIs in our pockets without needing connectivity? The reason I want this is because you could leave your house for a long roadtrip, and have an AI companion that never loses a step. Imagine if your AI had every road memorized and nuances about them, so if GPS signal dies, you can still keep going. Sidenote, ChatGPT uses tens of thousands of GPUs to run its architecture, I think it'll take a little more than just some laptop. Thank you for answering though :) I do think its an invaluable goal to have off-line first AI.
- brianwawok 3y agoI think you are not super familiar with how AI works. It's worth reading up on. For example - The Tesla self driving AI takes many hundreds (thousands?) of computers to build the model. Then it runs in realtime of 1 "GPU" that lives in my car. It's not sending frames in realtime to a supercomputer to process. So for a spaceship - same thing. You don't need to send the thing that makes the model. You just send a finished model and a GPU to run it.