4 ms·

Users can run ChatGPT-like AI with data 'pods', says Tim Berners-Lee

EVa5I7bHFq9mnYK 4y ago
Seems interesting in that you don't have to give some company access to all your search queries in order to use AI assistants, as is the case today.
- aquarium87 4y ago
  I would settle for even speech to text that stays local. Agree, an AI assistant that doesn't enrich google or whoever scoops my queries would be even better.
  - fragmede 4y ago
    OpenAI released the weights for their Whisper model, so you can run high quality speech-to-text, locally, at better than realtime if you have a decent GPU.
    - aquarium87 4y ago
      Very cool. Can I integrate this with Android yet? As the default assistant?
breckenedge 4y ago
This headline brought to you by an offhand comment in an interview.
gigel82 4y ago
Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation.
- EVa5I7bHFq9mnYK 4y ago
  You can probably share that monster server with others.
  - wizeman 4y ago
    You probably don't even need to have the server in your premises. Perhaps the server could be in some datacenter and you, as well as others, could use it remotely via the Internet.
- dragonwriter 4y ago
  > Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation. Well, you don’t need it on all the time, so if you don’t mind having the compute & model in the cloud (and since “data pods” seem to be a concept that TBL is pitching that would likely be implemented in the cloud, just with sharing being granular and white-listed, you probably don’t if you buy into that), you could just spin up an EC2 p4d.24xlarge instance for a little under $0.01/s when needed.
mdmglr 4y ago
I’m having a hard time understanding what this article is trying to convey. I read this as a low quality plug plug for the idea of “pods,” and it’s using the terms ChatGPT and AI to make headlines.
- EVa5I7bHFq9mnYK 4y ago
  I understand it this way that ChatGPT (or Alexa) will run locally and you don't have to send all of your queries to some company for processing. Of course, hardware costs will have to come way down. Or some kind of zero-trust scheme will be developed to send data for processing anonymously, possibly along with some satoshis to make the whole thing economical for computation providers.

Seems interesting in that you don't have to give some company access to all your search queries in order to use AI assistants, as is the case today.

aquarium87 4y ago
I would settle for even speech to text that stays local. Agree, an AI assistant that doesn't enrich google or whoever scoops my queries would be even better.
- fragmede 4y ago
  OpenAI released the weights for their Whisper model, so you can run high quality speech-to-text, locally, at better than realtime if you have a decent GPU.
  - aquarium87 4y ago
    Very cool. Can I integrate this with Android yet? As the default assistant?

breckenedge 4y ago

This headline brought to you by an offhand comment in an interview.

gigel82 4y ago

Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation.

EVa5I7bHFq9mnYK 4y ago
You can probably share that monster server with others.
- wizeman 4y ago
  You probably don't even need to have the server in your premises. Perhaps the server could be in some datacenter and you, as well as others, could use it remotely via the Internet.
dragonwriter 4y ago
> Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation. Well, you don’t need it on all the time, so if you don’t mind having the compute & model in the cloud (and since “data pods” seem to be a concept that TBL is pitching that would likely be implemented in the cloud, just with sharing being granular and white-listed, you probably don’t if you buy into that), you could just spin up an EC2 p4d.24xlarge instance for a little under $0.01/s when needed.

mdmglr 4y ago

I’m having a hard time understanding what this article is trying to convey. I read this as a low quality plug plug for the idea of “pods,” and it’s using the terms ChatGPT and AI to make headlines.

EVa5I7bHFq9mnYK 4y ago
I understand it this way that ChatGPT (or Alexa) will run locally and you don't have to send all of your queries to some company for processing. Of course, hardware costs will have to come way down. Or some kind of zero-trust scheme will be developed to send data for processing anonymously, possibly along with some satoshis to make the whole thing economical for computation providers.