3 ms·

How is this different than Google/WA today?

by sebzim4500 4y ago

no_time 4y ago
I can't speak for WA, but Google doesn't have my phone number, or any other PII. OpenAI does.
- Tepix 4y ago
  So, none of your friends have shared their phonebooks with Google?
  - no_time 4y ago
    Touché. GOOG probably does in fact, have my phone number through this vector. What I mean is that they probably have a hard(er) time assigning this identifier to my activity.
layer8 4y ago
The data you enter in Google Search is much more limited (at least it is for me). None of the other Google services are essential. (Google Search isn’t essential as well, but it’s a distinctive kind of service in that it isn’t practical to self-host.) With “WA” I guess you mean WhatsApp. For messaging, E2E encryption is now standard, which is not possible for AI services (barring huge breakthroughs in homomorphic encryption). In addition, it’s easy to self-host messaging solutions without losing out on features much.
- sebzim4500 4y ago
  Sorry, I should have specified WA means Wolfram Alpha. >barring huge breakthroughs in homomorphic encryption Actually this seems plausible to me without having to use those general purpose algorithms that cause a 1000000000x slowdown. For example, you can obscure the input to each matrix multiplication by shifting the input and outputs by a predetermined (user specific) constant. Maybe there are similar tricks for cross attention, although that might be a bit optimistic. Certainly you can do some amount of obfuscation by permuting the inputs, but I doubt that would achieve much.
  - layer8 4y ago
    I’m pretty sure your query will effectively still be derivable on the server side, as it has to syntactically/semantically interact with the model. To truly disguise it, at least part of the model/weights would have to be transferred to the client side (so that the server doesn’t learn the adjustment), which would in turn leak the model.
moshun 4y ago
It isn’t, this is literally the Google / Meta business model.

How is this different than Google/WA today?

no_time 4y ago

I can't speak for WA, but Google doesn't have my phone number, or any other PII. OpenAI does.

Tepix 4y ago
So, none of your friends have shared their phonebooks with Google?
- no_time 4y ago
  Touché. GOOG probably does in fact, have my phone number through this vector. What I mean is that they probably have a hard(er) time assigning this identifier to my activity.

layer8 4y ago

The data you enter in Google Search is much more limited (at least it is for me). None of the other Google services are essential. (Google Search isn’t essential as well, but it’s a distinctive kind of service in that it isn’t practical to self-host.) With “WA” I guess you mean WhatsApp. For messaging, E2E encryption is now standard, which is not possible for AI services (barring huge breakthroughs in homomorphic encryption). In addition, it’s easy to self-host messaging solutions without losing out on features much.

sebzim4500 4y ago
Sorry, I should have specified WA means Wolfram Alpha. >barring huge breakthroughs in homomorphic encryption Actually this seems plausible to me without having to use those general purpose algorithms that cause a 1000000000x slowdown. For example, you can obscure the input to each matrix multiplication by shifting the input and outputs by a predetermined (user specific) constant. Maybe there are similar tricks for cross attention, although that might be a bit optimistic. Certainly you can do some amount of obfuscation by permuting the inputs, but I doubt that would achieve much.
- layer8 4y ago
  I’m pretty sure your query will effectively still be derivable on the server side, as it has to syntactically/semantically interact with the model. To truly disguise it, at least part of the model/weights would have to be transferred to the client side (so that the server doesn’t learn the adjustment), which would in turn leak the model.

moshun 4y ago

It isn’t, this is literally the Google / Meta business model.