4 ms·

I'd assume they meant self-hosted inference.

• deleted 4mo ago
  [deleted]
• thayne 4mo ago
  Ohhhh... Yeah that makes sense. There's still the possibility of some form of ads getting embedded in local models, or biases that favor certain sponsored content, which is one reason why having more than just the weights open is important. But that's probably a less immediate threat.