3 ms·

If we thought websites mining Monera in ads was bad, wait until every site sells its users’ CPU cycles on a gray market for distributed LLM processing!

• asadalt 2y ago
  but that’s not much useful if the model is nano. Webgpu would be a better point of misuse maybe
  • btown 2y ago
    The latency to download all the weights would be a limiting factor on WebGPU. But if the weights are already downloaded and optimized locally…