3 ms·

It's looking like running your own mini ecosystem is the way of the future to me. No data centers, just a decent GPU 16-24gb of VRAM, CPU, and 32gb of RAM.

• Lalabadie 6mo ago
  This is Apple's bet, among others. Training purpose-specific miniature models lets you have a lot of tasks you can run with high confidence on consumer hardware.
  • twoodfin 6mo ago
    Or on a commodity EC2 instance with a relatively cheap inference sidecar.