4 ms·

This would require massively more compute than regular pipelines...

• galgia 2y ago
  If your problem is compute, you are already optimizing. This is here for all the steps before you start thinking latency-compute. Not all use cases are made equal.
• plaidfuji 2y ago
  (1) that delta will decrease quickly, and (2) corporations will gladly pay for compute over headcount to maintain fragile data pipelines
  • ekianjo 2y ago
    The price will go down, but LLMs reaching 100% accuracy and reliability is another story. We are nowhere close right now.
  • deleted 2y ago
    [deleted]
  • timr 2y ago
    > (1) that delta will decrease quickly Is your data pipeline o(n^3) in the number of tokens? If not, then no, it won't.