4 ms·
Not a joke and not everybody is jumping on "AI via API calls", luckily. As more models are released, it becomes possible to integrate directly in some stacks (
by thibaut_barrere 3y ago
Not a joke and not everybody is jumping on "AI via API calls", luckily.
As more models are released, it becomes possible to integrate directly in some stacks (such as Elixir) without "direct" third-party reliance (except you still depend on a model, of course).
For instance, see:
- https://www.youtube.com/watch?v=HK38-HIK6NA https://www.youtube.com/watch?v=HK38-HIK6NA (in "LiveBook", but the same code would go inside an app, in a way that is quite easy to adapt)
- https://news.livebook.dev/speech-to-text-with-whisper-timestamping-streaming-and-parallelism-oh-my---launch-week-2---day-2-36osSY https://news.livebook.dev/speech-to-text-with-whisper-timest... for the companion blog post
I have already seen more than a few people running SaaS app on twitter complaining about AI-downtime :-)
Of course, it will also come with a (maintenance) cost (but like external dependencies), as I described here:
https://twitter.com/thibaut_barrere/status/1722172915733430770 https://twitter.com/thibaut_barrere/status/17221729157334307...
- j45 3y agoThe average world and business user doesn't use an API directly. It can be easy to lose sight of that.
- ctrlmeta 3y agoYes, sooner or later this is going to become the future of GPT in applications. The models are going to be embedded directly within the applications. I'm hoping for more progress in the performance of vectorized computing so that both model training and usage can become cheaper. If that happens, I am hopeful we are going to see a lot of open source models that can embedded into the applications.