3 ms·
Depending on the length of the outage I think this could be a good third party dependency test. Do people chaos monkey test all their third party dependencies?
by LinuxBender 2y ago
Depending on the length of the outage I think this could be a good third party dependency test. Do people chaos monkey test all their third party dependencies? e.g. block them for a day? Will schools notice?
- anonzzzies 2y agoWe switch between claude and chatgpt auto (with a preference for claude when it's up), so we don't notice anything. Hopefully llama or so will be good enough some day, so we can just spin up a Vast machine when both are down or run off a local machine entirely.
- LinuxBender 2y agoThat's cool. I was not aware they had reached response parity yet. So in this case everyone would just need to do the same thing you did and have automatic failover to multiple providers. I guess that makes it a mostly non issue for businesses.
- anonzzzies 2y agoWe made a lot of tooling around llms for years now, so they don't need to have responsive parity exactly to be switchable for what we use them for. No other models work yet though: we sometimes try, with very varying results; definitely not ready for prime time.
- paxys 2y agoHow do all the ChatGPT wrappers plan for ChatGPT being down?