3 ms·
I think the parent is saying that one should be aware that the whole LLM industry is still in an experimental stage and far from mature. What you want isn’t wha
by layer8 7mo ago
I think the parent is saying that one should be aware that the whole LLM industry is still in an experimental stage and far from mature. What you want isn’t what’s being offered. I agree that there should be higher standards, but what we currently have is an arms race. The consequence is to factor that into the value proposition and maybe not rely too much on it.
- Ucalegon 7mo agoSLAs should be standard for any paid service, especially on the enterprise side, but also on the consumer side. Being immature as a company does not excuse a lack of service delivery.
- otterley 7mo agoNot every customer, even a paying customer, demands reliability at a particular level. Market segmentation tends to address those situations: pay more, get more.
- Ucalegon 7mo ago'I don't want to hold companies to account for failing to deliver services, therefore I think everyone else should live by my permissive "standards".'
- otterley 7mo agoThey can be held to account when they fail to deliver what they promise! But what is promised for delivery is what's in the Terms of Service (i.e. the agreement). Nothing more. If it's not in there, you can't hold them to account for it.
- Dylan16807 7mo agoYes, that's the problem. It's too easy for companies to fail to provide their service as long as they never promise to provide their service.
- otterley 7mo ago> It's too easy for companies to fail to provide their service as long as they never promise to provide their service. I don't even know what this means. You can't make anyone work for free, nor dictate the terms of what kind of work someone will do without their consent. I assume you are not pro-slavery.
- Dylan16807 7mo agoI'll make a very simple example. The service at mcdonald's is providing food for money. When their ice cream machine is broken, they fail to provide part of their service. I'm not saying anything about "making" them do anything. I'm just calling out their failure and saying it's a bad thing.
- otterley 7mo agoYou didn't merely call out their failure. You said it was "too easy," implying something more, like they owe you something. It's a pretty entitled point of view.
- Dylan16807 7mo agoI don't think it's "entitled" to want companies to put some effort into avoiding those failures. If the government did something, we could think of it as similar to passing inspection. The other way to look at things is that the market isn't varied and competitive enough to punish the companies that fail this way. They don't have to "owe me" anything for me to desire a different balance. My desire is fine.
- otterley 7mo ago"[W]ant[ing] companies to put some effort into avoiding ... failures" is not the same as "hold[ing] them to account". The former is "this sucks and I don't like it." The latter is "punish them or force them to do what I want!"--i.e., some sort of legal remedy.
- visarga 7mo ago> pay more, get more Users on $200 plan complaining, already at max level of subscription, I don't think a $200 subscription should make you feel like you are getting unfair advantage. Like restricting claude -p to API ... after I paid so much? Moderate use should not do that. I am not running it batch mode on a million inputs.
- phs318u 7mo agoIf you can point to a consumer targeted service that provides and keeps their SLAs, I’ll be impressed.