4 ms·

I'm only a light k8s user, but isn't part of the pitch that it actually gets you out of having to run parts of your infrastructure? Like, there's no point spinn

I'm only a light k8s user, but isn't part of the pitch that it actually gets you out of having to run parts of your infrastructure? Like, there's no point spinning up EC2 nodes just to run microk8s or k0s on them— have ansible scripts or whatever that just run your application directly. But the calculus changes if instead of EC2 nodes you can have a helm chart that deploys directly to a managed kubernetes services like EKS or GKE?

nicoburns 4y ago
That's still a bunch more complicated than other hosted solutions. I once worked for a 4 year old company whose entire infrastructure consisted of a managed postgres instance + a moderately sized single VM (and a duplicated setup as a staging environment).
colechristensen 4y ago
Eh, I've found kubernetes more complicated than the interface of a cloud provider, you always have to do the cloud provider as well for some things, and the benefits of the pre-baked helm charts or whatever else just aren't there until the relatively small difference in efficiency in each way of doing things makes a real difference as a result of scale. If you have a lot of experience with any interface, you can do it really efficiently, but if you don't, kubernetes can make your experience worse than anything you'd come up with on a cloud provider.
irjustin 4y ago
Can't you run K8 on Fargate so you don't have to manage EC2 nodes themselves? Even with ECS which is way simpler than K8 for small teams using Fargate has been incredibly beneficial in terms of debt/time. Then next step would be to move the entire application onto Lambda so we're not paying for downtime, but that's a whole headache and a half.
makeitdouble 4y ago
Fun with k8s starts when you realize it has no LTS and gets updated on a fixed schedule. Any given version is only officialy supported for about 1 year and a half. Then you'll need non trivial amount of knowledge of how it works to avoid many pitfalls (the helm chart will probably only go so far, it will still need small tweaks for your specific use case) So it's a combination of upfront time investment, ongoing tuning, and recurring maintenance events.
- p_l 4y ago
  Honestly, I find Helm to be a trap that is going to reduce your capability to run service reliably - or understand it. It's probably one of the most annoying bits in kubernetes ecosystem
alexalx666 4y ago
What are the benefits of k8s over docker-compose for small/medium business?
- maccard 4y ago
  All of the cloud providers offer k8s as a service, for one.
  - alexalx666 4y ago
    I should specify I was thinking about VPS. Coming from AWS to Linode VPS with Caddy + Docker felt great, Im wondering at what point (N requests per second ?) it becomes tech dept
    - maccard 4y ago
      Yeah that's definitely something that needs to be specified. > Coming from AWS to Linode VPS with Caddy + Docker felt great I guess that depends what you were using with AWS, but Fargate + k8s is a pretty amazing workflow. > Im wondering at what point (N requests per second ?) it becomes tech dept I make these calls for our org, and I wouldn't call it tech debt based on the performance or scale, but because of maintenance. As an example, if you needed to hire a new person/replacement person for your team, would it be easier to find someone who can maintain k8s or docker compose? The other area it shines for is the ecosystem. If you need to add monitoring to your app (e.g. with Prometheus), adding it to a k8s cluster is `helm install prometheus`
      - alexalx666 4y ago
        thanks for detailed response! how big is your org? My concern is that there is a cost to magic of adding deps like that. Complexity goes up and it is harder to understand what went wrong and where are the performance bottlenecks. I guess my question is at what org scale the tradeoffs are right
        4y ago
lucideer 4y ago
> isn't part of the pitch that it actually gets you out of having to run parts of your infrastructure? That's a big part of many k8s pitches I've seen but in my experience it hasn't been representative of reality (or at least for every part of infrastructure you no longer need to run there's a new part of k8s architecture/config to learn & manage). For me the selling points are: 1. For the time-cost of upfront complexity and setup, you get extremely easy and quick subsequent addition of infra/tooling & scaling thereof. 2. There are certain patterns of tooling that k8s enables (relatively easily), that would have been difficult/impossible with more traditional setups. I don't think it makes infra management overhead less, it just reorganises it so it's more upfront and then less later while scaling.
deleted 4y ago
[deleted]

nicoburns 4y ago

That's still a bunch more complicated than other hosted solutions. I once worked for a 4 year old company whose entire infrastructure consisted of a managed postgres instance + a moderately sized single VM (and a duplicated setup as a staging environment).

colechristensen 4y ago

Eh, I've found kubernetes more complicated than the interface of a cloud provider, you always have to do the cloud provider as well for some things, and the benefits of the pre-baked helm charts or whatever else just aren't there until the relatively small difference in efficiency in each way of doing things makes a real difference as a result of scale. If you have a lot of experience with any interface, you can do it really efficiently, but if you don't, kubernetes can make your experience worse than anything you'd come up with on a cloud provider.

irjustin 4y ago

Can't you run K8 on Fargate so you don't have to manage EC2 nodes themselves? Even with ECS which is way simpler than K8 for small teams using Fargate has been incredibly beneficial in terms of debt/time. Then next step would be to move the entire application onto Lambda so we're not paying for downtime, but that's a whole headache and a half.

makeitdouble 4y ago

Fun with k8s starts when you realize it has no LTS and gets updated on a fixed schedule. Any given version is only officialy supported for about 1 year and a half. Then you'll need non trivial amount of knowledge of how it works to avoid many pitfalls (the helm chart will probably only go so far, it will still need small tweaks for your specific use case) So it's a combination of upfront time investment, ongoing tuning, and recurring maintenance events.

p_l 4y ago
Honestly, I find Helm to be a trap that is going to reduce your capability to run service reliably - or understand it. It's probably one of the most annoying bits in kubernetes ecosystem

alexalx666 4y ago

What are the benefits of k8s over docker-compose for small/medium business?

maccard 4y ago
All of the cloud providers offer k8s as a service, for one.
- alexalx666 4y ago
  I should specify I was thinking about VPS. Coming from AWS to Linode VPS with Caddy + Docker felt great, Im wondering at what point (N requests per second ?) it becomes tech dept
  - maccard 4y ago
    Yeah that's definitely something that needs to be specified. > Coming from AWS to Linode VPS with Caddy + Docker felt great I guess that depends what you were using with AWS, but Fargate + k8s is a pretty amazing workflow. > Im wondering at what point (N requests per second ?) it becomes tech dept I make these calls for our org, and I wouldn't call it tech debt based on the performance or scale, but because of maintenance. As an example, if you needed to hire a new person/replacement person for your team, would it be easier to find someone who can maintain k8s or docker compose? The other area it shines for is the ecosystem. If you need to add monitoring to your app (e.g. with Prometheus), adding it to a k8s cluster is `helm install prometheus`
    - alexalx666 4y ago
      thanks for detailed response! how big is your org? My concern is that there is a cost to magic of adding deps like that. Complexity goes up and it is harder to understand what went wrong and where are the performance bottlenecks. I guess my question is at what org scale the tradeoffs are right
      - 4y ago

lucideer 4y ago

> isn't part of the pitch that it actually gets you out of having to run parts of your infrastructure? That's a big part of many k8s pitches I've seen but in my experience it hasn't been representative of reality (or at least for every part of infrastructure you no longer need to run there's a new part of k8s architecture/config to learn & manage). For me the selling points are: 1. For the time-cost of upfront complexity and setup, you get extremely easy and quick subsequent addition of infra/tooling & scaling thereof. 2. There are certain patterns of tooling that k8s enables (relatively easily), that would have been difficult/impossible with more traditional setups. I don't think it makes infra management overhead less, it just reorganises it so it's more upfront and then less later while scaling.

deleted 4y ago

[deleted]