6 ms·

I am one of these guys who is using K8S at home. The reason is a unified platform for work and home environment.

deforciant 7y ago
Same here, I run K8s both locally and on GKE for a project. My GKE cluster is just 2 nodes that have 2vCPU & 3.75GB RAM each. Performance is great and it has saved me an insane amount of time. I have also created an open source project that does one thing - updates your deployments :) https://keel.sh https://keel.sh. Previously I tried several different hosting options but nothing is easier/more convenient than k8s for me.
- Fiahil 7y ago
  Thanks a lot ! Keel looks exactly like something I would need!
fyfy18 7y ago
Assuming you are running on physical hardware how are you managing storage? I've tried Rook but it seems somewhat buggy and overkill for my requirements (rsync would do).
Fiahil 7y ago
I'm using K8S (with rancher's k3s) at home too ! My main reason is portability. When I need to unplug one of the Raspberries or move all services to somewhere else, I only need to change the storage layer.
- swsieber 7y ago
  So you're running bare metal k8s at home? What do you use for storage? That's my biggest question in how to move frok minikube at home to a true cluster.
  - Fiahil 7y ago
    Raid 1, 4tb, NAS with NFS :)
    - swsieber 7y ago
      Thanks! That should be enough to get me going in the right direction, hopefully to a working setup :)
echelon 7y ago
What's the cheapest you can run a k8s cluster in the cloud? I've been looking to spin one up in AWS, but it looks remarkably expensive for running personal projects.
- goatinaboat 7y ago
  Consider just running Minikube on your laptop. It’s pretty realistic and won’t cost you a penny. Except maybe in electricity, it seems to consume an enormous wattage just to exist...
  - bryanlarsen 7y ago
    minikube --vm-driver=none consumes a lot less resources, and k3s even fewer.
    - goatinaboat 7y ago
      I’m using Hyper-V at the moment, I’ll check out your suggestions - thanks
      - bryanlarsen 7y ago
        https://github.com/microsoft/WSL/issues/4203 https://github.com/microsoft/WSL/issues/4203
    - nobleach 7y ago
      K3s is fantastic. Lately I've been using K3d (which is the same thing, just in a docker container - much like Kind) It's super easy to spin up a cluster, and spin it back down with nothing really to clean up.
- ypcx 7y ago
  If you just/first want to practice actual, multi-node k8s on your local Mac (or Windows), I've just completed this: https://github.com/youurayy/hyperctl https://github.com/youurayy/hyperctl
- 7y ago
tshanmu 7y ago
How do you expose your services via an ingress when it needs to be behind a nat (via your home router/gateway)? Thanks!
- ivan4th 7y ago
  One possibility (especially for "home Kubernetes" case) is not exposing the services to the outside world at all and using ZeroTier to access them https://www.zerotier.com/ https://www.zerotier.com/ It's L2 mesh VPN, and I believe you can even use MetalLB with it with some minor trickery. You can, of course, set up WireGuard or OpenVPN for yourself, too, but from my experience zt is the simplest for accessing the boxes behind NAT as you don't even need to set up any servers with real IPs.
- deforciant 7y ago
  Hi, my shameless plug (I am the creator of webhookrelay): https://webhookrelay.com/v1/guide/ingress-controller https://webhookrelay.com/v1/guide/ingress-controller, using it both for services that are running in GKE and on minikube locally. It's cheaper than allocating a LB IP for backing services that don't get much traffic like Grafana and similar things.
- apeacox 7y ago
  DNAT. You map one/more ports from your router exposed on internet to ip:port of the local app. However, http/https ports are already used on routers to offer an admin web GUI. It’s technically possible to circumvent this with some ad-hoc firewall rules, but it depends if the router admin UI let’s you do that.
  - gdamjan1 7y ago
    > However, http/https ports are already used on routers to offer an admin web GUI. not on the wan side I'd hope
    - apeacox 7y ago
      Exactly, they aren’t exposed outside. That’s why you can “potentially” add rules to route request from the outside to an internal host:port, even 80/143. On the LAN you would still able to connect to router admin.
swsieber 7y ago
Do youbuse minikube at home? If it's a real cluster, I'd like to ask what you do for storage. I currently run minkube but would love to move to a real cluster setup.
bengale 7y ago
Docker for Mac can run a k8s instance for you if you want.

Same here, I run K8s both locally and on GKE for a project. My GKE cluster is just 2 nodes that have 2vCPU & 3.75GB RAM each. Performance is great and it has saved me an insane amount of time. I have also created an open source project that does one thing - updates your deployments :) https://keel.sh https://keel.sh. Previously I tried several different hosting options but nothing is easier/more convenient than k8s for me.

Fiahil 7y ago
Thanks a lot ! Keel looks exactly like something I would need!

fyfy18 7y ago

Assuming you are running on physical hardware how are you managing storage? I've tried Rook but it seems somewhat buggy and overkill for my requirements (rsync would do).

Fiahil 7y ago

I'm using K8S (with rancher's k3s) at home too ! My main reason is portability. When I need to unplug one of the Raspberries or move all services to somewhere else, I only need to change the storage layer.

swsieber 7y ago
So you're running bare metal k8s at home? What do you use for storage? That's my biggest question in how to move frok minikube at home to a true cluster.
- Fiahil 7y ago
  Raid 1, 4tb, NAS with NFS :)
  - swsieber 7y ago
    Thanks! That should be enough to get me going in the right direction, hopefully to a working setup :)

echelon 7y ago

What's the cheapest you can run a k8s cluster in the cloud? I've been looking to spin one up in AWS, but it looks remarkably expensive for running personal projects.

goatinaboat 7y ago
Consider just running Minikube on your laptop. It’s pretty realistic and won’t cost you a penny. Except maybe in electricity, it seems to consume an enormous wattage just to exist...
- bryanlarsen 7y ago
  minikube --vm-driver=none consumes a lot less resources, and k3s even fewer.
  - goatinaboat 7y ago
    I’m using Hyper-V at the moment, I’ll check out your suggestions - thanks
    - bryanlarsen 7y ago
      https://github.com/microsoft/WSL/issues/4203 https://github.com/microsoft/WSL/issues/4203
  - nobleach 7y ago
    K3s is fantastic. Lately I've been using K3d (which is the same thing, just in a docker container - much like Kind) It's super easy to spin up a cluster, and spin it back down with nothing really to clean up.
ypcx 7y ago
If you just/first want to practice actual, multi-node k8s on your local Mac (or Windows), I've just completed this: https://github.com/youurayy/hyperctl https://github.com/youurayy/hyperctl
7y ago

tshanmu 7y ago

How do you expose your services via an ingress when it needs to be behind a nat (via your home router/gateway)? Thanks!

ivan4th 7y ago
One possibility (especially for "home Kubernetes" case) is not exposing the services to the outside world at all and using ZeroTier to access them https://www.zerotier.com/ https://www.zerotier.com/ It's L2 mesh VPN, and I believe you can even use MetalLB with it with some minor trickery. You can, of course, set up WireGuard or OpenVPN for yourself, too, but from my experience zt is the simplest for accessing the boxes behind NAT as you don't even need to set up any servers with real IPs.
deforciant 7y ago
Hi, my shameless plug (I am the creator of webhookrelay): https://webhookrelay.com/v1/guide/ingress-controller https://webhookrelay.com/v1/guide/ingress-controller, using it both for services that are running in GKE and on minikube locally. It's cheaper than allocating a LB IP for backing services that don't get much traffic like Grafana and similar things.
apeacox 7y ago
DNAT. You map one/more ports from your router exposed on internet to ip:port of the local app. However, http/https ports are already used on routers to offer an admin web GUI. It’s technically possible to circumvent this with some ad-hoc firewall rules, but it depends if the router admin UI let’s you do that.
- gdamjan1 7y ago
  > However, http/https ports are already used on routers to offer an admin web GUI. not on the wan side I'd hope
  - apeacox 7y ago
    Exactly, they aren’t exposed outside. That’s why you can “potentially” add rules to route request from the outside to an internal host:port, even 80/143. On the LAN you would still able to connect to router admin.

swsieber 7y ago

Do youbuse minikube at home? If it's a real cluster, I'd like to ask what you do for storage. I currently run minkube but would love to move to a real cluster setup.

bengale 7y ago

Docker for Mac can run a k8s instance for you if you want.