7 ms·

Purpose: Learn linux clustering/diskless nodes. Advantages: Cheaper than conventional servers, limited physical form factor suitable for constrained environmen

Purpose: Learn linux clustering/diskless nodes. Advantages: Cheaper than conventional servers, limited physical form factor suitable for constrained environments such as apartments, luggage, etc. Low power consumption, suitable for mobile/off-grid/renewable. Recommended software: https://clusterlabs.org https://clusterlabs.org https://www.kernel.org/doc/html/latest/admin-guide/nfs/nfsroot.html https://www.kernel.org/doc/html/latest/admin-guide/nfs/nfsro... https://wiki.gentoo.org/wiki/Diskless_nodes https://wiki.gentoo.org/wiki/Diskless_nodes Commercial advantage: Run highly cost and power efficient data centers, call centers, etc. Eliminate redundant state. Remove manual configuration rollout. Infrastructure as code. Full CI/CD with kernel-level control, per node, for any OS. Basically becoming a lost art in this day of "outsource to cloud". With SDN knowledge, confidently build your own cloud provider.

skohan 6y ago
Is the power consumption really that good? I mean comparing to just getting a single 5950x or something would this actually win in terms of performance per watt?
z3t4 6y ago
You could rent a couple of 1USD/month VPS, or if really on a budget rent a bunch of containers with ipv6 for just a few cents
- contingencies 6y ago
  You absolutely could. But you wouldn't learn how to build a system that recovers from yanking a power or network cable, wouldn't own it, and wouldn't be able to run it on your terms. You'd need a credit card with an American-run payments network to operate, with a declared identity and a bank account, for which a prerequisite is a few months of stable living and income in a particular jurisdiction, itself something large portions of the world do not have access to. Further you'd need to be happy with the fact none of your data was in your country, under your physical control, and never would be. But feel free to ignore the rest of the world and the fact that all this rental crap runs on open source software, just throw in the towel and be a rent-payer: a strategy that has its perks and efficiencies, for sure. But don't discourage those who seek to learn more.
  - Symbiote 6y ago
    https://ipv6onlyhosting.com/ https://ipv6onlyhosting.com/ is the first result, and accepts payment by bank transfer. Many other small VM hosts accept payment by Bitcoin.
  - notwedtm 6y ago
    > You'd need a credit card with an American-run payments network to operate, with a declared identity and a bank account, for which a prerequisite is a few months of stable living and income in a particular jurisdiction, None of this is true.
    - contingencies 6y ago
      Try being from a random South Asian or African village. Tell me how you go buying cloud services with your nonexistant banking infrastructure and personal credit line.
      - nl 6y ago
        The physical location of a person isn't generally the key barrier to being unbanked; instead it's poverty. "The most common one was having too little money to use an account. Two-thirds cited this as a reason for not having a financial institution account, and roughly a fifth cited it as the sole reason. Cost and distance were each cited by about a quarter of those responding to the question, and a similar share said they do not have an account because a family member already has one. Lack of documentation and distrust in the financial system were both cited by roughly a fifth of adults without a financial institution account, and religious concerns by 6%." https://www.cashmatters.org/blog/globally-17-billion-people-did-not-have-bank-accounts-in-2017-world-bank-2018/ https://www.cashmatters.org/blog/globally-17-billion-people-... (And to state the obvious: poverty is also a barrier to owning physical infrastructure)
      - Koshkin 6y ago
        No, try buying cloud services while living in a remote village where clothing is non-existent.
  - 6y ago
- whymarrh 6y ago
  Where does one find VPSs this cheap?
  - tazard 6y ago
    RamNode has some starting at $15/year on their OpenVZ platform. Have been happy enough with that for several years now, although it's quite limited as to what it can do in terms of performance. But as another commentor mentioned, check out LowEndBox. It's where I discovered this.
  - JosephRedfern 6y ago
    A few years ago I could vouch for LowEndBox: https://lowendbox.com/ https://lowendbox.com/. I've not frequented the site in a very long time though, so can longer be sure.
  - z3t4 6y ago
    https://www.serverhunter.com/ https://www.serverhunter.com/
- tutfbhuf 6y ago
  From my experience the cheapest reliable ones in terms of storage, cpu, ram performance come at about 3$/month (+-50 cent). I can recommend Hetzner.
- bstar77 6y ago
  One issue I have with going the VPS route is that what I'm charged is often not what I'm expecting. I will use estimation calculators and figure my bill will be $25/month (which I get for a couple months) and then suddenly get a $120 bill. This has happened more than once and has had me loose all confidence in these services for hobby projects. I'd rather just buy a Pi cluster at this point.
  - z3t4 6y ago
    Your agreement was $25/month, so if they start to charge you $120 you pay them $25 and then cancel the service. This is very annoying but do happen dealing with unscrupulous businesses. Although if they have 500% margin eg. you pay $5 for something you can get for $1 elsewhere they will care more about keeping you as a customer. Compared to for example a cloud bill, renting a VPS is both cheaper and more predictive. If you are however paying $25/month you should start looking at dedicated servers, where all resources are preserved for you.
  - jacob019 6y ago
    Sounds like AWS or one of the big guys. The smaller providers usually have an all in price for a VPS with a fixed amount of rosources, no surprises. Lightsail is similar but kind of sucks.
    - bstar77 6y ago
      Yeah, it's AWS. In the future I'll be looking at the smaller providers.
- luzer7 6y ago
  Any links to an ok $1 VPS that would work? I tried a few a while back and always have an issue with RAM. What's the best way to go about clusters since I think you need 1gb RAM per node and lowest I've seen is $5. Thanks
Galanwe 6y ago
> Learn linux clustering/diskless nodes. Honestly, could be as valid with a setup that just involves running a bunch of VMs. > Low power consumption Yeah, well, a typical laptop should draw around 50W, which is what, like 0.05$ a day? > Commercial advantage: Run highly cost and power efficient data centers Hu, no, in terms of power efficiency per unit of work, you will not beat specialized hardware. > Infrastructure as code. Full CI/CD with kernel-level control, per node, for any OS. With SDN knowledge, confidently build your own cloud provider. Sure, also, blockchain, 5G, serverless, microwaves, rust, wasm Lets come back to earth for a second. There is objectively no purpose for this, except it's fun and nerdy. Do we really have to find excuses?
- contingencies 6y ago
  To be clear, the commercial utility refers to the skills, not the hardware.
- oarsinsync 6y ago
  > > Learn linux clustering/diskless nodes. > Honestly, could be as valid with a setup that just involves running a bunch of VMs. Slightly less valid. You don't have the same IO latency between nodes using VMs unless you start messing around with artificial attempts at inducing latency on each node individually. It's much easier to accurately simulate real world networking by not bothering to simulate and just using real world networking. There's a huge difference between latency on a wire vs latency within a hypervisor, and you won't know what you've papered over through lower latency via VM until you move to real hardware.
- JohnJamesRambo 6y ago
  Thanks for this, the other comments had left me, a layman, thinking this was actually useful instead of just for fun.
- nixgeek 6y ago
  > Yeah, well, a typical laptop should draw around 50W, which is what, like 0.05$ a day? At least where I live that would be 1.2kWh and about 13 cents per day, around $4 per month, or around $50 per year if running 24x7. Pacific Northwest has I believe some of the cheaper power in the U.S. at 10-11 cents per kilowatt hour.
ansible 6y ago
If you want to learn clustering with physical hardware, and you don't have the power and size constraints, you're better off buying some off-lease business desktops. These i3 and i5 systems with 4 to 8GB of RAM can be had for less than $100 each. When you're done with the cluster, you can likely sell them for nearly what you paid for them.
- deleted 6y ago
  [deleted]
- thetanil 6y ago
  i think you will lose in the end this way if you actually factor in power costs.
  - tutfbhuf 6y ago
    Yup, 6x old i5 thinkpads will require more space, more power and will likely be more expensive than 6x Pi.
    - foxhop 6y ago
      I'd take 6 old ThinkPad over 6 new Pi any day. :) I host a lot out of my house on a T430S with a cracked screen.
      - tutfbhuf 6y ago
        I know there are thinkpad hoarders with like 10 or 20+ old thinkpads. Seems to be a nice hobby, but you will rarely find one who builds a thinkpad cluster. In the case of Raspberry Pi it is pretty normal nowadays to connect a bunch of them into a cluster and have some fun. In fact, it has become so popular, that you u can find stackable cluster cases and other Pi cluster hardware on amazon.
  - nojito 6y ago
    Not when you factor in performance per watt.

skohan 6y ago

Is the power consumption really that good? I mean comparing to just getting a single 5950x or something would this actually win in terms of performance per watt?

z3t4 6y ago

You could rent a couple of 1USD/month VPS, or if really on a budget rent a bunch of containers with ipv6 for just a few cents

contingencies 6y ago
You absolutely could. But you wouldn't learn how to build a system that recovers from yanking a power or network cable, wouldn't own it, and wouldn't be able to run it on your terms. You'd need a credit card with an American-run payments network to operate, with a declared identity and a bank account, for which a prerequisite is a few months of stable living and income in a particular jurisdiction, itself something large portions of the world do not have access to. Further you'd need to be happy with the fact none of your data was in your country, under your physical control, and never would be. But feel free to ignore the rest of the world and the fact that all this rental crap runs on open source software, just throw in the towel and be a rent-payer: a strategy that has its perks and efficiencies, for sure. But don't discourage those who seek to learn more.
- Symbiote 6y ago
  https://ipv6onlyhosting.com/ https://ipv6onlyhosting.com/ is the first result, and accepts payment by bank transfer. Many other small VM hosts accept payment by Bitcoin.
- notwedtm 6y ago
  > You'd need a credit card with an American-run payments network to operate, with a declared identity and a bank account, for which a prerequisite is a few months of stable living and income in a particular jurisdiction, None of this is true.
  - contingencies 6y ago
    Try being from a random South Asian or African village. Tell me how you go buying cloud services with your nonexistant banking infrastructure and personal credit line.
    - nl 6y ago
      The physical location of a person isn't generally the key barrier to being unbanked; instead it's poverty. "The most common one was having too little money to use an account. Two-thirds cited this as a reason for not having a financial institution account, and roughly a fifth cited it as the sole reason. Cost and distance were each cited by about a quarter of those responding to the question, and a similar share said they do not have an account because a family member already has one. Lack of documentation and distrust in the financial system were both cited by roughly a fifth of adults without a financial institution account, and religious concerns by 6%." https://www.cashmatters.org/blog/globally-17-billion-people-did-not-have-bank-accounts-in-2017-world-bank-2018/ https://www.cashmatters.org/blog/globally-17-billion-people-... (And to state the obvious: poverty is also a barrier to owning physical infrastructure)
    - Koshkin 6y ago
      No, try buying cloud services while living in a remote village where clothing is non-existent.
- 6y ago
whymarrh 6y ago
Where does one find VPSs this cheap?
- tazard 6y ago
  RamNode has some starting at $15/year on their OpenVZ platform. Have been happy enough with that for several years now, although it's quite limited as to what it can do in terms of performance. But as another commentor mentioned, check out LowEndBox. It's where I discovered this.
- JosephRedfern 6y ago
  A few years ago I could vouch for LowEndBox: https://lowendbox.com/ https://lowendbox.com/. I've not frequented the site in a very long time though, so can longer be sure.
- z3t4 6y ago
  https://www.serverhunter.com/ https://www.serverhunter.com/
tutfbhuf 6y ago
From my experience the cheapest reliable ones in terms of storage, cpu, ram performance come at about 3$/month (+-50 cent). I can recommend Hetzner.
bstar77 6y ago
One issue I have with going the VPS route is that what I'm charged is often not what I'm expecting. I will use estimation calculators and figure my bill will be $25/month (which I get for a couple months) and then suddenly get a $120 bill. This has happened more than once and has had me loose all confidence in these services for hobby projects. I'd rather just buy a Pi cluster at this point.
- z3t4 6y ago
  Your agreement was $25/month, so if they start to charge you $120 you pay them $25 and then cancel the service. This is very annoying but do happen dealing with unscrupulous businesses. Although if they have 500% margin eg. you pay $5 for something you can get for $1 elsewhere they will care more about keeping you as a customer. Compared to for example a cloud bill, renting a VPS is both cheaper and more predictive. If you are however paying $25/month you should start looking at dedicated servers, where all resources are preserved for you.
- jacob019 6y ago
  Sounds like AWS or one of the big guys. The smaller providers usually have an all in price for a VPS with a fixed amount of rosources, no surprises. Lightsail is similar but kind of sucks.
  - bstar77 6y ago
    Yeah, it's AWS. In the future I'll be looking at the smaller providers.
luzer7 6y ago
Any links to an ok $1 VPS that would work? I tried a few a while back and always have an issue with RAM. What's the best way to go about clusters since I think you need 1gb RAM per node and lowest I've seen is $5. Thanks

Galanwe 6y ago

> Learn linux clustering/diskless nodes. Honestly, could be as valid with a setup that just involves running a bunch of VMs. > Low power consumption Yeah, well, a typical laptop should draw around 50W, which is what, like 0.05$ a day? > Commercial advantage: Run highly cost and power efficient data centers Hu, no, in terms of power efficiency per unit of work, you will not beat specialized hardware. > Infrastructure as code. Full CI/CD with kernel-level control, per node, for any OS. With SDN knowledge, confidently build your own cloud provider. Sure, also, blockchain, 5G, serverless, microwaves, rust, wasm Lets come back to earth for a second. There is objectively no purpose for this, except it's fun and nerdy. Do we really have to find excuses?

contingencies 6y ago
To be clear, the commercial utility refers to the skills, not the hardware.
oarsinsync 6y ago
> > Learn linux clustering/diskless nodes. > Honestly, could be as valid with a setup that just involves running a bunch of VMs. Slightly less valid. You don't have the same IO latency between nodes using VMs unless you start messing around with artificial attempts at inducing latency on each node individually. It's much easier to accurately simulate real world networking by not bothering to simulate and just using real world networking. There's a huge difference between latency on a wire vs latency within a hypervisor, and you won't know what you've papered over through lower latency via VM until you move to real hardware.
JohnJamesRambo 6y ago
Thanks for this, the other comments had left me, a layman, thinking this was actually useful instead of just for fun.
nixgeek 6y ago
> Yeah, well, a typical laptop should draw around 50W, which is what, like 0.05$ a day? At least where I live that would be 1.2kWh and about 13 cents per day, around $4 per month, or around $50 per year if running 24x7. Pacific Northwest has I believe some of the cheaper power in the U.S. at 10-11 cents per kilowatt hour.

ansible 6y ago

If you want to learn clustering with physical hardware, and you don't have the power and size constraints, you're better off buying some off-lease business desktops. These i3 and i5 systems with 4 to 8GB of RAM can be had for less than $100 each. When you're done with the cluster, you can likely sell them for nearly what you paid for them.

deleted 6y ago
[deleted]
thetanil 6y ago
i think you will lose in the end this way if you actually factor in power costs.
- tutfbhuf 6y ago
  Yup, 6x old i5 thinkpads will require more space, more power and will likely be more expensive than 6x Pi.
  - foxhop 6y ago
    I'd take 6 old ThinkPad over 6 new Pi any day. :) I host a lot out of my house on a T430S with a cracked screen.
    - tutfbhuf 6y ago
      I know there are thinkpad hoarders with like 10 or 20+ old thinkpads. Seems to be a nice hobby, but you will rarely find one who builds a thinkpad cluster. In the case of Raspberry Pi it is pretty normal nowadays to connect a bunch of them into a cluster and have some fun. In fact, it has become so popular, that you u can find stackable cluster cases and other Pi cluster hardware on amazon.
- nojito 6y ago
  Not when you factor in performance per watt.