4 ms·

I personally haven’t been impressed with yocto: It’s about as intuitive as gentoo and reliable as buildroot. Maybe I was using it wrong though. I think it’s a

by swiley 7y ago

I personally haven’t been impressed with yocto: It’s about as intuitive as gentoo and reliable as buildroot. Maybe I was using it wrong though. I think it’s a good idea.

codetrotter 7y ago
What sorts of reliability problems have you had with Buildroot? And what do you use instead?
- _pmf_ 7y ago
  Second that question. If you don't do product lines with varying platforms, buildroot is much easier.
- swiley 7y ago
  Honestly I was just being rhetorical. Buildroot really isn’t bad but it’s not totally solid and it’s not hard to mess it up either by not thinking or not reading the documentation. Changing the config and rebuilding without cleaning is the most obvious thing although the docs explicitly tell you not to do that so that doesn’t really count. Certain compiler build settings can result in a failed build. It’s really only meant to be used for making cross compilers anyway and the root image generation is a sometimes useful thing. Personally if I want a rootfs it’s easy enough to make one from scratch.
nrclark 7y ago
I work with Yocto in my day job. The learning curve is really steep, but I actually like it a lot. Buildroot a great project with clear goals and good execution. Yocto is flexible to a fault, which makes it a lot more complex. But with that complexity comes a lot of power and fine-grained control over your builds.
- troubler 7y ago
  I work with Yocto at my day job too. I hate it. I have 20 years of experience with Linux, and my favorite disto is Fedora. Fedora on arm is working much better than Yocto (except for DNF: 40,000 of available packages is too much for an embedded system, so at least 1GB of memory is required to run DNF).
  - clarry 7y ago
    Buildroot at work. Someone told me yocto is the future so I spent a week with it but it was a nightmare. Went back to buildroot. Gentoo is quite intuitive by comparison.
  - ernst_klim 7y ago
    >Fedora on arm is working much better than Yocto I concur. I've tried Yocto, was appalled by it. Then I've taken Centos 8, and it was a breeze to build for it, safe for some minor troubles. I would choose Centos/opensuse/fedora/custom distro over Yocto anytime.
  - StillBored 7y ago
    Yah, extra bonus because you can upgrade the system with dnf upgrade/etc. Unlike yocto where its a PITA and requires an engineer to validate it works every-time you need a security patch. Yocto is just another "The S in IOT stands for security" kind of problem.
  - nrclark 7y ago
    Fedora on ARM definitely works better than Yocto out-of-the-box. It's also much larger, and you don't have much control over the core components. You don't have control over how the packages were compiled, and you'd have a hard time reproducing your exact build later (especially if your flow includes a dnf update somewhere). Yocto is the wrong tool if you're looking for a good developer Linux. It's a great tool if you're looking for a way to make a highly customized Linux image. It provides good reproducibility and strict license mechanisms to make sure you don't run afoul of anybody's open-source license. It also provides you with tools to compile and include your own recipes, and easy ways to modify upstream recipes without needing to fork the Yocto repos.
    - troubler 7y ago
      Fedberry is about same size as Yocto. Not a problem to customize RPM based distribution at all.
rjzzleep 7y ago
Having used both for extensive periods of time I just need to say that gentoo is at least an order of magnitude more intuitive. Yocto is, well, "acceptable" once you get the hang of it but I definitely get where the sentiment is coming from.
stefan_ 7y ago
At one point I was trying to build a completely minimal system for an already embedded architecture and instead of building a toolchain, target kernel and essentially empty userland I got 4000 build tasks, it was downloading the entire compendium of all imaginable open source software packages out there and projected a finish time of some 3 hours. At least buildroot isn't that stupid, although of course it is still stuck in "recursive Makefile" hell.
- btashton 7y ago
  For what's it's worth if you use the public shared state cache you can do a full build of core-image-minimal in 5min. Also I'm not sure how Yocto is being stupid by generating 4000 tasks, if you target something with a GUI like core-image-sato you are easily going to get there because there really is that much software involved. Also remember task does not match 1:1 to recipe, you are looking at 5-6 tasks per recipe usually. Hob can help you explore the dependency graph if you really are not sure why the build got so complex.
  - stefan_ 7y ago
    Hey, just for kicks, I did it once more! Here is what they say about core-image-minimal: > The minimal recipe provides an image with the least number of packages to be a bootable image Here is what it is building, incomplete list, for install to the target rootfs: - libx11, libxau, libxcb, libxcrypt, libxdmcp, libxrandr, libxrender, glib-2.0, "gnome-desktop-testing", gperf, openssl, perl, pixman, libsdl2, python3, sqlite3, various xorg-.. This isn't even the freaking desktop image! Also, no, sorry, no more Hob, that is now deprecated in favor of a django webinterface (Toaster). If you are building a software image for an embedded device and you don't know every package that is going into it and why it is there, you need to stop. Look to the Android AOSP for what it takes - an in-depth understanding of the toolchain, strict choices for compilers and libc (none of this clang-experimental and your choice of uclibc, musl, glibc), stringent standards across the entire body of code you are compiling - no "uh this doesn't compile with PIE and hardening, just hack the CFLAGS". And there are ton more lessons there.
    - 7y ago
ausjke 7y ago
I think you're right. I worked on Yocto for two years, it is over-engineered _a_ _lot_ to say the least. The BSP companies like it though, my theory is that, since Yocto is so complex(unnecessarily), only them can solved the problem for clients. It's a worse case comparing to gentoo for embedded space. Just use buildroot to bring up your board, much simpler and faster with top class documentation.
- _pmf_ 7y ago
  > The BSP companies like it though, my theory is that, since Yocto is so complex(unnecessarily), only them can solved the problem for clients. I also think Yocto is mainly an advantage for BSP vendors, but I think where the benefits might offset the complexity is when managing lots of client specific variations and adaptations for the same base BSP.
  - troubler 7y ago
    So instead of "share code and save money", like normal distro, they use "split code and make profit" model.
ernst_klim 7y ago
>I personally haven’t been impressed with yocto That's a very mild way to express my feeling about it. Maybe I'm asking too much, but Yocto/openembedded is the worst piece of software I've ever dealt with. The build system is a huge pile of opaque and fragile scripts. It's so fragile, that if you don't put a space before a list of options, it would be concatenated with other options without a space, leading to incorrect options. Because there are no lists, lists are just strings of space-separated words. Who needs proper data types? There are no modularity either, everything is configured through strange variables with names like CONFIG_image_graphics_mesa_package=... God knows how this naming works. Of course nothing is documented, and the discoverability is extremely low: everything is done through hundreds of opaque shell scripts, python scripts, half-baked python scripts for their build system. The overall design of the build system is abysmally bad and fragile, and it's harder to get a notion how the things work than to just build everything with your own scripts. Oh, and when something is wrong, build system just returns python stacktrace. Is it that hard to use proper abstractions, data types, docstrings, introspection mechanisms so that everything would become transparent, obvious and sane?
- rafa1981 7y ago
  Example: PACKAGE_native_append += "something". "append" is a keyword, but the "native" is just a separate list of native packages, yet both are appended to a variable name separating it by underscores. They use the same "syntax". If my memory serves me correctly, if not in this example "+=" is required sometimes after "append", even if they seem redundant. Someone politely explains you why this works as it does, it makes sense, yet you wonder why you need to hit a gotcha when all you are doing is something as simple as adding an item to a list (as a space separated string). And then the metadata is also funny, e.g. do_patch[depends] = "whatever:do_populate...". Variables are not just variables, they can contain metadata, sometimes important. It feels like there are usage patterns, good practices and something more beautiful wanting to get out, but this is a domain where making a better build tool would break tons of recipes, so it feels like everytime they got a problem they added a quickfix and got forward without looking back. The steep learning curve most of the time is unneeded, you are frenquently doing trivial to simple taks and hit one problem that gets you blocked for a while for things that you are easily able to do outside Yocto. It is a shame that the good work they do is spoiled by the horrible "interface".

by swiley 7y ago

I personally haven’t been impressed with yocto: It’s about as intuitive as gentoo and reliable as buildroot. Maybe I was using it wrong though. I think it’s a good idea.

codetrotter 7y ago

What sorts of reliability problems have you had with Buildroot? And what do you use instead?

_pmf_ 7y ago
Second that question. If you don't do product lines with varying platforms, buildroot is much easier.
swiley 7y ago
Honestly I was just being rhetorical. Buildroot really isn’t bad but it’s not totally solid and it’s not hard to mess it up either by not thinking or not reading the documentation. Changing the config and rebuilding without cleaning is the most obvious thing although the docs explicitly tell you not to do that so that doesn’t really count. Certain compiler build settings can result in a failed build. It’s really only meant to be used for making cross compilers anyway and the root image generation is a sometimes useful thing. Personally if I want a rootfs it’s easy enough to make one from scratch.

nrclark 7y ago

I work with Yocto in my day job. The learning curve is really steep, but I actually like it a lot. Buildroot a great project with clear goals and good execution. Yocto is flexible to a fault, which makes it a lot more complex. But with that complexity comes a lot of power and fine-grained control over your builds.

troubler 7y ago
I work with Yocto at my day job too. I hate it. I have 20 years of experience with Linux, and my favorite disto is Fedora. Fedora on arm is working much better than Yocto (except for DNF: 40,000 of available packages is too much for an embedded system, so at least 1GB of memory is required to run DNF).
- clarry 7y ago
  Buildroot at work. Someone told me yocto is the future so I spent a week with it but it was a nightmare. Went back to buildroot. Gentoo is quite intuitive by comparison.
- ernst_klim 7y ago
  >Fedora on arm is working much better than Yocto I concur. I've tried Yocto, was appalled by it. Then I've taken Centos 8, and it was a breeze to build for it, safe for some minor troubles. I would choose Centos/opensuse/fedora/custom distro over Yocto anytime.
- StillBored 7y ago
  Yah, extra bonus because you can upgrade the system with dnf upgrade/etc. Unlike yocto where its a PITA and requires an engineer to validate it works every-time you need a security patch. Yocto is just another "The S in IOT stands for security" kind of problem.
- nrclark 7y ago
  Fedora on ARM definitely works better than Yocto out-of-the-box. It's also much larger, and you don't have much control over the core components. You don't have control over how the packages were compiled, and you'd have a hard time reproducing your exact build later (especially if your flow includes a dnf update somewhere). Yocto is the wrong tool if you're looking for a good developer Linux. It's a great tool if you're looking for a way to make a highly customized Linux image. It provides good reproducibility and strict license mechanisms to make sure you don't run afoul of anybody's open-source license. It also provides you with tools to compile and include your own recipes, and easy ways to modify upstream recipes without needing to fork the Yocto repos.
  - troubler 7y ago
    Fedberry is about same size as Yocto. Not a problem to customize RPM based distribution at all.

rjzzleep 7y ago

Having used both for extensive periods of time I just need to say that gentoo is at least an order of magnitude more intuitive. Yocto is, well, "acceptable" once you get the hang of it but I definitely get where the sentiment is coming from.

stefan_ 7y ago

At one point I was trying to build a completely minimal system for an already embedded architecture and instead of building a toolchain, target kernel and essentially empty userland I got 4000 build tasks, it was downloading the entire compendium of all imaginable open source software packages out there and projected a finish time of some 3 hours. At least buildroot isn't that stupid, although of course it is still stuck in "recursive Makefile" hell.

btashton 7y ago
For what's it's worth if you use the public shared state cache you can do a full build of core-image-minimal in 5min. Also I'm not sure how Yocto is being stupid by generating 4000 tasks, if you target something with a GUI like core-image-sato you are easily going to get there because there really is that much software involved. Also remember task does not match 1:1 to recipe, you are looking at 5-6 tasks per recipe usually. Hob can help you explore the dependency graph if you really are not sure why the build got so complex.
- stefan_ 7y ago
  Hey, just for kicks, I did it once more! Here is what they say about core-image-minimal: > The minimal recipe provides an image with the least number of packages to be a bootable image Here is what it is building, incomplete list, for install to the target rootfs: - libx11, libxau, libxcb, libxcrypt, libxdmcp, libxrandr, libxrender, glib-2.0, "gnome-desktop-testing", gperf, openssl, perl, pixman, libsdl2, python3, sqlite3, various xorg-.. This isn't even the freaking desktop image! Also, no, sorry, no more Hob, that is now deprecated in favor of a django webinterface (Toaster). If you are building a software image for an embedded device and you don't know every package that is going into it and why it is there, you need to stop. Look to the Android AOSP for what it takes - an in-depth understanding of the toolchain, strict choices for compilers and libc (none of this clang-experimental and your choice of uclibc, musl, glibc), stringent standards across the entire body of code you are compiling - no "uh this doesn't compile with PIE and hardening, just hack the CFLAGS". And there are ton more lessons there.
  - 7y ago

ausjke 7y ago

I think you're right. I worked on Yocto for two years, it is over-engineered _a_ _lot_ to say the least. The BSP companies like it though, my theory is that, since Yocto is so complex(unnecessarily), only them can solved the problem for clients. It's a worse case comparing to gentoo for embedded space. Just use buildroot to bring up your board, much simpler and faster with top class documentation.

_pmf_ 7y ago
> The BSP companies like it though, my theory is that, since Yocto is so complex(unnecessarily), only them can solved the problem for clients. I also think Yocto is mainly an advantage for BSP vendors, but I think where the benefits might offset the complexity is when managing lots of client specific variations and adaptations for the same base BSP.
- troubler 7y ago
  So instead of "share code and save money", like normal distro, they use "split code and make profit" model.

ernst_klim 7y ago

>I personally haven’t been impressed with yocto That's a very mild way to express my feeling about it. Maybe I'm asking too much, but Yocto/openembedded is the worst piece of software I've ever dealt with. The build system is a huge pile of opaque and fragile scripts. It's so fragile, that if you don't put a space before a list of options, it would be concatenated with other options without a space, leading to incorrect options. Because there are no lists, lists are just strings of space-separated words. Who needs proper data types? There are no modularity either, everything is configured through strange variables with names like CONFIG_image_graphics_mesa_package=... God knows how this naming works. Of course nothing is documented, and the discoverability is extremely low: everything is done through hundreds of opaque shell scripts, python scripts, half-baked python scripts for their build system. The overall design of the build system is abysmally bad and fragile, and it's harder to get a notion how the things work than to just build everything with your own scripts. Oh, and when something is wrong, build system just returns python stacktrace. Is it that hard to use proper abstractions, data types, docstrings, introspection mechanisms so that everything would become transparent, obvious and sane?

rafa1981 7y ago
Example: PACKAGE_native_append += "something". "append" is a keyword, but the "native" is just a separate list of native packages, yet both are appended to a variable name separating it by underscores. They use the same "syntax". If my memory serves me correctly, if not in this example "+=" is required sometimes after "append", even if they seem redundant. Someone politely explains you why this works as it does, it makes sense, yet you wonder why you need to hit a gotcha when all you are doing is something as simple as adding an item to a list (as a space separated string). And then the metadata is also funny, e.g. do_patch[depends] = "whatever:do_populate...". Variables are not just variables, they can contain metadata, sometimes important. It feels like there are usage patterns, good practices and something more beautiful wanting to get out, but this is a domain where making a better build tool would break tons of recipes, so it feels like everytime they got a problem they added a quickfix and got forward without looking back. The steep learning curve most of the time is unneeded, you are frenquently doing trivial to simple taks and hit one problem that gets you blocked for a while for things that you are easily able to do outside Yocto. It is a shame that the good work they do is spoiled by the horrible "interface".