8 ms·
The Zen of Erlang (2016)
- j_m_b 6y agoIs Erlang about to be the next big thing due to companies unable to use Huawei and instead going with Ericsson for 5G deployment?
- s3cur3 6y agoThe Erlang ecosystem (including my personal favorite BEAM language, Elixir) has been kind of a secret weapon for a lot of companies for years. There are a handful of freelancers in the community who have had the experience of going to work for a company doing Erlang/Elixir, only to be told they can never reveal the company’s identity because they consider the language a competitive advantage. One big corp went so far as to say they use Java in all their public-facing info (including hiring).
- apta 6y agoWhat does Erlang offer that the JVM or .NET don't?
- yawaramin 6y agoCheck out the OP.
- dnautics 6y agoThe concept of failure domains is baked into the runtime, and not an afterthought.
- smabie 6y agoWhile there is actor support through Akka and Akka.net on the JVM and .NET, neither of them support preemption like the BEAM does. Preemption of blocking actors is a game-changer in terms of how you write and structure concurrent code. I wrote a BitTorrent client in Scala using Akka and found myself desperately wishing that I could write actors in a blocking style. The amount of extra complexity and book-keeping required to write purely non-blocking actors is truly staggering. Let me give you an example. I have an actor that asks for two objects from a DbActor, and then sends them to the AdderActor to get the sum. Without preemption, I have to do the following. 1. Send a message to get object A and object B. Return. 2. Wait for an object. 3. When I get the object, figure out if it is object A or B (or maybe it's something else entirely). Update internal state so that I know I need one more object. Return. 4. Wait for an object 5. Get the object, figure out if it is object A or B (or something else). Update internal state so I know that I have both objects. Send the two objects and my Add message to the AdderActor. Return. 6. Wait for the result. 7. Now that I've gotten the result, update internal state saying that I've completed my A+B operation. Either store the result of A+B or whatever. This method requires a lot of internal booking and a lot of mutable hash tables in order to keep track of all the various stuff this actor is in the process of doing. If I'm trying to calculate A+B and C+D, I need to know how far along I am in each computation. This is a buggy and annoying process that creates a ton of complexity. Let's look at how we could do it in Erlang: 1. Send a message saying we want object A. 2. Don't return, and instead block until we get A. Now we ask for B. 3. Block until we get B. Now send the A+B message. 4. Block until we get it. Do something. Return. See how much easier this is? Because we can block, our code actually can be structured to look like normal, non-concurrent code. It can be executed in a sequential fashion, even though the actual computation is happening somewhere else. With Akka and Akka.net, we can't do that. We have to return as quickly as possible, or else we are going to lock up the entire system. This means that all of the implicit state that a normal program has (like current line being executed), must be stored explicitly by our program. It sucks, but hopefully the JVM will get preemption sometime soon. The actor model doesn't really work with out it. And even though it doesn't work without it, it's still better than threads and mutexes.
- apta 6y agoAs you point out, the JVM is getting preemption by means of Loom. .NET already has coroutines (async/await) so it should already do what you stated.
- smabie 6y agoI'm not super familiar with .NET, but if it supports preemption, they why this? https://getakka.net/articles/concepts/actor-systems.html#blocking-needs-careful-management https://getakka.net/articles/concepts/actor-systems.html#blo... Coroutines in general are a form of cooperative multi-tasking (they must explicitly yield), but I might missing something about .NET's implementation.
- apta 6y agoIt is specific to blocking APIs, as per the page: > Examples are legacy RDBMS drivers or messaging APIs, and the underlying reason is typically that (network) I/O occurs under the covers The issue with async/await is that APIs need to be extended with their async counterparts. If they don't, then you have to be sure not to invoke blocking calls. Java won't have this issue as the runtime will take care of preemption.
- sbalea 6y agoIn Scala/Akka, you could use the ask operator and compose the resulting Futures, something like this: for { a <- aProviderActor ? gimmeA b <- bProviderActor ? gimmeB aPlusB <- adderActor ? (add, a, b) } yield aPlusB
- smabie 6y agoYeah, but you're blocking the thread. It's very very easy for you to deadlock the entire system writing code like this.
- enraged_camel 6y agoI'll just come out and say that this is true for us at PriceTable. :) I've used Rails, Node.js and .NET before this, and none of them came close to Elixir in terms of developer productivity, not to mention system stability.
- gjvc 6y agohttp://www.paulgraham.com/avg.html http://www.paulgraham.com/avg.html still holds true.
- bobbyz 6y agoDoes it though? StackOverflow's predecessor was created one year after this was written, meaning it was likely written in an environment without SO. Easily finding the solution to your every problem is the ultimate programming language feature.
- ativzzz 6y agoHow much of this actually has to do with using the language? Unless the companies are solving very specific technical problems that Erlang/Elixir are designed to solve, what really matters is productive software devs and managers, and that is more defined by expertise and domain knowledge in a particular language than the language itself (within reason: you're not going to choose C over Ruby for a web app backend). How much of this is due to (the minority of) devs that can code Erlang/Elixir being more experienced/productive regardless of the language? Or just having good tech management?
- andrewflnr 6y agoI've heard this before, and despite my cautiously being on the Elixir bandwagon, this story triggers my BS sensor. Assuming their competitors are already invested in another language, it will be expensive for them to switch, and the company using Erlang/Elixir gets good press from using a hipster language. Can someone point to specific people that said they were barred from revealing their BEAM-using employer?
- jlouis 6y agoArguably, it already is all over the place in telecommunication. But indeed, Huawei being somewhat limited could push more people to buy Ericsson equipment, where a large part of it uses Erlang. It is strong in the area because you have the perfect storm of large complex protocols bundled with the need for very high reliability and robustness of systems. Few languages does that particular mix as well as Erlang.
- jmiskovic 6y agoI've spent two years with them and didn't see Erlang anywhere. It was occasionally mentioned as obscure thing you are forced to do in some other department, while rest considered themselves lucky to be using C++. There were also teams doing Java, Python, JS, Matlab, roughly in that order of popularity.
- danfritz 6y agoIts already the biggest thing ever, but nobody knows it. 90% of the Internet nodes is controlled by erlang code [1] Edit: it's indeed controlled nodes and not code [1] https://thenewstack.io/why-erlang-joe-armstrongs-legacy-of-fault-tolerant-computing/ https://thenewstack.io/why-erlang-joe-armstrongs-legacy-of-f...
- WJW 6y agoIf you use "passes through" as a standard, surely C would be the biggest thing ever since Linux+BSD+Windows make up way more than 99% of operating systems and those are all written in C.
- danfritz 6y agoHa yes fair point! I mainly wanted to indicate that it's used more than people think. It's the backbone of telecom
- bobbyz 6y agoErlang: Cobol/Telecom: Banks/Internet: Money
- ori_b 6y agoC is definitely bigger than people assume.
- pjmlp 6y agoWindows has also a good part of C++ and we all know Microsoft's stance on keeping C compilers around.
- ramchip 6y agoIt’s not exactly what the quote says - 90% of the traffic goes through nodes _controlled by Erlang_. See: https://news.ycombinator.com/item?id=17218190 https://news.ycombinator.com/item?id=17218190
- 6y ago
- gregors 6y agoI highly suggest looking at Elixir. It makes things much better in my opinion. Some takes from one of the inventors of Erlang on Elixir https://joearms.github.io/published/2013-05-31-a-week-with-elixir.html https://joearms.github.io/published/2013-05-31-a-week-with-e... tl;dr "It didn't take long, but pretty soon my gut feeling kicked in. This is good shit"
- danfritz 6y agoElixir is the only language that really blew my mind in its capabilities while still using a readable and fairly easy syntax. Everything is just thinking in terms of message passing between lightweight processes
- brink 6y agoMy latest project is in Elixir after going through Rust and Python as candidates. Erlang / Elixir isn't the best candidate for _everything_, but I will be using it in the future for just about everything I can because of how much I like it.
- dnautics 6y agoI don't think ericsson really uses erlang that much internally.
- mononcqc 6y agoThey do. It’s part of control planes for their next 5G stacks.
- swinglock 6y agoI don't see why it would matter. You're not going to see more or less Erlang anywhere, not even at Ericsson, due to Ericsson getting more or less business. The software will be written regardless as long as there's some business and you're not going to notice outside Ericsson either way. Besides, Huawei is free to use Erlang too. It stopped being Ericsson proprietary a long time ago.
- vyuh 6y agoThis is a loose transcript of presentation given at ConnectDev'16. Video of the presentation: https://youtu.be/4ZIPijEqrNI https://youtu.be/4ZIPijEqrNI
- rapsey 6y agoI’ve seen ex python or node.js developers say they are just as productive in Rust. After a few years of Rust experience, it still pales in comparison to Erlang productivity for me.
- stonecharioteer 6y agoI've been on the fence in learning erlang. I use python mostly and the industry around me uses Java or maybe golang. I have wanted to learn Rust and Erlang, but I've wanted to learn Erlang longer. I know there are different reasons to learn either, but what makes you feel erlang makes you more productive?
- rapsey 6y agoErlang concepts of processes, list comprehensions, pattern matching and extremely simple file/socket interfaces just make problem solving a breeze. There is very little boilerplate and very little in the way of irrelevant details.
- GordonS 6y agoNot sure if you've used Elixir, but if so, how would you say it compares to Erlang? I've spent a single day with Elixir and really liked it (if it was statically typed, I would have stuck with it), but I've only ever seen Erlang code (and stack traces), and honestly, the syntax looks really intimidating.
- lostcolony 6y agoThe syntax is alien (coming as it does from Prolog, which few people know), but it actually is as much a feature as an anti-feature. You end up not bringing your own understandings to the language (as illustrated by the one instance where it seems familiar - if statements do not behave the way you expect them to; it pattern matches and must match to true in one of its branches or it's a runtime error). It also doesn't have macros, so far less 'magic' in the libraries and things. Either way, the size of the language to grok is smaller than Elixir, so I'd argue in some ways it's easier, even if it's offputting. That said, Erlang has Dialyzer, which gives you 'optional' typing. Elixir can make use of it too, though I don't think it's quite as good (though I haven't used it in prod the same way). Basically, it'll walk through your code, infer types, and tell you anywhere the code can't work based on what it could infer. You can help it by adding type annotations as well. So for instance, you read from ETS; Dialyzer will infer it can be type "any". But, what's this, you append to it; it must be a list of some type then. So that place you're multiplying it by a number must be wrong, since you can't multiply a list by a number. But in reality what's coming out is a binary; both operations are wrong. Diyalyzer can't tell you that, but you can tell it that via type spec. Regardless, I'd probably create new projects in Elixir at this point; mix is such a good tool, and Elixir has some real niceties (looking at you, actual string type and pipe operator), to where it would probably be my default at this point.
- MrFantastic 6y agoImmutable variables are too weird for me.
- andy_ppp 6y agoThe runtime takes care of making immutability fast (enough), you realise how good it is when debugging code that does lots of mutations via references in other languages. Also it helps to reason about parallel code because nothing is being mutated from another thread.
- toast0 6y agoI agree it's weird, but you get used to it and now I'll occasionaly write code without reassigning to variables in 'normal' languages... I still miss for loops though.
- dnautics 6y agoIf you are willing to get over it, you'll find that huge classes of errors disappear. It's a very nice feature that lets you cut a bunch of bs, clarify your code, and make everything much more comprehensible. When you can mutate your values, you have to read any given block of code with a ton of suspicion (and possibly trace through control flow, keeping branches in your head, god I don't miss doing that). If your values are immutable, you don't have to do that. The one place where it screws you over in erlang is the REPL, which I think is why Elixir chose to allow you to mutate the variable binding, (but the underlying values are still immutable). In my main code, I mark any variables that I will mutate binding (almost never) with a ! postfix sigil (idea stolen from Julia/Ruby)
- yawaramin 6y agoYeah but it's a critical piece of how Erlang and its BEAM VM are able to deliver on their concurrency and fault-tolerance guarantees. Turns out that allowing variable values to change randomly throughout the system is really bad for building correct concurrent systems.
- bmitc 6y agoI'm not for sure exactly what you mean by immutable variables, but if you are referring to Erlang not being able to rebind variables, then you might check out Elixir, which does have variable rebinding. All data in Erlang and Elixir is immutable but the rebinding of variables is handled differently between the two. http://blog.plataformatec.com.br/2016/01/comparing-elixir-and-erlang-variables/ http://blog.plataformatec.com.br/2016/01/comparing-elixir-an...
- e_carra 6y agoI watched the presentation some months ago on YouTube. Really really well done. Thanks to that video I was able to get some tricky concepts of Erlang that I was previously struggling with.
- amelius 6y agoI have the feeling that Erlang is great, but only if you are working in a very specific problem domain. For example, I wondered if there is a GUI library for Erlang, and the response with the most votes here [1] is that people don't write GUIs in Erlang. The other answers point to wrappers around libraries written in other languages. I think that is suspicious for a language that has been around for such a long time now. [1] https://stackoverflow.com/questions/97508/what-libraries-can-i-use-to-build-a-gui-with-erlang https://stackoverflow.com/questions/97508/what-libraries-can...
- deleted 6y ago[deleted]
- dnautics 6y agocheck this out: https://www.youtube.com/watch?v=feAW1AVzNwo https://www.youtube.com/watch?v=feAW1AVzNwo But also there are GUIs (I believe there are wx bindings) that are shipped with erlang (wobserver for example) By and large, though people are writing servers in erlang, so building GUIs has never been a priority, and by the time erlang got a kick in butt in popularity due to Elixir, the way to write a GUI in erlang, became "write a web interface in Elixir". Finally don't necessarily trust stackoverflow; the entire elixir community has basically left SO and gone to elixir-specific fora, which we think is why elixir dropped off the SO developer's survey.
- zbentley 6y ago> the entire elixir community has basically left SO and gone to elixir-specific fora That's very surprising to me. Do SO's metrics of questions/answers/etc reflect this? If so, why the move? Was it organic? Organized?
- mononcqc 6y agoI was active on the Erlang stackoverflow. I left because stackoverflow is not a community, I don't give a crap about the gamification, the incorrect answers most upvoted because they provide a quickfix rather than a proper fix, and I'd rather go in places where you can have an actual discussion when you need to re-frame problems since newcomers aren't generally used to the paradigms of the VM and OTP. Stackoverflow felt like working for free just spending time answering things for imaginary points whereas other fora have more reciprocity available through richer dynamics that can help build communities. Stackoverflow, to me, is a last resort more than anything else.
- dang 6y agoIf curious see also 2018 https://news.ycombinator.com/item?id=17100626 https://news.ycombinator.com/item?id=17100626 Discussed at the time: https://news.ycombinator.com/item?id=11058500 https://news.ycombinator.com/item?id=11058500
- bobbyz 6y agoThe incessant functional evangelizing everywhere I go reminds me of why people don't like vegans