16 ms·
Software engineering research questions
- seanhunter 4y agoI'd love to see (or do myself if I ever get the chance) some research into some of the hot-button software architecture, tooling and project structure topics that come up a lot here and in every team I've worked on. They always boil down to a religious debate with strong opinions on all sides, and everyone wanting to copy something they've read about how their favourite MAGMA company does it, but it feels like some of these should have empirically right answers: 1. Under what circumstances is a monorepo beneficial as opposed to multiple smaller repos and what are the determining factors? (Team size, codebase size, tooling, software coupling, project velocity, .... etc?) 2. Under what circumstances are different system architectures better, and what are all the different factors that influence this? (eg microservices, 3-tier, one big blob of code, ... etc) 3. Can we empirically measure or determine whether a language, framework, library etc is the right choice for a given situation and how might we do that? Is it possible to formulate rules to inform good decisions here or is it always going to be a matter of judgement? 4. How do different styles of working (Pair programming, scrum, TDD etc) affect team productivity, code quality, developer happiness, project velocity etc? What are the factors that make one preferable over another in a given situation? 5. What's the right team size for a given project? 6. What's the best way to discover and communicate software requirements? ... I could go on. But in other engineering disciplines, a lot of the analogous things are solved problems rather than being topics for heated debate.
- gyulai 4y ago> ... favourite MAGMA company ... What's "MAGMA"?
- kinow 4y agoTIL as well: https://www.theverge.com/tldr/2021/10/28/22751274/facebook-meta-name-change-new-big-tech-acronym-faang https://www.theverge.com/tldr/2021/10/28/22751274/facebook-m...
- FridgeSeal 4y agoLike FAANG but more Meta.
- seanhunter 4y agoYeah exactly. Meta, Alphabet, Google, Microsoft, Apple[1] or permutations thereof. Basically you pick the initialism and then you choose companies that plausibly could fit into it. [1] Edit: errrr, that doesn't quite work does it. Meta, Amazon, Google, Microsoft, Apple lets say.
- BerislavLopac 4y agoOh, that's a nice one - definitely way better than FAANG! That being said, I think that Meta is evil and should not be promoted in any way - so we might go for a version without it, for example MAGA! Oh, wait... :P
- bee_rider 4y agoThought somebody had tried to commercialize MAGMA for a second. https://icl.utk.edu/magma/ https://icl.utk.edu/magma/
- drewcoo 4y ago> my impression is that we’ve gone from packaging or building an installer taking 10% of effort to cloud deployment infrastructure being 25-30% of effort, but that’s just one data point The old bad days of shrink-wrapped software involved installing in environments we could not control. Tbe direct costs of writing an installer and testing (the larger effort) install, upgrade, uninstall, recovering from partial installs, etc. were nothing compared to the costs of dealing with all the weirdness that could exist on a customer's machine. We're doing things like blue/green deploys and CD - things not remotely possible in that other world. And we're hooking up all kinds of monitoring and observability tooling that . . . even if we could have shipped that to customers on physical media, we'd be unable to harvest data from in those old times. I think we're spending a lot less engineering time and getting a bigger bang for the effort. I worry, though, that because software engineering has the shared professional memory of a goldfish that can always swim to an unvisited side of its bowl, we'll somehow try to repeat that pattern we've overcome.
- gonzo41 4y agoI would offer the view, that for teams flush with money, everything you said is great. But if you're a solo dev or in a small team, deployments and finding the correct balance is actually tricky to manage. Developers created a solution to the old deployment problem by abandoning it and doing something else. That problem exists and you'd think it'd just be solved now so rolling out a desktop app wasn't such a crazy pain. I worry that software engineering is building a lot of tech stacks that need active maintenance and can't really go into a classical long term support style use.
- sideshowb 4y ago> Developers created a solution to the old deployment problem by abandoning it and doing something else Also by shipping a standard webview and js app, if you want to go that route. But there were plenty of cross platform solutions before that, most notably java. Of course you know all that, guess I'm just trying to remind us that desktop deployment wasn't that unsolved and still isn't.
- Henrywright23 4y ago[flagged]
- TheAceOfHearts 4y agoThat's an interesting set of questions, and it feels frustrating that we'll probably never get an answer for most of them. My most important question regarding software engineering would probably be something like: how well are resources allocated and could we do a better job? Consider how many brilliant and outstanding people go work on some useless software at a big adtech company rather than helping to improve the world. The greatest tragedy of our time.
- wzwy 4y agoDo you have any notable example of brilliant people working on something that doesn’t improve the world? My naïveté inclines me to think that there are more brilliant people working on world-improvement project than the opposite.
- hardware2win 4y agoAds, imo.
- hkpack 4y agoI think for the most part we can only say retrospectively, what was worth doing. Facebook was created to connect people and ended up facilitating genocide. Breakthrough in private health-improving tech can bring unfathomed gap between rich and poor. We can only speculate where new developments such as AI will lead us.
- lupire 4y agoWas genocide so rare before Facebook? The 1990s Rwandan genocide was coordinated by 1-way radio.
- jmeister 4y ago>Facebook was created to connect people and ended up facilitating genocide. Throwing out the baby with the bath water here. How many lost friendships were recovered through FB? In my network of immigrants and refugees: countless. >Breakthrough in private health-improving tech can bring unfathomed gap between rich and poor. This is absurd. Why is the gap more important than the absolute level of the poor? All medical tech began as expensive and only for the rich.
- qsort 4y agoThese all stem from the complete lack of empiricism and scientific method in this discipline. I'm pretty sure we all have opinions on most of that stuff. None of which are backed by any evidence whatsoever, we are basically always going with our gut.
- chaxor 4y agoThis may be, but it is useful to point out that, in many cases, engineering practices in more tangible scientific areas are also driven by some personal preferences / opinion. For example, in which situations should you use Redlich-Kwong equations of state over a simple ideal gas or VdW? There will always be one model which gets closer to the measured values in a specific condition, but the entire domain may be difficult to determine which model is most appropriate. Even in these fields the decision falls to opinion - some models may be more precise and accurate, but require more processing/ development time. Which is just software engineering again.
- qsort 4y agoMy previous comment came out harsher than I intended -- I don't mean to imply that opinion and experience don't play a factor in other disciplines, we are more prone to see issues with software engineering because we are more familiar with software engineering. However I still think the situation is a bit worse. The tradeoffs in the models you mention are well understood. The equivalent in SE would be something like "should we use python or go", but it's very unclear that we can definitively state which use cases are better for which. There is simply no evidence, the plural of "anecdote" isn't "data".
- Lwepz 4y ago"23. Has anyone ever compared how long it takes to reach a workable level of understanding of a software system with and without UML diagrams or other graphical notations? More generally, is there any correlation between the amount or quality of different kinds of developer-oriented documentation and time-to-understanding, and if so, which kinds of documentation fare best?" This is such an important question and it's just the tip of the iceberg of a very deep problem that is rotting our software systems. We are absolutely pathetic at dealing with complexity and we actually enjoy complexity. We don't tackle questions such as 23. ANYWHERE near as seriously as we should. Developers overestimate their mental bandwidth which leads them to pompously build over-complicated tech stacks despite only having archaic tools to mitigate and navigate their complexity. Companies don't need to hire more devs to deal with their complex software systems, they need better tools to navigate their software systems. But because companies don't truly value their money and devs don't truly value their time, we end up in the situation we are in now. We should have hundreds of companies investing on initiatives akin to Moldable Development[1], instead they play the following bingo: 1) let's just hire more devs and hope to land on a 10xer 2) let's build our own framework Additionally, we overvalue specialization. By overloading developer brains with complex tech stacks, we encourage a culture of specialized profiles who find solace in trivia. Doing so, we limit cross-pollination and stifle true innovation. This attitude is actively killing-off thousands of valuable ideas. Every second, there's a coder out there who thinks of something wild, which requires very specific tools from different fields and finds out that the people who built such tools couldn't be bothered making them accessible under a sensible time-budget to people outside of their niche/ivory tower. So the dev either drops the idea or gets sucked up into a niche. This is tragic, but hey look! We have a new (totally not low-hanging fruit that could be predicted 10 years ago) Generative Model, WOW! "What a time to be alive"! [1] https://moldabledevelopment.com/ https://moldabledevelopment.com/
- lifeisstillgood 4y agoSoftware Wngineering is not engineering, it's literacy.
- deleted 4y ago[deleted]
- lloydatkinson 4y agoI would love to hear what people do for 25? I’m struggling with this myself - with static site generators you can’t always put files in the same directory as the markdown
- brianmcc 4y agoThis is an amazing list, and really highlights how much we take on trust in this industry: do X for good/better/best outcomes. Taking a step back I wonder: if there did emerge clear, incontrovertible evidence that doing X led to better outcomes, how many teams would actually adopt it? And how many would dismiss those findings regardless? In these modern times I suspect we'd see a far higher rejection rate than 10-years-ago me would've anticipated.
- pydry 4y agoMost of those questions (e.g. TDD) are highly context dependent. The fact we blithely ignore context is why some of them are controversial, I think. But yes, we do take too much on trust.
- _57jb 4y agoThank you! This is an awesome list of questions and it's incredibly thoughtful that you documented and shared it with us. It reminds me of Hitchhikers Guide where they know the answer but need the question. So many answers are out there floating around that we are often trying to force into certain frames for various motivations. Having questions that get us thinking, recognizing how unclear things are in current state, this feels like such a powerful thing to share. Apologies for the diatribe, very much appreciated.
- rwmj 4y agoSteve McConnell's Code Complete published by Microsoft is a classic text in this area, one of the only ones I'm aware of that actually uses academic sources for its claims. However it was published in the 90s and only updated once in 2004, so I wonder if there's a newer version or new book which updates this? https://www.microsoftpressstore.com/store/code-complete-9780735619678 https://www.microsoftpressstore.com/store/code-complete-9780...
- spenrose 4y agoOP's site ttps://neverworkintheory.org is dedicated to reviewing the abundant recent research in software engineering.
- ozim 4y ago*At what point is it more economical to throw away a module and write a replacement instead of refactoring or extending the module to meet new needs?* If you have rotation in the team it is a lot easier to get new people write new code than learn old ways - especially when original authors are all gone. If you have stable team, as long as knowledge is there and module fits style of the team I think rewrite will not be needed unless someone wants to shove some not fitting requirements there, which would be better handled by just making separate module.
- zozbot234 4y agoMissing question: Does the camel really have two humps?
- deleted 4y ago[deleted]
- nequo 4y agoSome of these could be tested among college students or high-school students. Let students form groups and participate in a tournament. Make the task complex enough that the tournament requires sustained work (e.g., 12 weeks). Then randomly assign coding practices to the participating groups and evaluate: > Do doctest-style tests (i.e., tests embedded directly in the code being tested) have any impact long-term usability or maintainability compared to putting tests in separate files? > Has anyone analyzed videos of coding clubs for children or teens to see if girls are treated differently than boys by instructors and by their peers? > Has anyone ever studied students from the first year to the final year of their program to see what tools they actually start using when. In particular, when (if ever) do they start to use more advanced features of their IDE (e.g., “rename variable in scope”)?
- mym1990 4y agoTwo developers go on a date: they use this as an ice breaker to get to know each other.
- Imnimo 4y agoIs "has anyone ever made X?" really a "research question"?
- rapjr9 4y agoFor the first question, putting the documentation into the source code has a major problem, there is no good place to put an overview of the whole system. Block diagrams are difficult to draw with just ASCII, images can't be included, formulas, and more. Also many things in software connect to many other things, and if the documentation is in the source code you can likely only describe one side of these connections (or you have to describe both fully on each side of the connection, thus duplicating a lot of the documentation.) Comments are immensely useful, but I don't think they work for general purpose documentation of a system. They can work well for libraries where each API needs to be described separately, but even then I wouldn't consider them complete documentation of a library (how do you combine graphics functions to build a rendering pipeline for example, do you have to described how to build pipelines for every single function that might be used in a pipeline?)