6 ms·
Feedback doesn't scale
- kiddz 11mo agojust sent you a note Carter . . . this is something close to my heart :-)
- kdazzle 11mo agoI dont think the solution to not knowing people in your company is to create bureaucracy. Ie - only hanging with 10 executives and a focus group. Get out there and talk to people for a few minutes - at the office or wherever.
- dataflow 11mo agoI think, putting what you're saying another way, just because your capacity might be limited to hearing from N people, that doesn't mean it has to be the same N people all the time. It should include a sampling across everyone so you have a lower chance of systematically missing entire points of view.
- wisty 11mo agoTeacher here. Best Principal I had would gatecrash your class once a year, then have a chat giving feedback. Kind of stressful (it could happen with little warning) but whatever. They knew everyone in the school (ebery teacher and about 500+ student names), and what happened in every class. It took time and talent to do it, but it made them a lot less insulated. Claiming you can't know 100-200 people - your high school teacher wrote 100 reports. Now obviously they aren't 100% on the ball, but they have some idea (I hope). There's an old story about how Bill Gates once took a call in tech support. A far larger organisation, and he still was willing to dive deep and see what was going on at the least glamorous part of the coalface. There's a difference between trying to micromanage everything, and micromanaging enough that you're not out of touch. Feedback is a two way street. It both let's you know what is happening, and let's the people below know that you actually care. Even if you can't (and arguably shouldn't) be everywhere at once, it has its place. Now yes, it's drive by management and isn't the main tool that a manager should use, but being overly scared that your trusted expert juniors will be destroyed by a senior checking up on them is maybe a bit silly, and if a senior manager is such a tool that they do cause havoc just by looking over someone's shoulder and giving them a bit of feedback you're already in trouble. Inulation isn't the answer IMO, just accepting that yes you don't need to know everyone and everything to the same level as if it was a small team.
- mattm 11mo agoThe same principle holds for quality management. You don't need to inspect every single product. However, if you inspect a small number of products at random, you'll detect a large percentage of the quality issues. While leaders can't know everyone they should make it a priority to have those random connections outside their inner circle. If they don't, they become in danger of hearing only the info that their inner circle wants them to hear.
- anonymouskimmer 11mo ago> However, if you inspect a small number of products at random, you'll detect a large percentage of the quality issues. As quality issues become fewer, the odds increase that inspecting a small number of products at random will lead to you thinking that there are zero quality issues. Have your inspections procedure scale and adapt to the relative proportion of quality issues you have reason to believe exist. And if you believe you truly have zero quality issues, then you need to switch to an immediate feedback procedure (such as an anonymous tip line, or a non-anonymous one for customer feedback).
- Root_Denied 11mo ago> There's a difference between trying to micromanage everything, and micromanaging enough that you're not out of touch. I think there's a good point to be made here that this isn't micromanaging, it's bypassing feedback layers that have a tendency to filter out critical or important information. That information may or may not be withheld intentionally, but being Bill Gates and seeing that a crucial tool to help a customer doesn't work very fast, or is missing information, or relies on "hacks" (tribal knowledge on how to bypass restrictions or flags) to keep the support process going would be something that wouldn't filter upwards easily. Definitely a balance to be had though for sure.
- TeMPOraL 11mo agoUltimately, it is. The post didn't touch on this, but it's exactly why the world looks like it does - it is, and has always been, recursively subdivided. It's why we have districts and towns and counties and states and countries. Hierarchical governance is a result of trying to cooperate in groups larger than the limit of how many direct relationships our brains can support.
- kdazzle 11mo agoMaybe, but a 200 person company isn’t really that big. The CEO should probably get over themselves if they think they couldnt possibly know everyone at least a little bit.
- 7bit 11mo agoOur CEO does this. She talks to a lot of people. Once you start talking business, she clearly doesn't care about your opinion, unless you're praising something. If it's remotely critical or a suggestion to change something, you can see in her eyes she's not even processing the words anymore. I rather have her not talking to me, because it's much worse knowing she fakes her openness, than actually just not showing up.
- avidiax 11mo agoSounds like some meta-feedback that should be delivered to her. Of course, this kind of person has lots of ways to deflect, so they have to actually genuinely believe in open feedback as a value, and be willing to understand how they are falling short of living up to that value. In the worst case, they only want to present as open to feedback, while they are using that feedback to build the list of detractors who will be laid off, not promoted, etc. And this kind of personal feedback can really trigger this sort of person.
- jameskilton 11mo agoThere's a lot of research on this, particularly from Robin Dunbar, who gave us "Dunbar's Number" https://en.wikipedia.org/wiki/Dunbar%27s_number https://en.wikipedia.org/wiki/Dunbar%27s_number
- ItsHarper 11mo agoThis approach can't inform you that someone in the feedback chain is causing a problem.
- munk-a 11mo agoYup - they touch on proxy relationships where you have a few trusted reporters to break the crowd into cohorts that you can mentally simplify but whenever you do this you need to accept that it won't be complete. You should expect and make room for occasional noise from the fifty people behind your one trusted reporter because the problem could always lie with the reporter themselves.
- xpe 11mo ago> Without an existing relationship, it feels like an attack, and your natural human response is to dismiss or deflect the attack. Or worse, to get defensive. Attacks trigger our most primal instincts: fight or flight. It is really important to recognize that it is the perception of an attack that triggers certain responses. For a counter example, watch how puppies play. It can very rough at some level but at another the intent is clearly benign. There are ways to shape and modify perceptions! Culture. Norms. Timing. Technology. Inclusion and exclusion criteria. Information architecture. Never assume that the technology or protocols you use have been designed for your core values. Often you have to redesign it for your purposes. Please do. Feedback *can* scale if one carefully defines protocols to suit particular goals. We are not helpless even if it seems we are hapless. Leaders and designers (often social scientists) must step up and show better ways. Computer scientists and software engineers must show curiosity and intellectual humility here. Better to draw broadly from other fields: social work, negotiation, psychology, anthropology, public policy, and more.
- xpe 11mo ago> Feedback doesn't scale because relationships don’t scale. I would not say it this way; it is too simplistic. In fact, I generally caution against the dominant metaphor here of comparing feedback to scaling. It falls apart quickly. Here’s a counter point. In many scenarios and settings, relationships provide transitive benefits. For example, if a leader builds trusted relationships with other leaders, a significant amount of trust can flow through that relationship. To build a better understanding, I suggest building diverse models. Try to answer the question: What kind of qualities do relationships confer and why? There’s also a generational aspect here. I started my career in the 2000 tech boom and bust. I’ve seen a lot of up-and-down cycles in the industry. I’ve seen lots of management styles and organizational cultures. People that had formative years during peak social media and/or COVID often have a different kind of socialization and this affects their default expectations. I won’t attach normative judgments without research, but there are significant differences. When I think of the most impressive collaborations I’ve participated in with amazing results, relatively few of them involve tech organizations. Building a scalable culture over various company sizes feels hard in the sense that generalizing prescriptive advice is tricky. A two person start up is cake because you only have to manage one internal relationship (a pair). People know great culture when they see it, but that is nothing like growing it.
- ChrisMarshallNY 11mo ago> set the expectation that they have strong relationships with their own teams Good luck with that. In most cronytocracies (typical, at the top levels of most companies), you get who you get. They may be really good engineers and "first line" managers, but suck at anything else. A big problem is that companies don't have career tracks that match people's skills. The Peter Principle[0] applies. Bad managers hire and promote other bad managers. Highly skilled engineers can often be terrible managers, but want to be managers, because that is the position they equate with "success," at an organization. A Principal Engineer should be just as valued and well-treated as a CTO. Most companies fail to do this, so everyone wants to be the CTO. Establish a career track, where technical people aspire to technical positions. And hire good managers; not ones that don't make the CEO uncomfortable. [0] https://en.wikipedia.org/wiki/Peter_principle https://en.wikipedia.org/wiki/Peter_principle
- mannanj 11mo agoJust experienced something similar working-at-definitely-not-capital-one as a principal engineer. My manager was horrible, and replaced by another bad manager. He incentivized bad behavior on my team and promoted inexperienced engineers, and group think, pushed me out for questioning the status quo.
- Swizec 11mo ago> A Principal Engineer should be just as valued and well-treated as a CTO. Most companies fail to do this, so everyone wants to be the CTO. Establish a career track, where technical people aspire to technical positions. I spent my whole career avoiding engineering management and trying to grow in the pure technical leadership direction. One day I realized that for every staff engineer there are 10 managers, for every principal there are 5 senior managers, etc. Turns out management is not so bad and companies seem to appreciate that kind of help a lot more edit: also as a manager you get to work on all those pesky “It’s a people problem, actually” parts of engineering which is pretty fun. Every time in technical leadership where it felt like “Well we’ve got the plan now we just gotta incentivize doing the plan” you’re the one doing the incentivizing yay!
- 11mo ago
- ramon156 11mo agoFirst paragraph already assumes a lot. We're a team of 5, but no, I cannot tell anyone my concerns or problems. I've read somewhere that company politics is necessary. Whether that's true, I'll probably never know.
- kylec 11mo agoWhen I worked at Netflix many years ago, they loved to boast about how they didn't have any "processes". My experience was that process ALWAYS exists, but at Netflix you just had to figure it out and hopefully not step on the wrong toes along the way.
- crabmusket 11mo agoAh, the tyranny of structurelessness.
- smj-edison 11mo agoTyranny of structureless is an excellent essay, [1] for the lucky 1 in 10,000 who haven't read it! [1] https://www.jofreeman.com/joreen/tyranny.htm https://www.jofreeman.com/joreen/tyranny.htm
- noitpmeder 11mo agoWhat do you feel you cannot share concerns with your peers?
- niccl 11mo agoNot the original poster but: * that the interaction with a peer _is_ the problem. I know we should all be grown up and able to talk about these things in a mature and effective way, but I can't cope with conflict in any shape or form, so if someone says Boo to me I cave in which doesn't get me any further * because peers aren't the people that need to hear some of the things I've got to say, it's layers above me that need to hear it
- conartist6 11mo agoAssuming the feedback you need will just come to you might not scale. Going and seeking out the feedback you want does not stop scaling.
- curiousaboutit 11mo ago[dead]
- schappim 11mo agoFeedback does scale if you’re willing to adjust the loss function. I like the Jason Fried-ism of: If something really matters, you’ll hear it again. If you have to write it down to remember it, it’s probably not important.
- econ 11mo agoI have this uhh I think it is a joke... Where I immediately implement feedback regardless just to encourage getting more of it. This is a great way to step on all toes and get negative feedback on the new approach. Basically the same as telling you I think your idea sucks but with less speculation and they don't even hate me. They think I'm joking, not even sure myself. Trust the process! it usually takes very little time. Much less than serious consideration.
- Logingarrett 11mo agoI like the building relationships concept. Ideally, each person in your 20 person group is in a different one of the 20 total teams. The organization will never be perfect but I think it could work.
- w_for_wumbo 11mo agoSo I get confused when I read things like "feedback doesn't scale". Because what am I, if not a self-organizing collective of a trillion cells. That seems like feedback which scales right there. This seems like a concrete example of why this logic is flawed. To me I believe it more useful to start with the premise of: I'm already communicating and leading trillions, how do I actually do that? A common issue is that we hold thoughts, logic and language as a type of universal gold standard, while ignoring that most of our communication isn't even verbal to begin with. It's context, observation, pattern recognition, a self-serving goal which aligns with the collective, because we're all wanting the same things. What feels good, what's expansive, what's beautiful etc. These are the reward functions for healthy communication in the human body, the more that we align and work with these, the better the results.
- adamhartenz 11mo agoMight be the biggest example of false equivalence I have seen in a long time.
- wavemode 11mo ago> So I get confused when I read things like "feedback doesn't scale". Because what am I, if not a self-organizing collective of a trillion cells. Well, yeah, that feedback scales perfectly because your cells don't have free will. I think there are plenty of real-world examples of large-scale projects where feedback scaled well, for similar reasons... though I doubt we want to use those as a guide.
- lukan 11mo ago"because your cells don't have free will" They are still independent cells. If they stop cooperating with the rest of the body, they become literally cancer.
- TeMPOraL 11mo agoThey are not independent. They're specialized. They're machines bred to perform highly specific functions in a very specific environment. They cannot survive outside of it. Edit: in fact, this "negative space" is probably underappreciated as the force defining the concept of a "living organism" itself. The fact that we can't just swap cells or pieces of cells around, that there is no universal, general-purpose cell that can be a skin cell today, a muscle cell tomorrow, a brain cell next week - is what makes nature be composed of organisms, instead of just being one big soup of cells.
- wowamit 11mo ago> Their struggles are not your struggles anymore. Though I agree with the larger point, there is a critical way to overcome that. The second line of leadership must own the culture at their team's level. This only works if you have direct access to the larger group. An open-door policy where anyone can schedule time with you is essential. You might not understand their struggle, but you can hear and route it to the right people. Sometimes the best way to show empathy is simply to listen.
- Aurornis 11mo ago> An open-door policy where anyone can schedule time with you is essential. In my experience, open door policies are necessary but not sufficient. If the policy is to wait for feedback to walk through your door you will only hear from the set of people motivated, willing, and trusting enough to do that. You have to go out and ask everyone one by one the appropriate questions and also be willing to listen. I’ve been in some companies where feedback was requested but then the immediate reaction was to argue and deny any feedback given, which is a fast path to ensure people stop providing feedback.
- wowamit 11mo agoAgreed. Setting up structures for people to provide regular feedback is a must -- I believe this goes without saying. The only downside is that this cannot be done 1:1 with each person. Hence, enabling even the motivated few is a good trade-off. But sure, necessary but not sufficient. At the same time, accepting and acting on feedback is a skill in its own right.
- Aurornis 11mo ago> The only downside is that this cannot be done 1:1 with each person. That level of feedback can be done with individual managers and their reports, with occasional skip-level check ins. I don’t actually thinking open door policies where, for example, the CEO of a large corporation is open to scheduling time with anyone who wants it could work for very long in an organization with 1000 people. I worked closely with the CEO of a company of that size that was growing. The number of ICs who attempted to send him emails and unsolicited reports trying to curry favor, get him to take their side in office politics, take credit for things, or even get their mangers in trouble was surprising to me. He made the mistake of publicly thanking a few people for bringing things to attention, which opened the floodgates for people seeing direct messages to the CEO as the highest leverage thing they could do in the office. The direct feedback skipping too many levels just doesn’t work because the person receiving feedback doesn’t have the context necessary to interpret it. The reporters know this and will start twisting facts and details to fit the narrative they want to deliver.
- wseqyrku 11mo agoIf you are operating at that scale, it's not a team anymore, it's an online community and should be treated as such.
- MichaelRo 11mo agoWhat's with the ghostly images? Can't we have one picture that's not some disturbing AI hallucination?
- untrust 11mo ago> Note: The photo is of a large crowd gathering for a union meeting during the 1933 New York Dressmakers Strike. That's scaling feedback. From the bottom of the article.
- adverbly 11mo agoComplaining that it doesn't scale past 100 isn't really that much of a complaint! I'd say it scales pretty darn good!
- fredirk 11mo ago> but you can know 10 people who each know 10 people Theoretically, yes, but in practice those 10 don’t really know 10 people. And if you don’t hire well and don’t have everything you need to keep them motivated, some of your 10 won’t even care about their 10 people or may actively be sabotaging you, peers, and/or their subordinates.
- dredmorbius 10mo agoIn a properly-structured hierarchy / bureaucracy, no only do they, but those ten (or however many) are direct reports, such that there is a structured flow of information. (Hierarchy and bureaucracy can of course have many other issues, but structuring flows isn't generally one of them.)
- saghm 11mo ago> Somewhere around 100 people, the ground shifts underneath you, as you realize you don’t know everyone anymore. You just can't. There aren't enough hours in the day, and honestly, there aren't enough slots in your brain This is definitely a rare exception, but at my first job, my boss's boss's boss (basically the #2 in the engineering organization, although probably only like 2/3 of it was under his purview) somehow seemed to have an unfathomable ability for knowing not only everyone under him the org tree, but details about what they were working on. I think it must have been at least 150, maybe even 200 people, and as far as I could tell he could recall every single person's name, project, and the general status of their work without needing anyone to remind him before talking with them. Maybe he did just really studiously review notes or something before any meeting or even chance of an ad hoc conversation in the halls, but I never really saw him typing at meetings or writing stuff down to keep track of later, so at the very least he'd need to have been able to retain a lot of information long enough to accurately record it later. Witnessing this firsthand for a few years was easily one of the most impressive mental feats I've ever observed.
- glompers 11mo agoDid having such a person in charge make a qualitative difference in the atmosphere of how work proceeded among people there? If so, do you think it would have played out similarly if the organization had had an equally effective "glue person" who wasn't in charge (therefore didn't have any authority to delegate or divide most tasks) and was required to manage upward [sic] to coordinate things for people?
- patcon 11mo agoLOVE this question! Thanks for asking. I also like toying with variants of where "essential elements" can live, sometimes in odd places :) https://x.com/patcon_/status/1963648801962369358 https://x.com/patcon_/status/1963648801962369358 > I have an idea for a quirky event experimenting with the "minimum viable feeling of community", but need to explain some context first. Bear with me... > [...] > So here's the event idea: what if someone ran an event where the 2nd rule was "NO INTRODUCTIONS", but only because the 1st rule was "you must arrive having fully memorized ONLY everyone's name and face". Beyond the strange entry requirement, what would such an event feel like? > And what strange sorts of intimacy might be created by this minimal scaffold of "knowing everyone"... & being in community together? I suspect it might feel like a warm event full of friends, but where everyone had mysteriously forgotten everything they knew about one another :)
- munificent 11mo ago> Past a certain size, you have to make peace with the fact that a lot of people in your org are going to be frustrated with you, and you're going to have no idea why, and you may not going to be able to fix it. I agree this is a necessary cost of being at the top of a large organization. But I am very suspicious of the kind of people that seem to have no trouble at all being misunderstood and disliked by many. Yes, decent people can be in those positions. But it's often a honeypot for sociopaths.
- _ache_ 11mo ago> You can't know 200 people, but you can know 10 people who each know 10 people You are still 100 people short to know 200 people, but I got the idea. The 100 people limit is already know by most of teachers. Having more than 3 classes, it is mostly impossible (very hard) to have a "deep" follow up of each student. Having more than 6 classes and it is strictly impossible to follow them even in the best conditions.
- bobek 11mo agoThe biggest (engineering) team I've built and led was 150 people, so I cannot speak for 200. I don't feel that the solution of keeping the understanding of what is happening was about a formal structure like an "employee steering committee". Rather than trusting the same principles used for scaling the doing side of the business. Things like empowering people to make decisions [1] or being clear about what/how/why you make certain types of decisions [2]. Working on staying aligned with your closest team, which then spent energy on staying aligned with their teams, etc. Sample randomly from the whole org, but mostly at your pace. The biggest mistake I've made was that I've pulled myself (for legitimate reasons, it seemed) from having a true conversation with every single hire before they've gotten an offer, when we were around 70. 30 minutes is typically enough, but I feel you need a singular person as a gatekeeper for the final values-fit check. Partially thinking that 70 is already good enough, but later I've come across people talking about, like, 500 people before pulling out [3] :) [1]: https://www.bobek.cz/decisions/ https://www.bobek.cz/decisions/ [2]: https://www.bobek.cz/work-principles/ https://www.bobek.cz/work-principles/ [3]: https://mastersofscale.com/reed-hastings-culture-shock/ https://mastersofscale.com/reed-hastings-culture-shock/
- metalman 11mo agofeedback fails when it is scaled down as well, the very worst manager to employie ratio bieng 1:1 where for every single consideration an employee turns to there manager, and effectivly reverses roles vs when there are several co workers who can use each other for feedback and in many ways then become self managing which of course lands us in the impossible to define world of "team building" it's mojo, nothing more
- willguest 11mo agoThis piece feels like an AI-generated effort because it’s not so much an exploration of leadership challenges, but rather a series of surface-level observations that lack depth. It's not just a general overview, but a collection of familiar tropes without any original or nuanced analysis, and the sentences aren't just simple, but lack the complexity and emotional depth that would make the piece feel truly human.
- the_af 11mo agoIsn't this more or less rediscovering hierarchies like that of the military? (i.e. "two levels down command & control"?).
- CarterBaxter 11mo agoI just wanted to stop by and say thanks for the discussion. There are a lot of good thoughts here, and I've enjoyed reading them. And I'm glad y'all liked the article. Well, at least those of you who enjoyed it.
- einpoklum 11mo ago> Past a certain size, you have to make peace with the fact that a lot of people in your org are going to be frustrated with you, and you're going to have no idea why, and you may not going to be able to fix it. This view of things can easily be used as an excuse to behave poorly, or otherwise, opaquely, with no transparency and accountability, and claim that there is no problem.