6 ms·
A little bit of slope makes up for a lot of Y-intercept (2012)
- jtbayly 4y agoDoes anybody know why I have to sign in to GitHub to read this?
- nishs 4y agodon't know why. but it's publicly viewable from a private browser window for me.
- cratermoon 4y agoIt may be that github thinks you're coming from an IP address associated with a lot of botting or malicious activity, so it's throwing up an extra wall. Can you try hitting it through a VPN or via some other network?
- paulpauper 4y agoAnother example is hiring. Before I came back to academia a couple of years ago I was out doing startups. What I noticed is that when people hire they are almost always hire based on experience. They're looking for somebody's resume trying to find the person who has already done the job they want them to do three times over. That's basically hiring based on Y-intercept. Personally I don't think that's a very good way to hire. The people who are doing the same thing over and over again often get burnt out and typically the reason they're doing the same thing over and over again is they've maxed out. They can't do anything more than that. And, in fact, typically what happens when you level off is you level off slightly above your level of competence. So in fact you're not actually doing the current job all that well. I dunno if his experience is true anymore. Maybe it was 20 years ago. There does seem to be a shift in the other way. This can explain why many tech or finance companies seek younger applicants who have credentials that confer with steep slope over more experience. Things like learning speed, ability to understand abstractions, making inferences, etc. This is why so many top companies use phone interviews as a sort of weeding-out process for applicants who cannot think fast on their feet despite having experience or credentials.
- bumby 4y agoIt may depend on the type of position being hired for. There’s a concept of “fluid” vs. “crystalline” intelligence, where people tend to transition from fluid to crystalline as they age. Meaning, young people tend to learn faster while older people tend to understand the greater context. This may mean younger people make better individual contributors but older people tend to be better at strategizing.
- webmaven 4y ago> This is why so many top companies use phone interviews as a sort of weeding-out process for applicants who cannot think fast on their feet despite having experience or credentials. OTOH, conflating " thinking fast on their feet" with "learns fast" (rather than with "is bullshit artist") its own logical fallacy.
- mdeck_ 4y ago[flagged]
- rippercushions 4y agoI don't think "curiosity to try new things" was anywhere near the top of the list of reasons why US leadership decided to go to war in Vietnam. Even “Join the Army, travel the world, meet interesting people and kill them” was supposed to be an anti-war slogan.
- bumby 4y agoI read the post as more about the pitfalls of overconfidence than curiosity. Meaning a self-proclaimed fast-learner can’t necessarily make up for lack of experience *, exemplified with the “whiz kids” that defined war strategy in Vietnam. * at least when short-term consequences tend to be dire
- sitkack 4y agoThe fast learner should be collecting experience as fast as they can. That is the point of learning.
- deleted 4y ago[deleted]
- bumby 4y agoI’m not sure one automatically associates with the other. Someone can collect a lot of novel experiences and still not learn a thing from any of them. But I agree with your point that the goal should be to collect lots of experience that one has learned from. That doesn’t seem to be the case with the “whiz kids” the post linked to.
- sitkack 4y agoI didn't say it did, but when I am looking for a "fast learner", they develop a flow state and collect experience to fold back into their feedback model of learning a new domain. They are doing continuous hypothesizing and refutation and showing/proving the same result from multiple directions. My experience with "whiz kids" people is that they have immense raw mental analysis power, but not broad analytical ability and their lack of real world context greatly hinders them. They don't have the ability to synthesize alternative viewpoints, their view of the world is from a monocular distant vantage point.
- oblio 4y agoY intercept = Current Y position?
- Jtsummers 4y agoY intercept is the value of a function f(x) at x = 0. In the analogy, it's the starting position. Someone starting at a higher baseline knowledge is not necessarily destined to stay ahead of a fast learner who happens to start at a lower baseline of knowledge.
- adammarples 4y agoY intercept is where the line crossed the y axis at time 0. So it's the initial state.
- jvanderbot 4y agoY value at x=0. Also sometimes known as "initial conditions"
- water-your-self 4y agoY = mx + b
- FPGAhacker 4y agoA number have people have replied and I think they are all correct, but I want to be explicit. Given a function y = mx+b. Graphically, the function is a line on the xy plane, and if you trace your finger along the line toward the y axis, where your finger “intercepts” the y axis is the value of the y intercept. That’s the idea of the name. And everyone else is also correct, Its value is f(0) where y = f(x) = mx + b.
- deleted 4y ago[deleted]
- hyperific 4y agoReminds me of "Car vs Motorcycle vs Jet" https://youtu.be/Y9YsxO30PXI https://youtu.be/Y9YsxO30PXI
- dang 4y agoRelated: “A little bit of slope makes up for a lot of y-intercept” - https://news.ycombinator.com/item?id=8055868 https://news.ycombinator.com/item?id=8055868 - July 2014 (62 comments)
- quickthrower2 4y agoI like this kind of wisdom because you read it, then you fill in the blanks. What is Y to you, etc.? Better than someone telling you to go to the gym every week etc. :-). In real life the curves are more complex. A tortoise and hare curve would be more interesting. The hare is doing a hackthon at the weekend, getting super tired and giving up. THe tortoise is working on your side project for 4 hours a week every week for years.
- carls 4y agoI took a class with Professor Ousterhout. He would end every Friday's lecture with a "Thought for the Weekend", such as this one. It was very entertaining and charming to hear him discuss his personal and professional life, and lessons he's learned throughout them often occasionally have very little to do with computer science. I don't remember all of his "Thoughts for the Weekend", but I do remember one story he told about wishing he had apologized sooner to resolve some conflict he was in. That was a bit of wisdom that stuck with me from the class, beyond any of the computer science topics we covered.
- egillie 4y agoWas it the scar tissue one? https://gist.github.com/gtallen1187/27a585fcf36d6e657db2 https://gist.github.com/gtallen1187/27a585fcf36d6e657db2
- rcme 4y agoI've thought very deeply on the subject of my personal relationships and what causes them to "wear out" as Ousterhout put it. My conclusion differs, and it's because Ousterhout puts the cart before the horse: > So, the solution is if you want a relationship to last a long time, somehow you have to keep the scar tissue from building up. The key here is "if you want the relationship to last." In many relationships, people lose the desire for the relationship to last. For instance, in his contractor anecdote, he cares more about the outcome of the construction project that he cares about prolonging his relationship with the contractor. Or in the case of a business relationship, business partners want the business to be run in their own way more than the want their relationship to stay strong. Everything comes down to a desire to keep the relationship going.
- majormajor 4y agoHe doesn't ignore that "people lose the desire for the relationship to last," it sounds like that's exactly what he's saying the "scar tissue" causes: "and then somebody decides they just don't care anymore," as he puts it.
- tpoacher 4y agoMistake #1 is assuming a linear function in the first place. If I'd known this when I was younger I probably wouldn't have spent so much time learning all those languages, none of which I now remember.
- CPLX 4y agoIndeed. I think a much more accurate model looks a lot like the returns on an investment. Returns are always accumulating to what you already have. If you know a lot you have context to recognize the next thing that comes along better. You’re in a place that is more wired for learning surrounded by smarter people. The guy says as much himself when he says “you’re at Stanford” for god sakes. People who didn’t have enough of the good thing in high school aren’t starting at a lower Y-Axis point they’re simply not on the graph at all. Most of life’s “graphs” don’t look like linear lines they look like compound interest.
- fsckboy 4y agoI'm sure he's well aware of polynomials and exponentials, but that's not really his point.
- rahimnathwani 4y agoWhen hiring, you can more accurately estimate y than you can dy/dx, unless you have a trial period.
- wnissen 4y agoTruly without snark, what is it about y that makes it easier and dy/dx harder? I wonder if y is easier to fake? You can study the coding problems, there are whole books on that strategy. It seems like that would artificially increase your y, though it's probably a good indicator. To estimate dy/dx, I like to ask about how people learned new things. Have they managed to become experts on something like build systems or testing pipelines even though it was well outside their experience? Perhaps I am biased by the fact that I learned a bunch of languages in school that are almost exactly the languages I don't use. Almost all of it was learned on the job.
- rahimnathwani 4y ago> Truly without snark, what is it about y that makes it easier and dy/dx harder? Because you can measure y at a point in time. If you want to know if someone can operate an espresso machine and make good coffees, you can just ask them to do it, and watch them. If you want to know whether someone can learn to operate an espresso machine, you can: A) Ask them about how they learn new things, or B) Ask them to learn something new, and see how well they do, or C) Test them on multiple unrelated things, as being able to do a wide range of stuff that takes time to learn is evidence that they can learn stuff. A is tricky: someone who is good at interviewing could give answers that would fool most people. So it doesn't really measure dy/dx. B is great if you have the time, as it directly measures how fast and well they can learn something unfamiliar. C is good because you don't need to have them learn something new, but it's bad because you'd need to spend many hours to cover enough breadth AND you'd need to be competent at testing this broad range of skills. > I wonder if y is easier to fake? You can study the coding problems, there are whole books on that strategy. Yes, you can fake y specifically for FAANG-style coding interviews. But being able to fake y in this context is pretty good evidence you can learn new stuff!
- moffkalast 4y ago> That's good news for all of you people because you're in Stanford and that means you learn really, really fast. > Personally I don't think that's a very good way to hire. The people who are doing the same thing over and over again often get burnt out and typically the reason they're doing the same thing over and over again is they've maxed out. Anyone else who feels like they haven't learned a thing in their field of work since they left university? Once you get hired for and do what you're good at while there's nobody else at the company you can learn from it just feels like gradual regressing.
- baxtr 4y agoIt's the exact opposite for me. I learned so much after graduating from university. And there isn't really much from my studies that I could use today.
- longcommonname 4y agoAbsolutely not. I have learned all sorts of things. But I have to seek them out.
- moffkalast 4y agoMaybe that's the main difference. In the student days you're forced to learn enormous amounts of new skills in impossibly short time spans. Afterwards you kind of have to self motivate if you want to continue, and dive into research papers to get up to speed on the bleeding edge stuff since there's no real other study material available yet. I've found myself mainly focusing on learning things from adjacent or unrelated fields instead, since I guess it's easier to get a grasp of the pre-grad stuff. It sure isn't making me any better at my job though lol.
- ZephyrBlu 4y agoComplete opposite. University was theory without application and I generally hated learning CS theory. Now that I'm actually building things, I find the theory more interesting because I can apply it. Aside from theory, I've also learned infinitely more about software development. If there's no one else at your company you can learn from and you want to have that it sounds like you should check out some other companies.
- elchief 4y agoRate of learning depends on quality of teaching, and I found most textbooks, professors, and especially TAs to be laughably bad, despite going to a top Canadian university. Thank goodness for online ratings of books and courses to weed out the bad ones (worse now w more fake reviews, sadly)
- vmatsiiako 4y agoThis is also very true for startups! 2-people teams can iterate and learn so quickly that at some point they are able to outcompete (or come very close to) existing market leaders (e.g., Figma/Adobe, Linear/Asana, Pulley/Carta). So the y-intercept (or the starting point) turns out to not matter much if the slope (growth and learning) is high!
- s17n 4y agoThe problem with hiring programmers for learning speed is that even fast learners will take months to years to catch up to experienced people. If you’re doubling the size of your company every year, even without attrition, you end up with most of your code written by people who aren’t that good (yet).
- mixmastamyk 4y agoCode review is your friend in that situation.
- nradov 4y agoThis is under appreciated. Code reviews are valuable for quality control and even more valuable for technical training.
- deleted 4y ago[deleted]
- naniwaduni 4y agoConversely, if you discount learning speed, then you'll have "experienced" people who, even after years, are barely ahead of the starting line. If you keep them around, your code is going to be written by people who still aren't that good and never will be... Of course it'd be really nice get get one over on this regime by finding people whose bases alone are strong enough to carry, but if you're in the position where you're trying to make this trade-off you probably can't afford them.
- bumby 4y agoI think this makes the error that experience is proportional to time. Some people are just “experiencing” the same problems and attacking them the same ways for years and years and not really building any additional experience beyond the first time they encountered the situation. But maybe that’s why you put experience in quotes.
- nostrademons 4y agoI used to live by this philosophy when this article came out. But now I think it's a fairly imperfect model of the world that can lead you astray easily. The problem with it is that it's very easy to interpret that y-axis, "something good", as static. It's pretty hard to make sense of the model at all if you don't interpret as static, because your slope will bend all over the place, out of the plane, into multiple dimensions, etc. But once you've set your goal point, your "something good" axis, the natural temptation is to optimize your slope until you're steadily progressing against it. And that's dangerous, because you might forget that the "something good" axis was arbitrary to begin with. Instead, I've become much more of a fan of John Boyd's "OODA loop" [1] model. Here, you're continually reacting to your environment, which is also continually changing around you. And the person or organization that can react faster usually has an advantage, because they can set the terms of the engagement. We can call that adaptation "learning", but the key point is that it's learning an environment that is dynamic, not static. Sometimes the environment will change in a way that invalidates all of your accumulated learning, and that's okay (and you don't really get a choice about it anyway). This also drives home the point that choosing the environment you're adapting against is a pretty critical skill, and often dominates how well you adapt to it (i.e. your learning rate). I've seen some relatively mediocre people become billionaires because they picked the right industry and the right opportunity within it to join. Similarly, there are people who are brilliant problem solvers but end up in jail because the environment they are in rewards problem-solving that will get you sent there (think Omar from The Wire, or SBF from FTX). [1] https://en.wikipedia.org/wiki/OODA_loop https://en.wikipedia.org/wiki/OODA_loop
- d23 4y agoI think you’re basically making the same point he is. He even cites the environment change as an example (e.g. changing jobs).
- nostrademons 4y agoI think the additional point I'm making is that a 2D-graph necessarily biases your brain into ignoring the environment change, and that makes this a poor model to think about the world. Indeed, the other comment reply posted as of now still references the graph metaphor, but with S-curves instead of straight lines (which isn't really the point I was making - I'm trying to argue that your lines need to be in infinite-dimension space, regardless of their equation). You certainly can have environment change as an additional mental model you draw on when necessary - but if the quality of a model is in its ability to draw useful conclusions about the world from it, then conclusions which need to be corrected by some other model should be viewed with some suspicion.
- teo_zero 4y agoThe fallacy is to neglect how important the delta-x (the time it takes for the red curve to catch up) could be in some cases. An inexperienced-yet-eager-to-learn candidate could be an awful choice for your startup if your project has a hard deadline at the horizon!
- twawaaay 4y agoIt is old question of getting something right now or delay your gratification and get more in the future. If I learned anything from playing strategy games like Starcraft it is two things: "Agility wins almost always over bunker mentality" Be nimble. Ability to pivot quickly has a value. "You only take now what you need to survive plus a safety margin and use everything else to macro." Macro = investing in improving your income/production ability). Greedy = low safety margin. You can lower your safety margins if you can get better at gathering information.
- throwawaytemp29 4y agoIsn’t the integral of the blue curve higher though? Like if I want to maximize total utility over the displayed time the blue would be higher. Also time has value, getting something earlier is generally better due to compound interest. Even some vague utility function like fun can display such a property of being better earlier, due to being able to remember the memory for longer.
- jvanderbot 4y agoIt's wrong to integrate when the target value is the value of Y. The integral of everything youve learned and accomplished _is_ your y value. A double integral doesn't make obvious sense to me.
- CuriousCosmic 4y agoIs it? For example, if you take `y` to be quality of life, you obviously want the highest quality of life you can get but what really matters is the integral `Y` quality of life over the course of your lifespan. A steeper slope that starts you with a much worse QOL isn't inherently better just because the end of your life is spent with a high QOL. Doubly so as depending on how age effects your ability to do the things you enjoy or the experiences you form/retain, the true function you care about (let's call it `z` and `Z`) may decrease the impact of `y` with time. Even more so when you don't know what lies in your future and/or how long you'll be around. This applies to knowledge and utility as well. Your immediate utility `y` is an integral. It's the aggregation of your accumulated knowledge. However the integral of this, `Y` is the total utility throughout your life. You may be more immediately useful with the steeper red slope later on but you get more total work done with the shallower blue slope.
- jvanderbot 4y agoYou're taking an example that doesn't make sense in the context of the article. TFA is most likely intended to mean "progress" of some sort. The double integral of velocity means what?
- revskill 4y agoLearning something new is easy. Doing something in a productive way is hard and could take a very very long time. And this is the difference between learning and working. So this talk to me is more about learning, than hiring. When conducting hiring, one must be prepared enough for productive work, not just learning. I love companies which offers internship programs for new workers. It's to me is the best way of hiring.
- seizethecheese 4y agoPrevious slope is correlated both with y axis and future slope.
- cratermoon 4y agoInteresting that he doesn't mention anything about how starting high enough at the y-intercept means that you'll forever be above someone who started low enough, even if the slope of their learning exceeds yours.
- Jtsummers 4y agoExcept he does allude to it: > unless you think you're going to die before you get to the crossing point Though based on the comments in this discussion I think a lot of people missed that statement.
- cratermoon 4y agoIt's important to recognize that the persistent Horatio Alger Jr "bootstraps" sentiments in the US means that everyone thinks they can catch up before they die or age out of the work force. This pernicious delusion keeps society from acknowledging and addressing the differential.
- lifeisstillgood 4y agoThe thing this fails on, the thing a lot of academically minded people fail on, is that knowing things is at best half the battle. There are very few areas of life (academia being the stand out) where knowing things is sufficient. To build something almost always requires organising other people which requires co-ordination with, alignment with, persuasion of other people. Two founders - one technical, one "politician" (sales, film producer, fixer) And there is no "fast learning" there. In fact I think it is the very opposite of the kind of focus that learning needs - you need to spend time with, talk with people.
- n_eutrino 4y agoThe effort of keeping learning new knowledge everyday is applausable. But the real world life is, your current knowledge base highly determines your horizon and how efficiently and broadly you learn new things.
- vsareto 4y ago>I think this is a pretty good guideline for life also. I suspect if the y-intercepts were faithful measurements to real life starting points, the y-intercepts would be very distant and he might reconsider this viewpoint. You get a huge boost on this hypothetical graph by having rich parents and going to good schools and gaining valuable connections during that process. Bonus, the quality education might even help your learning speed too. This seems like advice for people who need it the least.
- LastTrain 4y agoExcept that in life, slope is often a function of y intercept. That is, the higher you start, the better your chances for higher slope. So yeah, that intersect is mostly fantasy. Reach for the stars and all that though.
- _nato_ 4y agoI always thought this was a paul-grahamism...
- xrd 4y agoI lived in Japan when I was in high school for a year. I went without knowing a word of Japanese. After I was there for a week, I tried out konnichiwa on a few ten year olds in the neighborhood. They howled with laughter and I felt so ashamed. I was a Rotary student there. Most of the other Rotary students came with a few years of Japanese study under their belt. I was better than all of them within three months. The first takeaway was that it was harder for them to unlearn bad habits they learned when studying Japanese back in the US. A kid in class would mispronounce something, and because that kid often did that from the same perspective as the rest of the class, it was sticky. You learned bad habits easier than good ones. And, it was really, really hard to unlearn those bad habits. I never had that problem because I only heard Japanese from natives. A corollary to all this: if you want to learn a language, living there is 100x better than any other method. Not the most practical, but it's the best way.
- robocat 4y agoMy advice: listen to people who have learned English-as-second-language, and watch for the patterns in their mistakes AND patterns to the successful learners. We are very finely tuned to hearing mistakes in our own language, so we can at least recognise errors. Watch why they don’t learn to correct glaring mistakes. Watch how highly skilled learners pick up the language. While we are learning another language, it is very hard to recognise our errors, or diagnose or systematic errors. There are systematic patterns to our mistakes, and a lot of mistakes are inherent in the way languages are usually taught (reading before learning conversation being a #1 issue). Also watch how babies and children learn, and try to replicate that as much as possible. I learned conversational Spanish reasonably well, which was in part motivated by having a patient girlfriend whose mother-tongue was Spanish. I met a Japanese guy with fantastic English, who had learned English by living in East London and Australia, and it was amazing to hear his accent change mid-sentence from perfect Cockney to perfect Ocker, especially for phrases and colloquialisms. A demonstration of the power of mimicking via ear, not via writing.
- wanderingstan 4y agoA similar lesson served me well when learning German while living there. My German pronunciation (and some grammar) improved in lock step with my ability to mimic a thick German accent in English. Being able to systematically reproduce typical German “errors” in English taught me how to speak correctly when I switched to pronouncing German words.
- j7ake 4y agoA related "math truism" is that the Taylor expansion of the exponential function is e^x = 1 + x + x^2 / 2 ... This means that, if a process like skill development is growing exponentially, then when zoomed in at very small times (e.g. daily), growth looks flat. But if looked at longer times, it starts to look linearly increasing. Then finally when looked upon after many years, things look exponential. It's also related to the quote that people overestimate progress in the short-term but underestimate it in the long-term.
- aix1 4y agoI understand Taylor expansion and that we're not talking rigorous maths here. However, what I don't get in your example is the implied connection between the timescale and the order of the Taylor polynomial. Could you elaborate?
- j7ake 4y agoTruncating the Taylor expansion after the first term says exponential y = exp(t) can be approximated as y_approx = 1 which is a constant. This is true if you zoom in around t=0 far enough. Then as you zoom out, you have to include higher order terms to account for the exponential increase.
- froj 4y agoThe whole point of exp(t) is that the derivative at t is equal to the value at t. Thus if y_approx = 1 then the derivative is also 1 and not 0 (i.e. constant). If you're exponentially growing, but currently it's approximately constant, then you're at t = -inf and you'll probably be dead by the time you achieve something significant.
- deleted 4y ago[deleted]
- j7ake 4y agoYeah the constant is a poor approximation of the exponential. Maybe the analogy works better if I start at the second term . Zeroth order approximations are rarely useful because the dont capture the local gradient. But in the life analogy, there are people who assume where they are in life will be same in future (eg the “new” normal during pandemic). So maybe it’s not so terrible after all.
- kazinator 4y agoI remember that in the middle 1980's, U-Haul vehicles and trailers advertised $19.95 daily rates, painted right on them. Today, if you see a U-Haul, it sports the same $19.95 day. Lesson in fixed cost vs. variable. https://live.staticflickr.com/208/442280529_898a6b1f8e_b.jpg https://live.staticflickr.com/208/442280529_898a6b1f8e_b.jpg
- pimlottc 4y agoI’m not sure what your point is here?
- dcreater 4y agoIt's not about your y, let alone your y0, it's about your dy/dx
- conobpn 4y agoThis is the sort of simplistic analogy that excites and inspires students who know nothing of the real world. They'll soon realise its flaws when they step out of the ivory tower.
- sambapa 4y agoThere is no need to overtake someone, learn for the sake of learning. You are not worse than someone else because you know less and you are not better because you know more. We're all gonna make it brah.
- jcutrell 4y agoI’ve expressed a similar thought with reference to impostor syndrome - velocity vs acceleration. Early in your career you learn at a rapid pace. You are accelerating. You can feel acceleration. But naturally as you continue, the amount of knowledge you have and can wield on a given day is substantial, yet for many it doesn’t change very quickly. You may be accelerating, but it’s slight relative to your velocity. It would take a deceleration to appreciate the knowledge you have gained. This is somewhat of an antagonist perspective to the OP, but I find it helpful, as the learning curves of a given individual describe a logarithmic function most usually, which I believe is the major underlying cause of impostor syndrome.
- fnord77 4y ago[Laughter]