4 ms·
There's something I like to tell people: "You don't need math to make a good model, but you need math to know why your model is wrong." All models are wrong, an
by godelski 3y ago
There's something I like to tell people: "You don't need math to make a good model, but you need math to know why your model is wrong." All models are wrong, and actually one of the crucial points we're at is not enough concentration on how wrong our models are (or how wrong our evaluations are, which is also a type of model). I suggest also investing time in statistics, understanding higher dimensional spaces (topologically and statistically), and metric theory.
It is always a "stab-around in the dark" unfortunately, but the deeper your mathematical understanding is the brighter your candle burns to help you poke around. I think a lack of mathematical understanding has also made people misread Sutton as endorsing "scale is all you need" rather than "flexibility combined with scale has historically resulted in the largest gains." These things are very different.
- tysam_and 3y agoHa! I think we may be on the same page with Sutton, that and the misuse of the NFL theorem are the two disclaimers I put out the most. My most recent Sutton one was ~3 hours ago! (https://news.ycombinator.com/item?id=37129921#37151192 https://news.ycombinator.com/item?id=37129921#37151192). That's a really good point, and I stand corrected. I guess it is still very much stabbing around in the dark, just with some more information about the probability density function of good answers. Heck, even Terry Tao's post about how to solve problems shows very much a (refined) guess-and-check method, so I have quite little ground to stand on there. Metric theory is fun, and one I'd like to learn a lot more about. I certainly have a lot to learn there.
- godelski 3y agoYeah I think the nature of research is de facto searching in the dark. I mean if it weren't, would it really be research? I think of the analogy as the knowledge space is a dark void and our collective knowledge is permanent torches lighting up the area. Researchers are exploring into the darkness and finding suitable places to place the next torch. Maybe we can say that the torch's brightness is defined by how well known your work is, since people tend to the flames more (not to be confused with how important the work is). The big question to me is about the geometry of that knowledge space. Is it bounded? If bounded (most likely imo), how do we approach the bound? Do we plateau once we hit it (unlikely imo)? Do we approach {,sub,super}-linearly? Do we approach {,sub,super}-linearly and then transition into an asymptotic convergence? (e.g. S-curve) This question actually has a profound impact on the question of the risk of a super-intelligence. IMO knowledge is most likely bound ( and most likely looks like an S-curve. If we're more than half way through that S-curve than a super intelligence that is 100x smarter than us may only know <100x as much as us, which we have good reason to believe that this is the case since knowledge appears to compound and accelerate (linear and sublinear models don't fit our historic trend, but that doesn't tell us the shape of the curve ahead). That reduces the risk of a super intelligence absolutely outsmarting us since it would be easier to close the gap, especially since learning through observation is easier than learning through exploration (can use its torches, even if they are more difficult to see). I'm not sure I see this really discussed much in the super intelligence conversations and that we're often working with different priors so that creates fundamental disagreements that become impassible. Maybe we need to set these priors first before we even discuss the next priors about motivation of a super intelligence. At least for math, I don't think I have the capacity to learn it all in the short human life, even if we're just discussing what math would be helpful to ML. But it sure is fun to learn it, so I guess the inability to learn it all is not really a downside :) Now if only I can convince others that math is fun __and__ useful to ML.
- eointierney 3y agoThis is well put. Mathematics is our candle in the darkness of our understanding, and the more math we know the brighter our candle flames. But Mathematics is not a candle, it is the purest analogy we have ever encountered, and it enlightens our minds. It gives us an appreciation of scale, and measurement thereof, that is unmatched, yielding deep insights into itself and everything else. I just wish everyone learned number theory and geometry and algebra and physics and and and... I just wish everyone would read the Road to Reality by Penrose. Models are little stepping stones that are slippy and unsure, but we must use them to take further steps into the darkness of our ignorance.
- godelski 3y ago> I just wish everyone learned number theory and geometry and algebra and physics and and and... I'm less concerned with everyone having knowledge as much as I am concerned about everyone acting like an explorer and finding joy in the exploration simply for exploration's sake. Having targets and goals are good, we probably shouldn't always wander aimlessly (though this shouldn't be discouraged!), but concentrating too much on the target takes away the joy and makes us miss many beautiful things. I cannot find a stone that was turned which didn't end up providing utility, even if it didn't at the time. The competition can make the game more fun, but too much ruins it. It makes us loose sight that it is a game in the first place and why we play. We enrich the lives of ourselves and others by playing it, but we can also have full lives were we to all stop. I think we sometimes forget why we're playing and just do because others are or because personal gains. It's like trying to pick winners in a cooperative never ending game. Reminds me of my friend who would jokingly ask "did you win" when I mentioned a recent game of DnD. The fierce competition also discourage others from playing, but I just wish I could show them how beautiful and awesome this game is. To not let some assholes ruin our fun. I think currently we have lost sight of why we play the game and are too caught up in figuring out who the best player is. In reality such a thing is non-determinable due to the system complexities and timescales. I also don't really see any good utility other than an ego boost but comes at the cost of hyper-focusing on temporarily near outlook rather than exploring further. We need many types of explorers and I'm not quite understanding why we've structured the system to reward only one type. Simplicity?