4 ms·

This pattern comes up a lot in comments on this type of post. Author makes a dumb but easy-to-follow example to make a point, and then someone points out how th

This pattern comes up a lot in comments on this type of post. Author makes a dumb but easy-to-follow example to make a point, and then someone points out how the example is dumb. Try to avoid getting hung up on examples -- in this case nobody reading this post should come away thinking they now know more about cosine similarity than a library author. I dare say the author's main points were: - it's not that much code - it's not terrifyingly hard to understand - you might open up performance benefits in your specific circumstance just by knowing how it's calculated after writing the code to do it yourself

exmadscientist 5y ago
> in this case nobody reading this post should come away thinking they now know more about cosine similarity than a library author However, if this post leaves you open to the option that you might know more about $THING than a library author... that is probably a very healthy possibility to consider. (Consider. Some are that grad student who got assigned to write the library because they were too useless to do anything else. Others are David M Gay.)
- inimino 5y ago
  Indeed! That you should be optimistic about it is the best thing to take away from the post.
- username90 5y ago
  Beating library implementations is usually very easy since you know your use case perfectly and they don't. You need to be way less competent than them to not be able to do something better when you write a tailor made solution. The main reason not to do it is that it takes time and makes the code harder to get into for new hires.
queuebert 5y ago
Lest you think mine was a shallow, knee-jerk analysis, this is my area of subject matter expertise. I get all the nuances, but I just felt like defending library authors, whom he unjustly threw under the bus, because that stuff is really hard. Like really hard. Also, if you are using libraries written by grad students, then you probably need to find better libraries. All of the major battle-hardened ones like BLAS, LAPACK, CUDNN, TF, FFTW, etc., have had major big brains looking at them for years. Decades in some cases.
- inimino 5y ago
  I didn't read it that way. I took the audience to be more junior programmers to whom numeric library code can seem inscrutable and terrifying. In my experience "write it yourself first" is very liberating advice that every programmer should take to heart. I would also cut the author a little slack since he is a library author and the post is a kind of ad for his own numeric library. It could have been worded better though.

exmadscientist 5y ago

> in this case nobody reading this post should come away thinking they now know more about cosine similarity than a library author However, if this post leaves you open to the option that you might know more about $THING than a library author... that is probably a very healthy possibility to consider. (Consider. Some are that grad student who got assigned to write the library because they were too useless to do anything else. Others are David M Gay.)

inimino 5y ago
Indeed! That you should be optimistic about it is the best thing to take away from the post.
username90 5y ago
Beating library implementations is usually very easy since you know your use case perfectly and they don't. You need to be way less competent than them to not be able to do something better when you write a tailor made solution. The main reason not to do it is that it takes time and makes the code harder to get into for new hires.

queuebert 5y ago

Lest you think mine was a shallow, knee-jerk analysis, this is my area of subject matter expertise. I get all the nuances, but I just felt like defending library authors, whom he unjustly threw under the bus, because that stuff is really hard. Like really hard. Also, if you are using libraries written by grad students, then you probably need to find better libraries. All of the major battle-hardened ones like BLAS, LAPACK, CUDNN, TF, FFTW, etc., have had major big brains looking at them for years. Decades in some cases.

inimino 5y ago
I didn't read it that way. I took the audience to be more junior programmers to whom numeric library code can seem inscrutable and terrifying. In my experience "write it yourself first" is very liberating advice that every programmer should take to heart. I would also cut the author a little slack since he is a library author and the post is a kind of ad for his own numeric library. It could have been worded better though.