JHonaker

20 ms·

151.
by JHonaker 6y ago
Unfortunately, it's just something you start to notice once you become more familiar with the fundamental math underlying all of this. The book, Machine Learning: A Probabilistic Perspective by Kevin Murphy (the original book everyone
152.
by JHonaker 6y ago
Graphical models are just a way to encode relationships between different variables in a probabilistic model. Directed acyclic graphs (DAGs) allow you to specify (most of) the conditional independence structures that you can have between th
153.
by JHonaker 6y ago
I don’t know. Some people don’t like Sanderson. I love him. I still need to get around to finishing Wheel of Time just so I can get to his parts. I really wasn’t crazy about Dune Messiah. It was just okay. The whole prescient man that can’t
154.
by JHonaker 6y ago
I mean, as a graduate student, it was definitely incredibly useful. As a practicing data scientist, I’d have to say that it’s also incredibly useful. I’ve used this stuff, and more often, the ideas taught, to break down a problem into a tac
155.
by JHonaker 6y ago
I'm about halfway through both of these, but I think they're both great. Rhythm of War by Brandon Sanderson (Book 4 in the Stormlight Archives series) Love him, or hate him, BS is prolific. He somehow maintains a superhuman level
156.
by JHonaker 6y ago
Wise Man's Fear is also excellent. The Slow Regard of Silent Things was... interesting. I wouldn't say it was bad, but I definitely think it's a love it or hate it kind of book/novella. I liked it, but your enjoyment of
157.
by JHonaker 6y ago
This is probably my favorite introductory machine learning book. The fact that he places almost everything in the language of graphical models is such a good common ground to build off. This really sets you up to realize that there is (and
158.
by JHonaker 6y ago
In the section title, JAX: > But JAX even lets you just-in-time compile your own Python functions into XLA-optimized kernels...
159.
by JHonaker 6y ago
Bayesian network is a synonym for directed graphical model. Any time you see graphical models, they’re usually BNs. Undirected graphical models are very closely related too (all directed models can be represented as undirected models, but n
160.
by JHonaker 6y ago
Belief propagation is hard to parallelize because, in its basic form, it’s a sequence of serial computations. If the graph is a tree, though, then it’s actually pretty easy to parallelize. The only issue is you have to wait for all the inco
161.
by JHonaker 6y ago
The future is truly now [1]. The detail on this. [1]: https://imgur.com/a/VwuLdbi
162.
by JHonaker 6y ago
Great! Don’t worry. I have an MS in biostatistics and I’m in my sixth year of a PhD in statistics. I and everyone I know struggled with these concepts for a really long time. It just takes time and some hard work. It’s hard, unintuitive stu
163.
by JHonaker 6y ago
There are two main reasons why frequentist[1] methods are losing popularity: 1. Your tests make statements about some pre-specified null hypothesis, not the actual question you’re usually interested in: Does this model fit my data? 2. The p
164.
by JHonaker 6y ago
I mean, don’t just take my word for it. Here’s Yann LeCun [1]. I will concede that I forgot about DeepFakes. How’d I do that? But still, cool now we can live in a dystopian future. The point that I was trying to make still stands. Assuming
165.
by JHonaker 6y ago
I’m tired of Hinton over promising. It’s not going to do everything and he’s promoting an irresponsible position. Has there really been a huge breakthrough since the initial wave of CNNs? I guess transformers/attention, but I don’t con
166.
by JHonaker 6y ago
This is great. The one thing that is a little unsatisfying with a lot of examples of Q-learning is that the environment is fixed. The utility functions are owned by the square, not the agent (i.e. not a function of any local awareness). For
167.
by JHonaker 6y ago
I have had a Paperwhite for years, probably close to 10. I recently upgraded to an Oasis for my 30th birthday. It was an incredible improvement. The noticeably bigger screen is crisp and incredibly responsive. I and my wife had just gotten
168.
by JHonaker 6y ago
Julia is dynamic. I've described this before, but the type annotations are used for multiple dispatch, not for static type checking. The quick example of why this is powerful is multiplication: # Assume you only have addition defin
169.
by JHonaker 6y ago
> As [one] math major to another, there are interesting problems everywhere and literally all people are interesting and full of problems. Add me to that list as well. I originally started graduate school with dreams of moving to Califor
170.
by JHonaker 6y ago
Oh I’m not saying that it’s a bad thing to want static type checking. I’m just saying that the type annotations in current Julia are absolutely not for that. It’s for multiple dispatch and for helping the compiler choose optimize your code.
171.
by JHonaker 6y ago
> Editors (Juno) do not check types at runtime when the information is readily available This complaint is really common with people that see types and expect them to do something like TypeScript. Julia is not a statically typed language
172.
by JHonaker 6y ago
I've been working my way through Beautiful Racket [1] over the last week or so. It's been awesome. If this kind of thing is of interest to you, I highly recommend it. It's a book focused on a way of thinking that involves bui
173.
by JHonaker 6y ago
Yea, CRFs and graphical models in general are extremely versatile! It’s a shame more people don’t think about them. The major problem with them is computation, but there are approximate methods like belief propagation, expectation propagati
174.
by JHonaker 6y ago
Yea, this would be a great resource if it exists. I constantly have to point out to project managers that neural NLP models by and large have very different goals than they do. If you’re not trying to do something that amounts to computing
175.
by JHonaker 6y ago
Press O (capital o), then click and draw the corners of a closed polygon. You have to click on the original corner to close it.
176.
by JHonaker 6y ago
> Statistics has probably done more damage to the world than any other discipline, by giving a sheen of respectability to fake science in fields like nutrition, psychology, economics, and medicine. I think it's unfair to represent t
177.
by JHonaker 7y ago
> Something that intrigued me in Saxton et. al.’s paper was how high a baseline transformer scored on probability tasks (~0.77 and ~0.73), given that working these out are a multi-step process. How could basic pattern-matching score so h
178.
by JHonaker 7y ago
What do you write about?
179.
by JHonaker 7y ago
I read the article a long time ago, so I don’t remember what you mean by the ANKI method. Anki is a program that assists you by automatically serving you cards. The article is quite long, but very good. I’ve given 3 examples in some other r
180.
by JHonaker 7y ago
It’s usually just a problem and sometimes a simple example I can write as a test case for correctness. Some cards I’ve put in lately are: Calculate the level of a binary tree with the minimal sum of its elements. Reconstruct a binary tree g

More ›