jing

6 ms·

1.
by jing 2y ago
No it can’t. That’s d to d
2.
by jing 7y ago
In practice the functions just need to be piecewise differentiable. The RELU is the canonical example for deep learning. At kinks a subderivative is used.
3.
by jing 7y ago
Why not just get the 7702p?
4.
by jing 7y ago
Actually I'm pretty sure the Rome numbers are for double precision whereas most numbers quoted for GPUs are for single precision or less, making Rome's 3.4tf even more impressive.
5.
by jing 7y ago
https://www.fast.ai/2018/07/02/adam-weight-decay/
6.
by jing 7y ago
Particularly since it would not be unreasonable to assume that the "mi" in mimalloc is incorrectly pronounced like the "mi" in Microsoft.
7.
by jing 7y ago
Yep. And Mellanox does it too fwiw - https://community.mellanox.com/s/article/vma-improves-redis-...
8.
by jing 7y ago
I've got the 9550 and run Ubuntu on it. No issues whatsoever and I do very compute-intensive work on it. One thing that I've found is very important is to clean out the fans often, otherwise dust builds up and prevents cooling.
9.
by jing 8y ago
I think this resource could be helpful: http://colah.github.io/posts/2015-08-Understanding-LSTMs/ Essentially, RNNs and feed forward networks are very similar - RNNs are just "unrolled through time" and
10.
by jing 8y ago
Note that it's not just the loss function. It's the loss function combined with a very specific problem formulation - namely a neural network with only linear activations (equivalent to a 0-layer network). Once you go to non-l
11.
by jing 8y ago
I find it hard to believe that SGD would be faster than the closed form solutions for linear regression (gels, gelsd etc.). The closed-form solutions give a lot of other benefits in practical settings as well which makes them more likely t
12.
by jing 11y ago
The Xeons support much more RAM.
13.
by jing 11y ago
Are physics engines not yet accurate enough to enable "virtual" pre-training / full training of the networks, lighting conditions, etc? If they are, exclusively using physical robots seems somewhat inefficient.
14.
by jing 11y ago
DAC is an order of magnitude cheaper than optical and might be fine for their use based on their comments of cat6 v cat6a and "short runs in their lab". Also, if they are using two or three NICs per box, you'd need to factor
15.
by jing 12y ago
Some claim that this is part of a broader trend of "generational theft" from the young to the old and have some interesting slides to demonstrate their thesis: http://online.wsj.com/news/articles/SB100014
16.
by jing 12y ago
The pairing idea isn't new although it does seem to be very successful - there's a company called Thinkful ( http://www.thinkful.com ) that does online learning by pairing a mentor who gets paid with every student who si
17.
by jing 16y ago
ZFS may have been, but not the 128 bit support. I mentioned that there are "admittedly much more relevant features" which are in fact what smugmug likes: "ZFS is the most amazing filesystem I’ve ever come across. Integrated volume manageme
18.
by jing 16y ago
Yes, this is theoretically cool and all, but when I hear something like: "Let's start with the easy one: how do we know it's necessary? Some customers already have datasets on the order of a petabyte, or 250 bytes. Thus the 64-bit capacity
19.
by jing 16y ago
A recent HN post which may be helpful for you: http://news.ycombinator.com/item?id=1752139
20.
by jing 16y ago
Here's a few I've really liked that have a broader subject matter than only what you asked for. I figure that if you like to read you'd like these books. --- NON-FICTION --- Darkness Visible A Mathemematician's Apology Omnivore's Dilemma
21.
by jing 16y ago
I'm curious - you say, "A do-it-yourself wedding invitation kit costs $45, while professional wedding invitations are hundreds or thousands of dollars." How much of that "hundreds or thousands" is in the actual printing vs. the design + mar
22.
by jing 16y ago
If it was profitable to harvest / clean up the spill, wouldn't BP be doing it already? For that matter, wouldn't all of its competitors such as Exxon be doing the same as well?
23.
by jing 16y ago
Exactly. Unfortunately, since Palantir is in the enterprise space, few people on HN immediately know of the how 1) cool and 2) difficult the problems and solutions in the space are. And of course, this post hast immediately degenerated in
24.
by jing 16y ago
I don't mean to sound rude, but your comment shows how little you know understand about securities, investing, risk, and reward. Of course nobody comes in asking for "crappy mortgages". Pension funds, endowments, etc. have certain investin
25.
by jing 16y ago
Does that mean that we should throw the CEO of McDonald's in jail too because he knowingly sells junk food to customers? No, we shouldn't. And the reason is that people are free to buy whatever food they want. If they want shitty fast fo
26.
by jing 16y ago
This article is so incorrect that it's a joke. I guess there's a reason why Michael Lewis and Maria Bartiromo don't talk about the differences between splice() and sendfile()...
27.
by jing 17y ago
Charity isn't always about being as "effective" as possible. People there are literally dying from not having food, water, and medical care. I hate to say this on hacker news, but not everything is a numbers game. Haiti is in a humanit