oldesthacker

5 ms·

1.
by oldesthacker 3y ago
This is what Tomas Mikolov said on Facebook: > I wanted to popularize neural language models by improving Google Translate. I did start collaboration with Franz Och and his team, during which time I proposed a couple of models that could
2.
by oldesthacker 3y ago
The results of Table 3 are not really exciting. Could this change with 100 times more data? The key novelty in the specific context of this particular application is the quantized variational encoder used "to derive discrete codex enco
3.
by oldesthacker 3y ago
Let's take an example: his "unnormalised linear Transformer," a neural network with "self-attention" published in 1992 under another name. It wasn't just an idea, it was implemented and tested in experiments. H
4.
by oldesthacker 3y ago
> Isn't that exercising political capital? These are very good points. > ... the worst of many abusers of the citation system. Is this ad hominem argument by user "lacker" meant to distract from the omissions of the awa
5.
by oldesthacker 3y ago
Thanks! Of course, the silverbacks! No offense.
6.
by oldesthacker 3y ago
The machine learning field as a whole has a huge credit assignment problem. This post seems to encourage other ML researchers to come out with their own priority disputes. Tomas Mikolov just aired his grievances: > I wanted to populariz
7.
by oldesthacker 3y ago
How new is this insight? The failure of teams of highly capable individuals is often due to egocentric silver-haired gorillas in the room: >They spent excessive time in abortive or destructive debate, trying to persuade other team member
8.
by oldesthacker 3y ago
> It was all about the economics, all the way back from early 90s. We cant do x node because it would be too expensive to sustain it at a node every two years. Totally agree. > AI trend could carries us forward to may be 2035. But we
9.
by oldesthacker 3y ago
Interesting bit about Samsung’s secret sauce: Samsung went even smaller than Intel, showing results for 48-nm and 45-nm contacted poly pitch (CPP), compared to Intel’s 60 nm, though these were for individual devices, not complete inverters.