mochomocha

11 ms·

91.
by mochomocha 4y ago
The tone of the post is pretty off putting. It reads as a "look how smart I am!" article - the author doesn't even pretend to be modest.
92.
Scenario: AI-Generated Game Assets(scenario.gg)
2 points by mochomocha 4y ago|0 comments
93.
by mochomocha 4y ago
Regarding denormal/subnormal numbers mentioned as "weird": the main issue with them is that their hardware implementation is awfully slow, to the point of being unusable for most computation cases with even moderate FLOPs
94.
BioNTech Acquires InstaDeep(techcrunch.com)
2 points by mochomocha 4y ago|0 comments
95.
by mochomocha 4y ago
Because enforcing the law is the basis of a functioning society? If citizens don't like the laws, it's in their power to change that (assuming of course a functioning democracy where elected officials are not just vessels for corp
96.
by mochomocha 4y ago
Seeing the GOP trying to repeal the IRS funding boost as soon as they have majority in the House, it's hard not to become cynical about how corrupt our politicians are. The latest CBO report [1] estimates that extra IRS funding has an
97.
by mochomocha 4y ago
The number of companies ready to spend $40M/year of compute per "average ads model engineer" is exactly 0.
98.
by mochomocha 4y ago
I think the author downplays the significance his work because it only applies to "small neural networks". There are a lot of use-cases that can benefit from this type of optimizations. Discovering how to use an undocumented fast
99.
by mochomocha 4y ago
The analogy doesn't have to hold on every possible behavior of the two entities compared for OP to have a valid point.
100.
by mochomocha 4y ago
If you're going to correct someone, you'd likely want to do it right: he did not want to spend that kind of money after having agreed to do so in a legally binding way . Mark of a business genius who is definitely not impulsive
101.
by mochomocha 4y ago
It's definitely not an idiotic approach, and companies do keep buffers. In the most advanced cases, probabilistic models are devised to estimate how big these buffers should be. Asking for companies to keep buffers for unpredictable &q
102.
by mochomocha 4y ago
Yep. Much harder to be the one bearing the responsibility of the calls being made than being an armchair commentator complaining about the decisions. I don't anticipate that he'll be any more successful at this than other leadersh
103.
by mochomocha 4y ago
The biggest surprise to me from this article was learning that Levandowski is not in jail anymore and back at it. The whole article reads like free publicity for him and his new company, and is light on data backing up the claims (beyond us
104.
by mochomocha 4y ago
In a soon-approaching world where all movies have deep-fake actors, popular music is generated etc. how do you approach the economics of creativity and content generation? Should Tom Cruise heirs receive a perpetual rent 200 years from now
105.
by mochomocha 4y ago
Yes, but I don't think SF is an exception here. The whole Bay Area is a NIMBY nest that looks frozen in time with infrastructure similar to what was in Europe in the 1950s. That's how my SF neighbor pays 30x less property tax than
106.
by mochomocha 4y ago
I have a non-pro version, but I can definitely relate to the "too slick, it randomly slides" problem - especially bad because the back camera protrudes. It's pretty ridiculous, my phone ends up on the floor multiple times a d
107.
by mochomocha 4y ago
Subnormals in particular I think are a pretty big failure of the IEEE standard, in the sense that because their implementation is very slow & varies across architectures, the only time most people learn about them is when they're h
108.
by mochomocha 4y ago
I think the theory you're describing is pretty interesting, I had never thought about depression this way.
109.
by mochomocha 4y ago
Categorical variables in the datasets of large tech companies can take a lot of different values.
110.
by mochomocha 4y ago
I've put in production numerous models with millions of tabular data points and a 10^5-10^6 feature space where tree-based models (or FF nets) outperform more complex DL approaches.
111.
by mochomocha 4y ago
> Why Should I Pay for Peak Load? [...] someone in that supply chain is charging you based on their peak load Oh it's even worse than that: this someone oversubscribe your hardware a little during your peak and a lot during your tro
112.
by mochomocha 4y ago
As someone eagerly waiting for his Prophet5 Rev4 to arrive by mail by the end of the week, this reassures me :) Been playing on software versions of the Prophet5 for years and I finally made the jump and bought "the real thing".
113.
by mochomocha 4y ago
Amazing how fast the US is turning into a populist autocracy.
114.
by mochomocha 4y ago
Given that cloud providers oversubscribe their rack power supplies for $ reasons, I'm waiting for the cloud-level equivalent of this DVFS attack, where you throttle a competitor cloud instances by bursting on collocated instances of yo
115.
by mochomocha 4y ago
A friend of mine didn't get a promotion at Google because he was told that though his work generated >1B of revenues for the company, it was not "hard enough". He left the company.
116.
by mochomocha 4y ago
Can you expand on why you find AVX512 instructions more innovative? I haven't had a chance to try SVE yet, but on paper it sounds very innovative and offers a wide range of new capabilities. Gather/scatter have been around for a w
117.
by mochomocha 5y ago
Right, all this overhead is very pytorch specific and doesn't have to be present in all cases. If you resolve everything at compile-time for a limited class of cases (which is what vectorflow does), it's possible to have a solutio
118.
by mochomocha 5y ago
If you're loading the model for every prediction, you're doing something really wrong. Pre-processing and post-processing are indeed usually trumping the core computation itself, but as you mentioned it's not done in the NN.
119.
by mochomocha 5y ago
It's not developed anymore. I still have a service in production using it: estimating the distribution of runtime of any container we launch, through joint conditional quantile regression (output of the net is p5, p10, ..., p95 of the
120.
by mochomocha 5y ago
Would you mind defining "overhead"?

More ›