Radim

63 ms·

541.
by Radim 9y ago
On the topic of "likely exhausts memory": The best search methods allow reversible state updates. The reversibility makes things super-fast -- you no longer need to copy all data structures on path expansion. Instead, you modify
542.
by Radim 9y ago
Off-topic, but lisper , congrats on your neat HN karma points! It's 222-2222 I gotta answering machine that can talk to you
543.
by Radim 9y ago
Alright man, good luck. I know HN can be brutal. But this was really not your best piece (technically; it may have met its marketing / traffic goals).
544.
by Radim 9y ago
Even vectorized operations still have to go through every data item. I'm not sure what you imagine happens inside pandas, but I assure you it's not magic.
545.
Ravens Are So Smart, One Hacked This Researcher's Experiment(motherboard.vice.com)
7 points by Radim 9y ago|0 comments
546.
by Radim 9y ago
Nice :) Interestingly, the O(n) Python is still about 4x slower than the O(n) Pandas -- the same relative difference as in the original O(n^2) implementations from the blog post. So despite the mishaps of this "Senior IT Business Analy
547.
by Radim 9y ago
That doesn't look faster -- 60ms? Nor clearer, at least to me :) Additionally, you might have a bug in the code: groupby() only groups consecutive keys, so your code will fail if the dataset is not already sorted by product_id. I gue
548.
by Radim 9y ago
Well pandas iterates through every row anyway, just in native-land rather than pure Python. That's not the difference. The trouble with this code was the choice of the quadratic algorithm (which the idiomatic pandas version avoids). Yo
549.
by Radim 9y ago
No comment on the poor implementations (why quadratic complexity, in all three cases?), but some general notes: For reporting benchmarks, you probably want the minimum , rather than average. While keeping an eye on the distribution/va
550.
by Radim 9y ago
I think you hit the nail on the head there. This is also what makes "social networks" so frustrating to technical people: it's not about your idea or even its execution. Rather, it's about how many other apes you've
551.
by Radim 9y ago
Same thing happened with Berkeley in the US: originally "Barclay", and still pronounced "Barclay" in the UK.
552.
by Radim 9y ago
For people interested in this kind of stuff, Guy Deutscher's book "The Unfolding of Language: An Evolutionary Tour of Mankind's Greatest Invention" is a fun read! As is the "The History of English" podcast [0],
553.
by Radim 9y ago
Because it quite obviously does, even by your own admission. Are you arguing against yourself now? That reddit post is clearly tongue-in-cheek, written consciously in an exaggerated voice to spark interesting discussions (which it did) -- n
554.
by Radim 9y ago
What resonates with people, and why, is a rather deep question. Indicative of an arbitrage opportunity (lucrative), if you can really get to the bottom of it. It would befit someone of your intellect to try to figure out why the post was so
555.
by Radim 9y ago
Previous HN discussion: "Why can't you guys comment your fucking code" https://news.ycombinator.com/item?id=14692691 Copy&pasting my response there: --- Why is code coming out of research labs/univer
556.
by Radim 9y ago
"A bit" error prone? We copied the (100% pirated) cassettes very carefully in CZ, never mind recording fancy radio waves. And it was still unreliable as hell! The magnetic cassette loading was sometimes more suspenseful than the a
557.
by Radim 9y ago
We run an Incubator for university students, helping them bridge the gap between "academic" and "useable" code, so I have to deal with this topic all the time. Why is code coming out of research labs/universities so
558.
by Radim 9y ago
Or let me phrase this differently. You seem to have this image of an honest academic, toiling away on OSS at nights, standing up to committees like Galileo, the proverbial Travis. You'd like to help him lessen his burden by a better re
559.
by Radim 9y ago
I like this format. Now that the post slid off the main page, it's more quiet here and we can discuss at leisure :-) Sustainability of open source is a topic close to my interests and line of business. First, I'd question that a &
560.
by Radim 9y ago
Well, that was my initial reaction, honestly. It's great for you that your reaction was different, but it's not like anyone chooses their initial reaction. How is criticising me for it constructive? I only wish the best for Dani
561.
by Radim 9y ago
I wasn't the only one by the way, and NIPS moved away from Canada the following year.
562.
by Radim 9y ago
With all due respect, the career trajectory of Travis Oliphant (&co) has been nothing but spectacular! He's extremely accomplished, respected and (I hope) compensated. You're kinda undermining your own point there :-) In any c
563.
by Radim 9y ago
It's popular to poo on USA these days, but I had a similar experience with Canada. I was about to present at NIPS (a ML conference in Vancouver) in 2010, but was denied visa (Czech citizen - EU). No reason given. Those pesky PhD comput
564.
by Radim 9y ago
That's an easy one -- because they don't have to :-) In some cases, "paying extra" without being asked to might even be compromising your fiduciary duties. I feel the open source movement has spoilt its "user base&q
565.
by Radim 9y ago
Is the idea that "foundational work" (in any field) can be done without "huge sacrifices" widely accepted? It sounds a tad unrealistic to me, unsupported by history. It's as if people want to have it both ways: Crea
566.
by Radim 9y ago
Correct. It's a lose-lose situation, and therefore should be avoided. Your "speeding tickets" example demonstrates this beautifully. We all know people who need an externally imposed speed limit, a scalar number that is so OB
567.
by Radim 9y ago
"The machines themselves condition the users to employ each other the way they employ machines." - God Emperor of Dune , Frank Herbert (a prescient book on social feedback loops, my favourite in the series)
568.
by Radim 9y ago
That's an interesting read -- wasn't the main "leave" argument pretty much to avoid Socialism, the new Soviet Union and creepy external authority (EU)? Preserve freedom? From the outside, hilariously, it looks like both
569.
by Radim 9y ago
Jesus christ. I read that as "bacon is flawed" for a second and nearly got a heart attack. Bacon is perfect.
570.
by Radim 9y ago
We've lived in Thailand, Vietnam and South Korea, and medical care has been fairly atrocious in each one. This was the most pronounced in South Korea, because it is so advanced technologically but somehow still has that SEA feel of wan

More ›