pwang

30 ms·

241.
by pwang 14y ago
Thanks for the feedback! You're right that for scientific use cases, the data access story defines mode and methods of computation. Your use case of having a large dataset stored across many files on a distributed FS is one of the cornerst
242.
by pwang 14y ago
Possibly; it is not on our immediate roadmap, but is something we can add if there is enough demand. If you are interested in accelerating Numpy, have you seen Numba? One decorator can net you a several hundred times speedup over pure pyth
243.
by pwang 14y ago
Thank you!
244.
by pwang 14y ago
This is our MVP, so there are a lot of shared features with some other existing projects. One of our "deep tech" features I don't think anyone else has is the ability to quickly and dynamically switch between different Python environments,
245.
by pwang 14y ago
> Most universities tend to have their own computing cluster, which will make storing the (potentially large) datasets easier, and furthermore use of the CPU time is free! We plan on making the entire Wakari stack available to deploy
246.
by pwang 14y ago
> Useful for heavy computation on smallish datasets, but not for moderate computation on big datasets. Here at work the datasets are several gigabytes so this would not be a solution. This is just a closed beta for the very first init
247.
by pwang 14y ago
Yes Joey, though I'm not sure if you still remember me - We co-founded CSLUG back in 1995. :-) I was a lowly freshman happy to get to geek out on Linux with CS folks. (Not many Physics people were really into it then.)
248.
by pwang 14y ago
> And when you are a creator rather than a consumer (especially of the written word, be it code, essays or books), screen size rarely matters. I don't necessarily agree with the parent post's sentiments, but I also disagree with this ve
249.
by pwang 14y ago
> Does anyone have a link either to a slightly more leisurely exposition of the theory behind it, or perhaps a more user-focused summary of what kind of features and optimisations this new magic might enable? No, but those will be fort
250.
by pwang 14y ago
> its all haskell ideas ported to python land under the covers :) Well, that's not entirely true. It's based on many of the same ideas which underlie some of the good Haskell ideas, and have a natural expression in Haskell because it'
251.
by pwang 14y ago
Numba actually uses the Python AST, so it's not too different. Currently it's also using Mark Florisson's Minivect internally to reason about Numpy arrays and array expressions. This will be much easier when Numba encounters a Blaze array,
252.
by pwang 14y ago
So, what do people need custom physical objects for? Especially rigid stuff? Generally things are rigid either because the application they serve requires the structural rigidity, or because the application they serve requires chemical pr
253.
by pwang 14y ago
If you look in the source ( http://bl.ocks.org/3914862 ) about 4/5 of the way down, they basically copy the core logic from Jake's Matplotlib version.
254.
by pwang 14y ago
> I'm sorry Bret, but Alan is right. You do need to be able to think like a machine. I would like to bring in another Alan Perlis quote: "You cannot move from the informal to the formal by formal means." Programming is the art of formal
255.
by pwang 14y ago
> What can python offer then? Numpy and scipy and twisted? Those are just libraries, and bindings can be made from JS to their respective hot-spots of C. This is true but it's missing the point. Scientific programmers and data analysts
256.
by pwang 14y ago
> People like new stuff, Python is getting old, boring, too many people are into it now and its not hip anymore. Lots of people are also into breathing, eating, and having sex. I don't see those activities losing mindshare. Programming
257.
by pwang 14y ago
Yeah, Convore was fun. I'm sad it went away. (Not caremad, though - thanks, Kenneth; urbandictionary owes you a page hit today.) But huge props to Leah for keeping at it... I'm disappointed at the haters on this thread taking personal pot
258.
by pwang 14y ago
I was a paying customer. I had other shit to deal with than setting up an IRC server with robust logging, and it worked well enough for our team (except the random disconnects). I guess we'll be looking at hipchat and some of the other alt
259.
by pwang 14y ago
> it exposes the core concepts at the data level But it exposes them poorly , from a user interface standpoint. The beauty of UNIX, actually, is that it provided a few simplifying abstractions (block files, character devices, pipes), a
260.
by pwang 14y ago
So you have had good luck with hg-git, then? Does it play well with github? I've read mixed reviews... I'm OK with git but am deeply displeased with how difficult the learning curve is for a casual user. I'd much rather that Mercurial won
261.
by pwang 14y ago
"I want to work with craftsmen" And craftsmen are picky about their tools. Git has a terrible, terrible, command line UI. It's entirely possible to do distributed source control with an easy command line interface: Mercurial. I've never h
262.
by pwang 14y ago
Hopefully more than you've typed ":q!" :-)
263.
by pwang 14y ago
I agree with your assessment. Deploying into enterprise takes a good chunk of money to deal with the countless "last mile" issues. Also, you start needing an enterprise sales team. Even if you use the Atlassian model, there's limited spa
264.
by pwang 14y ago
I've found recommendations for Drucker on some entrepreneurial sites. I think if they re-released his books with updated covers (hire whoever does Malcolm Gladwell's covers), they might grab more attention from the "young generation".
265.
by pwang 14y ago
How do you know it's not memory I/O bandwidth bound? Just curious.
266.
by pwang 14y ago
I'm interested to hear about your CPU-bound Python programs that also involve large amounts of data. Normally such problems are I/O bound and are better solved in a data parallel way. (Graph problems can sometimes be an exception, but tho
267.
by pwang 14y ago
> rpm/apt/msi had more mature tools MSI is terrible. It has older tools, and maybe that's what you mean by mature, but every time I've ever interacted with an MSI build process, I walk away amazed that this is the actual, certified, M
268.
by pwang 14y ago
Of course they are - but Microsoft only knows how to make platform plays. It seems to have forgotten that platforms are bootstrapped on the basis of killer products, and sustained by interop between a continuous stream of great products. F
269.
by pwang 14y ago
Nice straw man! And how many dragons and white walkers and Cylons are featured by Nova specials, the Discovery Channel, and get pop-sci articles written up in Scientific American?
270.
by pwang 14y ago
I actually think this is backwards: The primary reason why Facebook can be successful is because it is organized such that it could realize the vision of a technical founder, who has a foot in tech and a foot in business. You're right tha

More ›