pwang

9 ms·

61.
by pwang 9y ago
Have you checked out Bokeh? It's a Python and R library, but it's exactly designed for the kind of "industrial / engineering data visualization", and it doesn't require you to do a whole pile of Javascript. h
62.
by pwang 9y ago
> Building native dependencies as binaries Yep. http://conda.readthedocs.org
63.
by pwang 10y ago
Yes, a bunch of modern software dev is drug dealing.
64.
by pwang 10y ago
Can you elaborate?
65.
by pwang 10y ago
Out of curiosity, were you using spark-scala or pyspark?
66.
by pwang 10y ago
Agreed. What a lot of people here in HN don't seem to realize is that the reason why Software Is Eating the World is because software can be really really bad, and still be better than not-software. When presented with "a pile
67.
by pwang 10y ago
I applaud the spirit of this, i.e. in trying to lay out a covenant with the community while still being entrepreneurial about building a commercial business to fund continued innovation and maintenance of the software. The problem is that i
68.
by pwang 10y ago
Since this link is from 2014, it doesn't mention rBokeh, which is a very powerful interactive viz library for R: http://hafen.github.io/rbokeh/
69.
by pwang 10y ago
No, you cannot.
70.
by pwang 10y ago
Distributing Python +C extensions are easy with Conda. https://conda-forge.github.io/
71.
by pwang 10y ago
Respect. I think the singular power of an experienced programmer is being able to reason about high-level structure, while being able to deep-dive into any lower level detail, anywhere in the overall system, and therefore be able to carve o
72.
by pwang 10y ago
At this point in time, I think that the Python/Numpy stack offers the best performance, productivity, and expressiveness trade-off. With the [Numba]( http://numba.pydata.org ) just-in-time compiler, you can now easily bounce
73.
by pwang 10y ago
I dunno... I'm not Rob Pike, but I could basically describe computing from the quantum level to the solar system dynamics and electromagnetic influences of a robotic interplanetary craft. Then again, I've been coding for ~25 years
74.
by pwang 10y ago
Well, kind of. We've tried to work with the python core packaging folks to improve the built-in metadata facilities. (There has been a checkered history there in terms of reception to our ideas...) In terms of making these packages e
75.
by pwang 10y ago
One of the reasons that we started Continuum Analytics was because we felt that the scipy/pydata ecosystem was so powerful and had such an important role to play in the tech landscape, that we could not purely rely on the goodwill cont
76.
by pwang 10y ago
Yes, that's why people don't use apt-get or pip, and rather install Anaconda. Pip and wheels are still not really suitable for scientific Python work, because the metadata facilities are not sufficiently rich to capture all the in
77.
by pwang 10y ago
The reason and motivation for Anaconda is precisely to help people avoid the "fun" you alluded to of building numpy/scipy/etc. from source. Even on systems which provide the right compiler and headers and runtime libs f
78.
by pwang 10y ago
That's not a fair assumption: a huge number of Python users are using it for some level of data processing and data analysis. And that percentage is growing each day, because Python is a very hot technology in data science.
79.
by pwang 10y ago
BUT WHY Your performance is going to be complete and utter crap because you're paying for serialization on every single data element. Dask is higher performance and more pythonic: http://matthewrocklin.com/blog/wor
80.
by pwang 10y ago
If you want easy scale-out and scale-up with Python, check out the (relatively) new library Dask: http://dask.readthedocs.org
81.
by pwang 11y ago
Starmaker was my introduction to Stapledon. Superb and holds up even across the span of several decades.
82.
by pwang 11y ago
> that is seemingly limitless in what it does and can do With great power comes terrible debugging! Have you checked out rBokeh? Full browser interactivity, support for many more points than D3 (and way more if you turn on webGL), suppo
83.
by pwang 11y ago
Can you elaborate on this?
84.
by pwang 11y ago
Actually, we'd LOVE to get a bokeh.rb project going! Most of the power of Bokeh is in the BokehJS runtime, and in our M-VM-V-C architecture for visualization. The Python code is just generating a JSON representation of the plot, but
85.
by pwang 11y ago
In the "Technical Vision" part of our docs, I speak to this a little bit: http://bokehplots.com/pages/technical-vision.html A very large part of the vision is that we want to support accurate and useful visua
86.
by pwang 11y ago
Of course you're right that we do need to support SVG and vector formats, but it's also not entirely true that "vector >> raster" in all cases. Raster does have limited resolution, but so does your screen or most o
87.
by pwang 11y ago
In the Dev Guide docs, there is a section about why we built our own Javascript charting library from the ground up: http://bokeh.pydata.org/en/latest/docs/dev_guide/bokehjs.htm...
88.
by pwang 11y ago
There is a full-featured javascript runtime "BokehJS" which is designed from the ground up to be driven by remote (aka server-side) models, which are sent over the wire as JSON. The server-side models are generated programmatical
89.
by pwang 11y ago
What resolution are you looking for in print? If you export your raster at 300 dpi, and enable lossless PNG compression, shouldn't it suffice for most print purposes?
90.
by pwang 11y ago
Thank you for your candid and insightful comments. I am curious - if there was a GIL-removed version of Python 2, would you change your assessment that your "long-term plan will likely involve removing more python from the pipeline&quo

More ›