awaythrowact

14 ms·

1.
by awaythrowact 5y ago
I may be wrong. It happens a lot! But I think Arrow's vision encompasses compute, not just a data format and data interface. https://www.slideshare.net/wesm/pycon-colombia-2020-python-f... Slide 43: The "Arro
2.
by awaythrowact 5y ago
Fair. I agree Arrow is still more of a vision than anything else. > it didn't even provide a shape attribute I suspect this has to do with the project's focus. I think they aspire to be a back-end to DataFrame libraries, which
3.
by awaythrowact 5y ago
What is your point? (I honestly do not understand.) Blackbear's comment was that writing libraries in C allows those libraries to be deployed broadly in many compute environments. Jakob's reply (as I understood it) was that outsid
4.
by awaythrowact 5y ago
What are your favorite open source Python packages written in Rust?
5.
by awaythrowact 5y ago
> there is no libnumpy or libpandas I think this is changing with the rise of Apache Arrow. See eg here, slide 38 and on: https://www.slideshare.net/wesm/pycon-colombia-2020-python-f...
6.
by awaythrowact 5y ago
> for library writers, how many people might use it can be a deciding factor on investing the time Yes. Especially given that a high percentage of library development these days is being done by industry, not just academia. (At least in
7.
by awaythrowact 5y ago
Makes sense. I don't use TF Eager, but I do use Jax, and Jax lets you arbitrarily compose JITed and non-JITed code, which made me think that might be a viable pattern. I guess I wondered if there might be something like "nonstatic
8.
by awaythrowact 5y ago
If the next machine learning killer-app model requires autodiff'ed dynamic control flow, do you think Google/Facebook will build that capability into XLA/TorchScript? Seems like if NLP SOTA requires dynamic control flow, Goog
9.
by awaythrowact 5y ago
Always happy to help. Especially the last day or so - I've been waiting on some long training loops so it's been a pleasant diversion. To be 100% honest with you, there's pretty much 0% chance of me adopting Julia in the next
10.
by awaythrowact 5y ago
> since `fit` would've likely come from the same source No. As described in the great-great-great-great-great-great-great-great-great-parent comment, the problem I am describing is that of trying to combine models from multiple soft
11.
by awaythrowact 5y ago
Just to be clear, I like Julia, and think it has advantages over Python. I'm writing all this as someone who is cheering for Julia to break out of its HPC niche. Thanks.
12.
by awaythrowact 5y ago
@cbkeller I know in Julia I can just precede every function call and object instantiation with "modulename." and solve the namespace problem that way. What I want to do instead, what I do in python, is bind one namespace of functi
13.
by awaythrowact 5y ago
Never made it that far. This was a feature I use all the time in Python ML development (both consuming open source packages via an OOP interface and also writing in-house model classes) that I consider essential for my productivity and that
14.
by awaythrowact 5y ago
I very frequently run into namespace collisions like that. I think they are quite common in large codebases. I am aware of the ability to do eg "import TensorFlow; model = TensorFlow.model; TensorFlow.fit(model,data)" As I mention
15.
by awaythrowact 5y ago
I know nothing about Lisp, so at the risk of talking past eachother.... I never said macros were required. I said implementing this type of code without OOP required more boilerplate, and MLJ uses macros to reduce that boilerplate. As I und
16.
by awaythrowact 5y ago
I agree you can achieve same benefits with Macros. Indeed, I see that MLJ, Julia's attempt at a SciKit type project, makes extensive use of Macros. But I personally think macros are an antipattern. In large projects, they can introduce
17.
by awaythrowact 5y ago
I'll give you my two cents, recognizing that I very well might just be ignorant about Julia and multiple dispatch, and if so please continue to educate me. Consider if we want to run many different types of models. Logistic regression,
18.
by awaythrowact 5y ago
I second most of this. A lot of problems are fixable with time and money. Maybe the Series A will help! But some problems might be related to Julia's design choices. One thing I really missed in Julia is Object Oriented Programming as
19.
by awaythrowact 5y ago
Congrats to the Julia team. I am a python developer who has dabbled with Julia but it never stuck for me. I think Julia was built by academics for other academics running innovative high performance computing tasks. It excels at the interse
20.
by awaythrowact 5y ago
Did PyTorch increase or decrease demand for ML developers? Did Ruby on Rails increase or decrease demand for web developers? Did C increase or decrease demand for systems programmers? Automation and abstraction is a complement, not a substi
21.
by awaythrowact 5y ago
Learned a bunch from the article and from this thread. Thanks all.
22.
by awaythrowact 5y ago
I pip install foo, and foo depends on bar. I pip freeze > lock.txt. My lock file has foo v1 and bar v1, right? Later bar upgrades to v2. I then try to rebuild the container image from lock.txt. My pip freeze lock file will still keep me
23.
by awaythrowact 5y ago
Mirrors my experience. Walled garden “we handle everything for you” tools are good for simple use cases. One you need to go outside the garden, even a little bit, it becomes more trouble than it’s worth. For non-trivial projects, I prefer d
24.
by awaythrowact 5y ago
Why is pip freeze not 100%?
25.
by awaythrowact 5y ago
Doesn’t pip freeze > requirements.txt capture exact versions of dependencies of dependencies?
26.
by awaythrowact 5y ago
Can you elaborate? What does docker+poetry get me that docker+pip+requirements.txt doesn’t?
27.
by awaythrowact 5y ago
Honest question: How is polygon more centralized than Solana? My understanding is that Polygon supports roll ups.
28.
by awaythrowact 5y ago
My understanding is, proof of stake is not more secure than proof of work. Reason for PoS are efficiency, speed of transaction, lower gas fees, less environmental impact, etc. (Of course there can be secure PoS, insecure PoS, secure PoW, in
29.
by awaythrowact 5y ago
Questions for Solana bulls from a crypto noob: 1) ETH bulls say that Solana is not really decentralized. It achieves scalability by limiting the network to only a handful of validators; why not just use AWS at that point? Why are they wrong
30.
by awaythrowact 5y ago
https://news.ycombinator.com/item?id=26834333

More ›