BadInformatics

10 ms·

61.
by BadInformatics 5y ago
Is there a clear consensus that this is the case? I had much the same understanding as you after reading all the debates on rent control on HN, but was recently pointed to [1] which offers a very contrarian perspective (including an analysi
62.
by BadInformatics 5y ago
In case you haven't seen it already, I found https://news.ycombinator.com/item?id=26779580 to be a pretty succinct list of the biggest stumbling points (latency, telemetry and documentation). A couple of more specific
63.
by BadInformatics 6y ago
> Most of those terminologies don't come from a general programming paradigm, but are the domain language of specific libraries. Not really? Most of these concepts can be linked back directly to earlier from CS theory and/or ot
64.
by BadInformatics 6y ago
Though I agree on the cultural ignorance point (especially not choosing to localize terms so that they sound exotic), needless overtime and the 996 culture are absolutely a problem. It's not so much that the work is tiring as the hours
65.
No Seriously, Hate Your Tools(buttondown.email)
1 points by BadInformatics 6y ago|0 comments
66.
by BadInformatics 6y ago
I think that plan may have been axed, as (anecdotally) the number of communal mailboxes seems to be relatively low among the few cities I've visited/lived in over the past couple of years. Also anecdotally, I'm not sure why t
67.
by BadInformatics 6y ago
TIL, thanks. Maybe it's different for rural areas, but here in (sub)urban Canada postal workers hit a few houses at a time (and you can tell because most of them wear comfortable walking shoes too). I just looked it up and it seems lik
68.
by BadInformatics 6y ago
Same with Canada Post AIUI. How often does the right-hand driver's seat thing come into play? Seems like the procurement for this kind of custom vehicle couldn't/won't be cheap.
69.
by BadInformatics 6y ago
This was about removing the feature (which IIRC wasn't completed yet) that would allow you to "install" a PWA. I'm as disappointed as you that they removed it, but calling it "they removed PWAs" is just FUD.
70.
by BadInformatics 6y ago
> My impression from reading the paper is most of the other optimizations (custom kernels, contiguous memory, checkpointing, etc) are orthogonal to the partitioning stuff This is true, I include them as examples of the amount of engineer
71.
by BadInformatics 6y ago
Having followed this DeepSpeed stuff for a little while, the ZeRO paper is probably as close as you can get to an ELI5 because there's no singular brilliant idea behind this. Most of the ideas have been explored already (see e.g. the P
72.
by BadInformatics 6y ago
GP makes a fair point about JAX still requiring a limited subset of Python though (mostly control flow stuff). Also, there's really no in-library way to add new kernels. This doesn't matter for most ML people but is absolutely imp
73.
by BadInformatics 6y ago
In case you haven't found it already, IME https://github.com/asvetliakov/vscode-neovim is a more performant, less buggy and more feature complete vim mode for VS Code. I use it on the daily for local and remote de
74.
by BadInformatics 6y ago
The latter. WGSL (purposefully) lacks many of the high-level niceties of GLSL or HLSL in order to be a good compile target as well. IIRC it has a 1-1 mapping to SPIR-V constructs, so you can see how one might build higher-level languages&#x
75.
by BadInformatics 6y ago
My sense is that they're somewhat better than, say, AMD at keeping development work in the open instead of just throwing code over the wall. Hence the choice of "development model" instead of just "FOSS". It's
76.
by BadInformatics 6y ago
It's better to think of this as a more friendly (i.e. open source development model) first party compute stack than some kind of pan-vendor standard. For example, anyone using MKL is now nominally using oneAPI libraries. They also went
77.
by BadInformatics 6y ago
> do you want to try a new standard that you don’t known if it will be obsolete in a couple of years Some incarnation of oneAPI is bound to exist as long as Intel has a foothold in the HPC market. For example, MKL and MKL-DNN have been r
78.
by BadInformatics 6y ago
This is hands down the best description I've seen of why so many of us persist in using Python despite the language or runtime. I do hope that more alternative language ecosystems will begin to thrive in the numerical space and that we
79.
by BadInformatics 6y ago
Only if you want to write C++, which a diminishing number of ML researchers or practitioners do. SYCL makes more sense for traditional HPC, but since it works at the source level it doesn't make as much sense for ML framework codegen.
80.
by BadInformatics 6y ago
As well as employing Simon Peyton Jones. Jane Street and OCaml would be another good example of deep corporate involvement in an ML family language.
81.
by BadInformatics 6y ago
I'm not sure that's a fair characterization. Core team members have expressed serious interest in getting more static verification, interfaces and other type goodness into the language, but if you try to force the issue it turns i
82.
by BadInformatics 6y ago
I work with bog-standard deep learning and this does come up, albeit not in the research stage that most people are familiar with. The closer you get to deployment, the less adequate Python becomes and the more you struggle with artificial
83.
by BadInformatics 6y ago
I mean yes, because a) there's less to change, b) you still have nice features like protocols and c) Python's type system is pretty unsound. My point was that saying ML is too complex for type systems is really a cop out, and that
84.
by BadInformatics 6y ago
In addition to what the sibling said, a big part of the S4TF project was proposing changes to Swift's type system. I'd also point out that there are not one, not two, but three type checkers looking into tensor typing for Python.
85.
by BadInformatics 6y ago
I would've assumed so too had they not mentioned both AI and algorithms. That to me strongly implies deep learning frameworks. Also, stuff like https://data-apis.github.io/array-api/latest/ exist because of
86.
by BadInformatics 6y ago
GP was referring to type hints and how they don't provide any runtime validation. There are libraries like Pydantic that let you do some, but nothing built into the language runtime IIRC.
87.
by BadInformatics 6y ago
> I prefer having a Python monoculture for AI to be able to mix and match different algorithms Given how divergent the current crop of ML frameworks are, is this really a realistic expectation? Having played around with Julia and Flux fo
88.
by BadInformatics 6y ago
Well, it's happening: https://news.ycombinator.com/item?id=25128251
89.
by BadInformatics 6y ago
I remember an interview [1] with him a few months back where he seemed to have stopped pursuing it after Chris Lattner's departure. Sylvain Gugger, who was pretty involved in fastai and prototyping a Swift port, also left to join Huggi
90.
by BadInformatics 6y ago
Looks like @throw6606 was right: https://news.ycombinator.com/item?id=24533937 . Does anyone know the status of https://ai.facebook.com/blog/paving-the-way-for-software-20- ...?

More ›