Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
jpivarski
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
jpivarski
4y ago
It would be exciting if this is true. I just can't get past the statistical analysis. Has anyone else noticed that the fit functions in Figures 3, 4, and 5 of https://www.cambridge.org/core/journals/cambridge-
2.
▲
by
jpivarski
5y ago
Un-padding: something like string-trimming (e.g. `str,rstrip`), but for missing values at the ends of lists... There isn't a function for that. If you happen to know that the only uses of missing values are at the ends of lists, `ak.is
3.
▲
by
jpivarski
5y ago
> I don't get what's missing? Seems like that's the list in the documentation. The essential part of this is the fact that it is a columnar implementation. Although that's not interface-level, it's not a detail:
4.
▲
by
jpivarski
5y ago
Okay, that's a lot of questions. There are slice examples here, for all the different ways these arrays can be sliced: https://awkward-array.readthedocs.io/en/latest/_auto/ak.Arra... That includes what I
5.
▲
by
jpivarski
5y ago
Then I need to warn you that libawkward.so is going away—it didn't serve the purposes that we had for it. The decision to downsize the C++ part is described in detail here: https://indico.cern.ch/event/855454/
6.
▲
by
jpivarski
5y ago
It's a C++ library with a Python interface. How much C++ and how much Python is currently in flux ( https://indico.cern.ch/event/855454/contributions/4605044/ ): we're moving toward having the ma
7.
▲
by
jpivarski
5y ago
I've been doing some tests with JSON recently, so I have some exact numbers for a particular sample. Suppose you have JSON like the following: MULTIPLIER = int(10e6) json_string = b"[" + b", ".join([
8.
▲
by
jpivarski
5y ago
I meant to add that autodiff is a feature we'll be working on this upcoming spring, by using JAX arrays as the buffers. Until we have autodiff, backpropagation won't be possible.
9.
▲
by
jpivarski
5y ago
I hadn't considered an Awkward array being used as a neural network, and I would expect specialized neural network frameworks to optimize it better: don't they fuse the matrices representing each layer into a single outside-of-P
10.
▲
by
jpivarski
5y ago
Naturally, we considered this! :) We needed a larger set of tree node types than Apache Arrow in order to perform some of these operations without descending all the way down a subtree. For example, the implementation of the slice describ
11.
▲
by
jpivarski
5y ago
Hi! I'm the original author of Awkward Array (Jim Pivarski), though there are now many contributors with about five regulars. Two of my colleagues just pointed me here—I'm glad you're interested! I can answer any questions yo
12.
▲
Show HN: Phases, Scala macros for multiphase classes
1 points
by
jpivarski
11y ago
|
0 comments