niviksha

4 ms·

1.
by niviksha 4mo ago
Excellent read - thanks! Always felt there was a ‘self-licking ice cream cone’ at the heart of the present moment. If only AI had better context than the messy reality that is human knowledge…oh wait, we have AI to help with that problem
2.
by niviksha 2y ago
This is a very innovative take on infra for ML observability. Shreya Shankar and collaborators at Berkeley came up with https://github.com/loglabs/mltrace , which treads the same ground - perhaps you've looked at i
3.
by niviksha 2y ago
There are a few symbolic logic entailment engines that run atop OWL the Web Ontology Language, some flavors of which which are rough equivalent of Cycs KBs. The challenge though is the underlying approaches are computationally hard so nobod
4.
by niviksha 4y ago
My use case is generating a very high rate (10k e/s up to 100k e/s) of JSON-NL events from samples of JSON-encoded log data (JSON-NL to be exact). Is this supported in OSS Gretel? FYI, I'd built a hand-crafted generator using
5.
by niviksha 4y ago
Wow, this is great. I built my own synthetic time series data generator for benchmarking, could have saved myself a bunch of trouble with this.
6.
by niviksha 4y ago
Thanks for sharing this. It is a very interesting problem that highlights some of the technical challenges of working with modern event data, which happens to 'prefer' being semi-structured (i.e JSON is the most natural serializat
7.
by niviksha 4y ago
Sneller head of product here. Arrow is a data exchange format, are you referring to benchmarking against DataFusion or Ballista? Also, on Presto - we did early benchmarks against Amazon's Athena (Presto under the covers) running on par
8.
by niviksha 4y ago
Great read! Minor nit - shouldn't they be called 'road trains'? The other kind are also land trains, no?
9.
by niviksha 4y ago
This blog itself is a work of art, like mechanical watches themselves
10.
by niviksha 4y ago
This is an interesting response to the original article. My TL;DR for this is something like 'Yes, information tech has always resulted in social upheaval, so notwithstanding the scale and speed of the current iteration, this isn&#x2
11.
by niviksha 9y ago
i'm not questioning your use of indexes. i'm questioning the basis of the unqualified assertion that 'query times are slower than a SQLite database' - with indexes off, and both running on CPUs, the basis of comparison i
12.
by niviksha 9y ago
hi - i took a look at the sqlite db. not to nitpick, but you have 4 indexes there? the overhead of indexes at tiny data sizes like this is minimal, so no surprise that sqlite or pg will compare favorably at laptop scale (FWIW, i ran this on
13.
by niviksha 9y ago
TL;DR - It does come down mainly to the network, but in far more interesting ways than is apparent from some of the answers here - and also the nature of the HPC software ecosystem that co-evolved with supercomputing for the last 30+ years.