mrlongroots

28 ms·

61.
by mrlongroots 1y ago
Exactly. To present a potential usecase: there's a ridiculous and massive backlog in the Indian judicial system. LLMs can be let loose on the entire workflow: triage cases (simple, complicated, intractable, grouped by legal principles
62.
by mrlongroots 1y ago
Hah thanks for sharing this, fun read!
63.
by mrlongroots 1y ago
Which, as a cpp programmer trying to pick up Rust, is honestly fine to begin with. Once you've written varying amounts of code in 5-10 programming languages, it is incredibly tedious to flip through pages trying to teach you how if con
64.
by mrlongroots 1y ago
This is cool! eBPF is incredible: I think of it as flipping the relationship between you and the perf tool. Instead of the tool giving you information, it asks you "what do you want to know?". I don't know if it's google
65.
by mrlongroots 1y ago
I have the same gripe. You want a canonical standard that's like "hive partitioning" but defines the range [val1, val2) as column=val1_val2. It's a trivial addition on top of Parquet.
66.
by mrlongroots 1y ago
I think there's two aspects around LLM usage: 1. Having workflows to be able to provide meaningful context quickly. Very helpful. 2. Arbitrary incantations. I think No. 2 may provide some random amounts of value with one model and not
67.
by mrlongroots 1y ago
There are DBMSes that do their own thing -- superficial chatgpt queries seem to result in a few, but I'll not mention them because I don't know much about their internals. I can think of a few reasons, mostly related to wanting to
68.
by mrlongroots 1y ago
I was confused for a while about where this discussion was going, and what was the broader point. Will try to consolidate thoughts in the interest of making it clearer. You seem unhappy with POSIX because its guarantees feel incomplete and
69.
by mrlongroots 1y ago
I'm not sure how any of these negate the broader point: filesystems provide a lower-level interface to the underlying block device than a database. To say that that's not true would require more than cherry-picking examples of whe
70.
by mrlongroots 1y ago
> Is file alignment on disk guaranteed, or does it depend on the file system? I think "guaranteed" is too strong a word given the number of filesystems and flags out there, but "largely" you get aligned I/O. >
71.
by mrlongroots 1y ago
Some examples off the top of my head: - You can reason about block offsets. If your writes are 512B-aligned, you can be ensured minimal write amplification. - If your writes are append-only, log-structured, that makes SSD compaction a lot m
72.
by mrlongroots 1y ago
> "Likely the idea that filesystems should run as userspace / unprivileged (or at least limited privilege) processes which would make them, ultimately, indistinguishable from a form of database engine." "Userspace vs
73.
by mrlongroots 1y ago
Thoughts: 1. Distributed filesystems do often use databases for metadata (FoundationDB for 3FS being a recent example) 2. Using a B+ tree for metadata is not much different from having a sorted index 3. Filesystems are a common enough useca
74.
by mrlongroots 1y ago
To reframe your takeaway: you want to benchmark the "system" and see how capable it is. The boundaries of the system are somewhat arbitrary: is it "AI + web" or "only AI", and it is not about fairness as much a
75.
by mrlongroots 1y ago
Exactly this. For me, the C/C++ language pack stopped working overnight with Cursor. This was clearly because of commercial concerns about derivative IDEs fairly and squarely gaining traction over the original product. But it broke my
76.
by mrlongroots 2y ago
Now we are getting into the definition of what a parallel filesystem is. In my book, a parallel filesystem is not just pooling together a bunch of nodes, but something that can actually support the synchronized accesses needed by a parallel
77.
by mrlongroots 2y ago
Deepseek just used FoundationDB to build a parallel filesystem. Parallel filesystem are a big deal -- their number, including proprietary ones, is probably in single digits.
78.
by mrlongroots 2y ago
I think summarization quality can only be a subjective criterion measured using user studies and things like that. The task itself is not very well-defined. You want a lossy representation that preserves the key points -- this may require c
79.
by mrlongroots 2y ago
> It’s purely an ecosystem play imho. It benefits the kind of people who will go on to make potentially cool things and will stay loyal. It will be massive for research labs. Most academics have to jump through a lot of hoops to get to p
80.
by mrlongroots 2y ago
Yes, that is sensible. While India has a moral claim to these artifacts, it will take another decade or two of growth before there is adequate bureaucratic bandwidth to provision the necessary infra needed to maintain them at home. Until th
81.
by mrlongroots 2y ago
Tip: copy-paste our entire exchange as a Gemini prompt and ask "who's correct?". (I did that yesterday and was very satisfied :) )
82.
by mrlongroots 2y ago
I concede that the specifics of what I said were wrong, but the larger point was not. If you buy a single DGX H100 rack and run LINPACK, you automatically get TOP500-grade numbers. Infiniband is a solid product, if not the best commercial o
83.
by mrlongroots 2y ago
> Furthermore, if you use RDMA over Ethernet, you are using infiniband at a low level. RoCE which enables it was originally called Ethernet over infiniband. This is wrong. RDMA over Ethernet is... RDMA over Ethernet. There is no Infiniba
84.
by mrlongroots 2y ago
Sorry to hound you for the third time, but this is wrong: > Infiniband is extremely popular in the HPC space Not anymore. There used to be Cray Aries/GNI, psm/psm2, and now there's Slingshot, the new Cornelis stuff etc. Th
85.
by mrlongroots 2y ago
Or they can develop a RoCEv2 that works (which is basically what UltraEthernet is). Infiniband is not fun - it's a special snowflake of an interconnect that sits parallel to the rest of your datacenter network, and can not really run a
86.
by mrlongroots 2y ago
> Infiniband is an industry standard Infiniband is not an industry standard lol. Maybe it used to be, but it definitely is not anymore. Most Infiniband vendors are dead. The only product from those days that endures is Cornelis' Omn
87.
by mrlongroots 2y ago
It's surprising that Chinese companies have not stepped into fill the printer gap. For most places where American companies stagnated, Asian ones (cars, renewables, sub-$500 smartphones) came in and ate their lunch.
88.
by mrlongroots 2y ago
To offer a different perspective, I think this is lazy criticism. There is a fundamental tradeoff between the "sharding strategy" of a social network and user experience. Both bluesky and mastodon are reasonably pareto-optimal giv
89.
by mrlongroots 2y ago
And I trust and hope that I am able to make that distinction before I lay out my allegations :). I don't want this to become a game of "supplying the evidence" because that also becomes a game of the "skeptical party&quo
90.
by mrlongroots 2y ago
> "anti-establishment" as in holding the government accountable I'm all for holding the government accountable, but the apt metaphor for some of the cited outlets would be that they protest for a road where the government

More ›