benpacker

14 ms·

31.
by benpacker 3y ago
The end result is almost the same as an audit table except there's much more work to do at read time, and some queries simply cannot scale as they need to with this approach. In general for most apps you'd rather have 2 writes (wr
32.
by benpacker 3y ago
Yes - they are open weights and open inference code, which means they can be integrated into Ollama. They are not “open training” (either in the training code or training data sense), so they are not reproducible, which some have suggested
33.
by benpacker 3y ago
Most of this is inaccurate. The history of unions is long and complex. Although there has been tension historically between craft unionism and industrial unionism (the original term for lower skilled work), that was mostly in the pre-war pe
34.
by benpacker 3y ago
easier to scale to a distributed TPU cluster I think?
35.
by benpacker 3y ago
Is that lossy? Isn't the vector representation of the text (and the ANN index itself) lossy, and the source text itself the source of truth?
36.
by benpacker 3y ago
Yep, that’s right. Modal ( https://modal.com ) is actually what you’re describing with Python, but Modal is just the compute layer (Unison is going for the whole cloud), and Modal isn’t doing anything to handle version alignment a
37.
by benpacker 3y ago
I haven’t used the service or language, but I imagine if you’re familiar with it, the above snippet feels like Typscript does to me. From their written materials, it looks like the thing you’re missing is that this is a single source of tru
38.
by benpacker 3y ago
I definitely think trying to find similarity on a variable subset of dimensions is required. Fingers crossed I get the time to try soon
39.
by benpacker 3y ago
I like this, and I like Bun, and I’m going to use this, but I’m nervous about whether Bun’s ultimate share of the server-side cloud Javascript will be big enough to sustain the maintenance surface area they are carving out for themselves. H
40.
by benpacker 3y ago
Ah wow, I'm not a frequent player so I didn't know how clever it can get!
41.
by benpacker 3y ago
I unfortunately can’t imagine having time to test this, but I imagine there may be a way to accomplish this with embeddings. The game itself is sort of an embeddings clustering problem, with the added difficulty that each group needs to onl
42.
by benpacker 3y ago
My understanding is that Cloud Run is not suitable for stateful workloads (databases, etc.)
43.
by benpacker 3y ago
If I use GKE or any other standard Kubernetes offering (excluding GKE autopilot for now), if I have a variable workload and I want Node-level autoscaling, I will probably pay between 1.5x-2.5x in compute costs above what my Pod requests s
44.
by benpacker 3y ago
If this is “free GKE autopilot” (autopilot billed at the same price as regular Fly Machine compute), then that changes the way I think about Fly’s basic compute pricing a lot. I would think they should highlight that a lot more in the produ
45.
by benpacker 3y ago
Typo haha - I meant GKE. Fixed now.
46.
by benpacker 3y ago
I think there’s a slight misunderstanding - I’m referring to how much of a Node is being used by the Pods running on it, not how much of each Pod’s compute is being used by the software inside it. Even if my Pods were perfectly sized, a lar
47.
by benpacker 3y ago
Unfortunately last I checked the compute pricing for GKE autopilot was almost double, so if you can beat 50% utilization, you might as well just keep the under-utilized Node around.
48.
by benpacker 3y ago
Am I understanding correctly that because they map a “Pod” to a “Fly Machine”, there’s no intermediate “Node” concept? If so, this is very attractive. When using GKS, we had to do a lot of work to get our Node utilization (the percent of re
49.
by benpacker 3y ago
If you’re just learning about this from outside the United States, some important context is that the domestic narrative about 9/11 was that “They hate us for our freedoms”. Substantive discussion about Bin Laden’s motivations and his
50.
by benpacker 3y ago
Some highlights: “In order to procure the necessary raw materials for knife production, one of us (M.I.E.) went on a diet with high protein and fatty acids, which is consistent with an arctic diet, for eight days…” “Raw material collection
51.
by benpacker 3y ago
I know price will vary wildly based on how many you’re buying, but does anyone have the roughest ballpark for how much it would cost to buy one (1), or like two?
52.
by benpacker 3y ago
This is the docs repo
53.
by benpacker 3y ago
It implements the BEAM, so any language that shares the runtime can be made to work (Elixir, Gleam, etc)
54.
Show HN: Kysely-access-control (permissions at the query building layer)(github.com)
1 points by benpacker 3y ago|0 comments
55.
by benpacker 3y ago
This is quite confusing - you shouldn’t need a columnar engine to filter/aggregate 20k rows. Postgres / MySQL with a table per board (or one giant partitioned table with a JSONb column) would have been totally fine, as would have
56.
by benpacker 3y ago
I’m not sure if Postgres could support that type of operation directly via count() since I don’t know if the fact that no other filters are present is available to the Index Access Method API. It might be possible to do a separate functio
57.
by benpacker 3y ago
The underlying engine, Tantivy, has better performance characteristics than Lucene. You can compare Lucene to Tantivy and can compare Elasticsearch to pg_bm25 or ParadeDB
58.
by benpacker 3y ago
Kids learn grammar by copying, but a group of kids with no language will invent one (see Nicaraguan sign language), and empty transformer models will not do this. Kids raised hearing a mix of French and African languages will also invent a
59.
by benpacker 3y ago
How does this compare to Parseable? https://github.com/parseablehq/parseable First guess is that the underlying storage / query layer is pretty similar (Parquet + Datafusion), but OpenObserve has more built in use
60.
by benpacker 3y ago
A bit odd that Pinecone is publishing this… I can understand if they identified that building with LangChain means more Pinecone usage, and a barrier to building with Langchain is its documentation and ease of getting started, but if the no

More ›