jacobn

7 ms·

31.
by jacobn 2y ago
So a lot of Apple Intelligence is still vaporware then? From [1] "Additional Apple Intelligence features will roll out later this year and in the months following", i.e. later in 2024 and then in 2025, and the not-available-at-lau
32.
by jacobn 2y ago
The fact that they have touch id on some of the ipad side power buttons, but not on the iphone, is so annoying. Face id is both great and terrible, and complementing it with touch id to cover the >5% of cases where face id fails would be
33.
by jacobn 2y ago
The only number I could find was 22/27 hours of video playback for 16/16 Pro, you can compare that to older models on https://www.apple.com/iphone/compare/ that might give some indication?
34.
by jacobn 2y ago
Nice work! Making AI accessible directly in the browser (even if you have to download quite the payload for the model parameters) is a real accessibility game changer. Shameless plug: if you prefer API-based background removal we offer a su
35.
by jacobn 2y ago
I was under the impression that you could more or less do something like that with the existing LLMs? (May work poorly of course, and the sample I think I saw a year ago may well be cherry picked)
36.
by jacobn 2y ago
I agree it sounds absolutely absurd - first time I heard about it I couldn’t believe it. The Wikipedia page has more on the rationale, good or bad: https://en.wikipedia.org/wiki/Civil_forfeiture_in_the_United...
37.
by jacobn 2y ago
Any confiscated cash needs to go into state level or even federal coffers, not to the agency or local cops that did the confiscating. That removes the immediate incentive for abuse, while retaining the tool for what it was intended for: act
38.
by jacobn 2y ago
Is it known why/how those animals have reduced / negligible senescence? Like do they have some other variant of the AP-1 gene(s), or some such?
39.
by jacobn 2y ago
At the AI engineer fair, or some other event?
40.
by jacobn 2y ago
Tangentially related: I needed to share some binary data from Java to python. Didn’t want to pull in protobuf (for probably mostly bad reasons), so I wrote a writer implementation in Java, then asked gpt4o to write the python reader. Worked
41.
by jacobn 2y ago
A very big reason for the “go big or go home” mentality comes from very simple company valuation metrics: If you have $10M ARR and modest growth you’re probably going to get a ~4x P/E valuation. If you have $100M ARR and modest growth
42.
by jacobn 2y ago
> Goes to show just how much is in the training data. And in the scale (num_layers, embed_dim, num_heads) of the model of course ;)
43.
by jacobn 2y ago
Forgot one: the positional encoding also changed, llama3 uses RoPE, gpt2 uses a learned embedding.
44.
by jacobn 2y ago
The training code is presumably quite a bit more complex than what they've open sourced, but part of the beauty of the GPT-based LLMs is their structural simplicity. Now, that simplicity can be deceiving - there are a lot of conceptual
45.
by jacobn 2y ago
In transformers the attention matrix is N*N, so there are a lot of values to go over. Typically makes it memory bandwidth bound, not compute bound.
46.
by jacobn 2y ago
Can we all agree to just call it X-Twitter? Clear & concise.
47.
by jacobn 2y ago
Unless of course: “Public perceptions of higher education have declined rapidly, and I expect the problems to get worse.” turns out to be the case (Which it probably won’t)
48.
by jacobn 2y ago
Which probably corresponds to a loss of foot traffic to restaurants & shops in the cities' downtowns. This is very visible in SF.
49.
by jacobn 2y ago
I've been mulling over this weird idea that we should all be using an Edge (Web) Framework that manages the layouts + static site content, then pulls in either JSON or pre-rendered HTML templates from the more dynamic db-driven backend
50.
by jacobn 2y ago
Ethics are a lot more nuanced and change a lot faster than laws. Heck, a large fraction of ethics seem to be so fickle that they’re subject to potential revision by every generation. In fact, I’d argue that those revisions are a significant
51.
by jacobn 3y ago
The fundamental operation done by the transformer, softmax(Q.K^T).V, is essentially a KV-store lookup. The Query is dotted with the Key, then you take the softmax to pick mostly one winning Key (the Key closest to the Query basically), and
52.
by jacobn 3y ago
“we attribute the performance of Yi models primarily to its data quality resulting from our data-engineering efforts” Data work is rarely sexy, but (almost) always useful. Did they release the corpus?
53.
by jacobn 3y ago
This is a “sounds good, but devil is in the details” type situation, and the details typically don’t work out all that well because the initiative effectively assumes good intent from the ecosystem, when we have seen time and time again tha
54.
by jacobn 3y ago
Reviewing vs creating are very different mindsets. There’s a red team, blue team flavor to it. AI levels up the less skilled, but makes even the more skilled miss embarrassing mistakes.
55.
by jacobn 3y ago
SEPA via Stripe takes on average 5 days, max 14 according to their docs - instantaneous would be a game changer?! https://stripe.com/docs/payments/sepa-debit
56.
by jacobn 3y ago
Establishing democracy is indeed also a fragile process, but one that has numerous successful implementations (~140 democracies in the world?). Social democracy has numerous successful implementations (eg Scandinavia). But the more “hardcor
57.
by jacobn 3y ago
The problem with collectivism is less with collectivism as platonic ideal (which has a lot of romantic appeal), and more with the inevitable concentration of power it requires and thereby enables. The reason there has been no successful imp
58.
by jacobn 3y ago
Interesting point that abundant cheap-but-bad products can effectively choke off the second hand market. It complements the boots theory nicely [1]. [1] https://en.wikipedia.org/wiki/Boots_theory
59.
by jacobn 3y ago
It seems like a lot of the problems arise from the strings being attached to the top of the pin Why not attach them to the bottom and have the setting machine underneath?
60.
by jacobn 3y ago
More exactly how does a proxy add an online DDL capability to the presumably remote database? Or is a database proxy something completely different than eg a web proxy?

More ›