intalentive

6 ms·

61.
by intalentive 1y ago
Basically. Some people are even saying, hey, if you encode text as an image then you don’t need tokenizers any more, and you get more expressivity from the graphic styling. Another takeaway is that you don’t need to pass a tensor of shape (
62.
by intalentive 1y ago
Moral hazard
63.
by intalentive 1y ago
Suppose you have an image with 1000 words in it, and suppose for simplicity that every word is 1 token. Then the image is “worth” 1000 tokens. But under the hood, the image will have to be transformed into features / embeddings before
64.
by intalentive 1y ago
>they do so much more I'm not familiar. What else are they good for?
65.
by intalentive 1y ago
Gov. Hochul deployed the National Guard to New York subways last year.
66.
by intalentive 1y ago
"Government funding is the engine of economic innovation" is a tacit admission we have a planned economy.
67.
by intalentive 1y ago
I read "stock buybacks in 1982" as shorthand for "financialization and short-term thinking at the expense of long-term gains", which certainly happened across corporate America and Britain starting with Reagan and Thatch
68.
by intalentive 1y ago
I like Mint. I just wanted something simple that looks like Win7 I can use for work, email, browsing, and it delivers.
69.
by intalentive 1y ago
I built something similar in structure, if not in method, using a hierarchy of cross attention and learned queries, made sparse by applying L1 to the attention matrices. Discrete hierarchical representations are super cool. The pattern of a
70.
by intalentive 1y ago
Overall I really like these transformer RNNs. They are basically EBMs learning an energy landscape that falls into a solution, relaxing a discrete problem into a smooth convex one. Reminds me of other iterative methods like neural cellular
71.
by intalentive 1y ago
>the only real difference is the amount of money backing it Judging by how often Sam Altman makes appearances in DC, it's not just money that sets OpenAI apart. It's likely also a strategically important research and developmen
72.
by intalentive 1y ago
The West also crushes dissent: try to organize a pro-Palestinian protest on a university campus and tell us how it goes. Crushing dissent is simply what governments do. In the meantime I would like to see more Hoover Dams and Apollo program
73.
by intalentive 1y ago
The complexity of the human body surely weighs in at over 1 GB. I think of DNA analogously to the rules of cellular automata. The entropy of the rules is much less than the entropy of the dynamical system the rules describe. The body is fil
74.
by intalentive 1y ago
Generative world models seem to be doing ok. Dreamer V4 looks promising. I’m not 100% sold on the necessity of EBMs. Also I’m skeptical that self-supervised learning is sufficient for human level learning. Some of our ability is innate. I d
75.
by intalentive 1y ago
A confident, unified people under competent leadership can accomplish great things. I wish the Chinese continued success and hope their example eventually spurs the development of a new ruling class in the West.
76.
by intalentive 1y ago
Rolled my own in Python. For graph/tree document representations, it’s common in RAG to use summaries and aggregation. For example, the search yields a match on a chunk, but you want to include context from adjacent chunks — either lat
77.
by intalentive 1y ago
Agentic search with a handful of basic tools (drawn from BM25, semantic search, tags, SQL, knowledge graph, and a handful of custom retrieval functions) blows the lid off RAG in my experience. The downside is it takes longer. A single “inve
78.
by intalentive 1y ago
Interesting aside about the Vienna circle and isomorphism. I suspect that’s where Hayek got his idea that mind and representation are isomorphic, echoing Aristotle’s assertion in “On the Soul” / De Anima that the mind becomes the objec
79.
by intalentive 1y ago
“Solve computer use” and previous work is audio conversation model. How do these go together? Is the idea to replace keyboard and mouse with spoken commands? a la Star Trek
80.
by intalentive 1y ago
China is run by the state, which employs the engineers. The West is run by finance capital, which employs the lawyers (and buys the politicians). There was a post here a while back about engineering grads in the UK who couldn't get eng
81.
by intalentive 1y ago
>My tentative theory is that the systems, incentives, and technologies in modern world have managed to slightly empower the individual, and massively empower large organizations, but at the significant expense of small organizations This
82.
by intalentive 1y ago
>The answer is actual competition It's hard to see how that can happen when politicians take money from the rent-seekers who benefit from the status quo. "Competition is for losers", says Peter Thiel, so buy yourself a sta
83.
by intalentive 1y ago
The doc string becoming part of the prompt is a nice touch. It seems plausible and intuitive that simple tools dynamically called by agents would yield better results than complex search pipelines. But do you have any hard data backing this
84.
by intalentive 1y ago
>we need to work to bring back the Ancient Greek model of the polis and in particular the Ancient Greek model of politics as what gives life meaning. The Ancient Greek model of politics isn't compatible with liberal pluralism. The f
85.
by intalentive 1y ago
Nowadays everyone publishes their code. There’s typically a project page on github.io, a paper on arxiv.org, and a public repo.
86.
by intalentive 1y ago
World reserve currency status follows the leader in manufacturing and trade. Maintaining dollar hegemony was never going to be feasible after de-industrialization, but short-sighted decisions like weaponizing SWIFT have accelerated its decl
87.
by intalentive 1y ago
Ok, the song exists on a playlist with a few hundred saves. I don’t think it’s a widespread groyper meme though. I’ve never seen them reference it on Twitter. Maybe the arrows are a video game reference? I still don’t see a groyper tie ther
88.
by intalentive 1y ago
"Hey, fascist! Catch!", "Bella ciao" and three arrows are all antifascist. I would assume that the shooter is motivated by antifascist political ideology at odds with Kirk's political ideology. https://en
89.
by intalentive 1y ago
What's the evidence for this claim? Seems at odds with the details reported here: https://www.the-independent.com/news/world/americas/us-polit...
90.
by intalentive 1y ago
Using a metric like SAT math scores, the demographic breakdown is: Asian > White > Hispanic > Black. The youth population is becoming less White and more Hispanic, therefore we should expect lower math scores.

More ›