mediaman

16 ms·

121.
by mediaman 10mo ago
If your position is that brains are not actually bound by the laws of physics -- that they operate on some other plane of existence unbound by any scientifically tested principle -- then it is not only your ideological opposites who have qu
122.
by mediaman 10mo ago
Read the full post. Partway down you will see they agree with you that getting an API key is not hard. Paying is hard. And it is confusing how to set it up: you have to create a Vertex billing account and go through a cumbersome process to
123.
by mediaman 11mo ago
A person who chooses to evaluate all ideas by way of their source tells me all I need to know about their opinion.
124.
by mediaman 11mo ago
Serving a subpoena in this manner is for publicity, not process. In this case the public defender is issuing a subpoena for records in relation to the trespassing case. This is in relation to OpenAI, not Sam Altman. They could serve any rea
125.
by mediaman 11mo ago
Cultural antibodies take a long time to develop. In twenty years you will see more common resistance to what's being produced today, but less to whatever new innovation is released then. See, for example, the slowly declining efficacy
126.
by mediaman 1y ago
We've had a great experience with JSONata too. It's nice because we can just put the JSONata expression into a db field, and so you can have arbitrary data transforms for different customers for different data structures coming or
127.
by mediaman 1y ago
That is a common refrain by people who have no domain expertise in anything outside of tech. Spend a few years in an insurance company, a manufacturing plant, or a hospital, and then the assertion that the frontier labs will figure it out a
128.
by mediaman 1y ago
I both read a fair amount (and long books, 800-1,000 page classic Russian novels, that kind of thing) and use LLMs. I quite like using LLMs to learn new things. But I agree: I can't stand reading blog posts written by LLMs. Perhaps it
129.
by mediaman 1y ago
We do this simply by injecting a company-defined list of proper names/terms into the prompt, within <special_terms>, and telling it to use that information to assist with spelling. It works pretty well.
130.
by mediaman 1y ago
He is telling you how it mechanically works. Your comment about it “understanding what that means” because it is an NLP seems bizarre, but maybe you mean it in some other way. Are you proposing that the attention input context is gone, or t
131.
by mediaman 1y ago
Bread is a great example! You can buy a loaf for $3-4. It is not a 50x markup. Like growing your own veggies, baking bread is for fun, not for economics. But the cloud is different. None of the financial scale benefits are passed on to yo
132.
by mediaman 1y ago
The point about synthetic query generation is good. We found users had very poor queries, so we initially had the LLM generate synthetic queries. But then we found that the results could vary widely based on the specific synthetic query it
133.
by mediaman 1y ago
I have a lot of success asking models such as Gemini to OCR the text, and then to describe any images on the document, including charts. I have it format the sections with XML-ish tags. This also works for tables.
134.
by mediaman 1y ago
RL works great on verifiable domains like math, and to some significant extent coding. Coding is an interesting example because as we change levels of abstraction from the syntax of a specific function to, say, the architecture of a softwar
135.
by mediaman 1y ago
It's a false dichotomy. LLMs are already being trained with RL to have goal directedness. He is right that non-RL'd LLMs are just mimicry, but the field already moved beyond that.
136.
by mediaman 1y ago
We're going in the opposite direction. High minimum wages are making it nearly impossible to run small restaurants. We're seeing restaurant apocalypse happening in places like Seattle and Denver, because high wages result in high
137.
by mediaman 1y ago
That's already happening. It started happening when they incorporated reinforcement learning into the training process. It's been some time since LLMs were purely stochastic average-token predictors; their later RL fine tuning sta
138.
by mediaman 1y ago
We don't need fossil records. We have a clear chain of evolved brain structures in today's living mammals. You'd have to invent some fantastical tale of how God is trying to trick us by putting such clearly connected brain st
139.
by mediaman 1y ago
In Context Learning (ICL) is already a rapidly advancing area. You do not need to modify their weights for LLMs to persist state. The human brain is not that different. Our long-term memories are stored separately from our executive functio
140.
by mediaman 1y ago
This is terribly confused. Economics is the study of scarcity. Scarcity comes in many forms: land, attention, materials, time. (It is not the study of money, which is a common belief of those who have not thought about what money is. Money
141.
by mediaman 1y ago
Yes, every gigantic new secret police force answerable only to the executive is created to "catch criminals" or "deport immigrants" or do whatever else people will accept, until said police force's mandate is morphe
142.
by mediaman 1y ago
The Federalist papers, Thomas Jefferson, and the Supreme Court as recently as 2008 have all identified the right to bear arms as a mechanism for protection against a tyrannical state. It's surprising as a 2A supporter that you seem una
143.
by mediaman 1y ago
Consider looking at social media less and reading more history. The idea that people are recently celebrating cruelty, but did not earlier, is charmingly nostalgic but not exactly historical.
144.
by mediaman 1y ago
That understanding of what science is, in its de facto form of practice to date, is remarkably ungrounded from the history of science.
145.
by mediaman 1y ago
The purpose is not so much Claude Code, but that LLMs running semi-autonomously in a shell environment with access to Unix tools are powerful in a way that a web chatbot is not. Replace Claude Code with some other TUI such as opencode and,
146.
by mediaman 1y ago
We should have a finish hook that, when the AI decides it's run, runs the hook, and gives it to the LLM, and it can decide whether the problem is still there. Students don't get to choose whether to take the test, so why do we giv
147.
by mediaman 1y ago
The reduction of volunteer organizations started long before COVID: "Bowling Alone" was written in 2000, and documents much of the same changes. The trend has been resistant to any particular link to localized economic ups or down
148.
by mediaman 1y ago
The funny thing is that Elon has been very critical of regulation in car design, such as the rules around the side-view mirrors (he wanted to get rid of them and replace with cameras). But then they find something unregulated and manage to
149.
by mediaman 1y ago
I don't believe they are UL certified, but Dumfume sells 3.6kwh (300ah-12v) lifepo4 batteries for $320. 15 of those would get you 54kwh for <$5k. Might be tough to be anywhere near that point for UL certified only, though.
150.
by mediaman 1y ago
Meeting notes are useful in two ways, for me: - I'm reviewing the last meeting of a regular meeting cadence to see what we need to discuss. - I put it in a lookup (vector store, whatever) so I can do things like "what was the thin

More ›