lsy

13 ms·

151.
by lsy 3y ago
An LLM can't generate new training data for itself. Mathematically speaking, the output of the LLM is governed by the same statistics embedded in its parameters, and a large enough training set of LLM output should have zero impact o
152.
by lsy 3y ago
We are not going to prove or disprove "reasoning" through giving the LLM word problems. LLMs subvert the entire foundation of word problems, which is that words correlate to internal representations and are an indicator of thought
153.
by lsy 3y ago
What does it take to "hook up" an LLM to a camera and get it to output something cogent? We have a set of human-selected discrete photographs and a set of human-written text labels for those photographs, then a model that is train
154.
by lsy 3y ago
So a bunch of pull quotes from CEOs and one non-peer-reviewed survey study? One would expect that out of all the companies pushing for an end to remote work, one would have solid data they were willing to share.
155.
by lsy 3y ago
The problem is that new knowledge comes not only from combination but discovery , and discovery fundamentally requires access to and interaction with the actual world. And as of yet we have not created a way that computers can directly acc
156.
by lsy 3y ago
Can you imagine sitting down to write an email announcing a layoff and deciding that opening with "H1" in place of "Hi" and calling people "Hackeronies" would be a great, culture-preserving idea? It's an e
157.
by lsy 3y ago
For those who don't have 65 minutes, if you write software you are probably familiar with the concepts of evals, caching, guardrails, defensive UX, and collecting user feedback, none of which are really unique to LLMs. The other two it
158.
by lsy 3y ago
Looking at the graph, it seems like productivity skyrocketed in 2020 (when everyone was WFH), returned to the 2019 baseline in 2021, and dived in 2022. To me this indicates that it's somehow hurting productivity for people to have retu
159.
by lsy 3y ago
The thing that really proved this game's point for me is the comments here from people giving slightly different versions of "well it's obvious what 'vehicle' means".
160.
by lsy 3y ago
What strikes me is that this all sounds like bluster and prevarication around safety, rather than a situation where the safety has actually been thought through. This blog post also doesn't have any kind of links or references to any m
161.
by lsy 3y ago
Not really. It's an interesting sidebar how companies use the phrase "employee-owned" to confuse people about who is in charge. Moog had an ESOP which just means the employees held 49% of the shares of stock in the company, a
162.
by lsy 3y ago
Similar to self-driving cars, I think the last 1% of the way is going to be the near-insurmountable barrier that makes widespread implementation difficult or potentially impossible. For tasks where you can plausibly check the results with s
163.
by lsy 3y ago
Two points in response to this: I think it's a category error to call word embedding in a vector space "semantic" representation when discussing concepts like understanding. Semantics deals with the referents of words, but in
164.
by lsy 3y ago
This article points out what is probably real friction from shifting mores but seems mainly preoccupied with implying that a return to more conservative values around women's role in society would be called for. What I feel is needed i
165.
by lsy 3y ago
None of this makes sense. 1."lè" with a low tone means fine, but "nì síkòní" means "I'm fine", while "là síkòní" means "he/she/it is fine"? 2. The example of "noun prefix
166.
by lsy 3y ago
For people who don't understand this, the reason humans refer to "Alex" much later in a story is not because they are statistically recalling that they said "Alex" dozens or hundreds of words earlier (as the LLM is
167.
by lsy 3y ago
My sense is that surviving and thriving malls in urban areas today are really destination experiences for dining. Valley Fair has extremely high-quality dining options which brings the foot traffic that props up the whole enterprise. The SF
168.
by lsy 3y ago
To me the odd takeaway here is that the model eventually converges to a close approximation but never really lands at the core of the problem. Loss never reaches zero even for the memorized set, and the "grokked" loss is usually h
169.
by lsy 3y ago
I think on top of the well-covered critique around regulatory capture, Altman and other GPT hangers-on benefit when the media gets into a tizzy about "AI" and needs sound bites and consultants and talking heads, when investors wil
170.
by lsy 3y ago
I agree and I think the reason it's sort of an indictment of LLMs is because there's no real way to guarantee performance over a range of input, which makes it unsuitable for many automation tasks. If you develop an LLM prompt tha
171.
by lsy 3y ago
I can only imagine the desperation of the researcher pleading with a computer to do its best to solve the halting problem.
172.
by lsy 3y ago
It's not playing in-context of minecraft, it's playing in-context of an API to minecraft. You can see one of the limitations in its error condition when it tries to craft an "acacia axe" out of acacia planks and sticks,
173.
by lsy 3y ago
I'm not sure how the authors arrive at the idea that this agent is embodied or open-ended. It is sending API calls to minecraft, there's no "body" involved except as a symbolic concept in a game engine, and the fact that
174.
by lsy 3y ago
I think there is a pretty sizeable difference between "human perception of the world is necessarily mediated by sense organs" and "all human textual output exhaustively covers the world and can be used to comprehensively desc
175.
by lsy 3y ago
This article is of a piece with the "Sparks of AGI" paper in that it doesn't really provide any formal justification for its tests, and is mainly just a dude saying "well, certainly this seems like it would be outside th
176.
by lsy 3y ago
Nothing makes me think of Altman as a grifter more than his trying to spook uneducated lawmakers with sci-fi notions like "superintelligence" for which there are no plausible mechanisms or natural analogues, and for which the solu
177.
by lsy 3y ago
At this point you can really just give a recipe for this type of article. - business-brain CEO is flailing - no better justification than "whiteboards" and "personal connection" - leadership actually lied when they promi
178.
by lsy 3y ago
Simply holding temp to 0 or making the selection deterministic isn't an adequate solution unless the process is always run with the same set of inputs (at which point why not run the model once on all inputs and create a map?). Ultimat
179.
by lsy 3y ago
In practice, I suspect it will be quite tough for these harnesses to get traction. Repeatedly calling an LLM is expensive and also not deterministic. Depending on the implementation, it may also be vulnerable to prompt injection. For most c
180.
by lsy 4y ago
I think the issue is that the sentence "Many tasks cannot be specified easily and precisely in computer code but can be described in a sentence or two of natural language" is not, in fact, true. Natural language is a pretty fantas

More ›