golol

21 ms·

241.
by golol 3y ago
> And I think capitalism & the world we live in today is especially draining & enmiserating in this way. When was it bețter exactly?
242.
by golol 3y ago
I very much agree with this sentiment. For me it is the 9th symphony that I don't want to wear out.
243.
by golol 3y ago
Definition 2 (Large Language Model). Let S be a computable seta of all the finite-length strings of alphabet A and (s0, s1, . . .) be an one-to-one enumeration of all the elements in S. A large language model, denoted h, is a function that
244.
by golol 3y ago
The result in the theorem applies to your brain. Your brain can be modelled as an LLM in the sense of the paper up to arbitrarily small error. The result is a diagonalization argument that is not very relevant for the real world.
245.
by golol 3y ago
I can assure you it has no relevance for people working with LLMs, as the result includes your brain, for example.
246.
by golol 3y ago
> So that "30% of individual statements are unsupported" number was actually a test of how well ChatGPT's GPT-4 browsing mode with Bing could provide citations when answering medical questions. Man, I am so disappointed. T
247.
by golol 3y ago
This is just another diagonalization against some finite thing, like the no free lunch theorem. An "LLM" in their definition is essentially any finite thing which predicts the next token. The same result applies to your brain too,
248.
by golol 3y ago
well I let's say you want to make the coffee and we split that task into roughly two subtasks. The first is to imagine what motions are necessary to do that. How does the coffee cup have to move, how does your hand have to move to gras
249.
by golol 3y ago
Yea but it helped the arguably larger portion of the population which dont see their children starve anymore due to cheaper food.
250.
by golol 3y ago
I feel like some people living wealthy cushy American lifestyles think the world is fine the way it is. It's not. The world has a dramatic lack of physical and mental labor, which is the cause of economic struggle. The best hope these
251.
by golol 3y ago
sensorimotor control is imo not at all the bottleneck. Teleoperated androids could do lots of useful things right now, but the AI is lacking to automate them.
252.
by golol 3y ago
The real advancement is the consistency of character, scene, and movement!
253.
by golol 3y ago
Lack of quality in the details yes but the fact that characters and scenes depict consistent and real movement and evolution as opposed to the cinemagraph and frame morphing stuff we have had so far is still remarkable!
254.
by golol 3y ago
Come on, don't you see that the capability to understand the physical world that sora demonstrates is exactly what we need to develop those household robots? All these genAI products are just toys because they are technology demonstrat
255.
by golol 3y ago
Biology literally took a planet sized genetic algorithm with nanomachines a couple Billion years to get to this point.
256.
by golol 3y ago
This does put a smile on my face
257.
by golol 3y ago
The way that LLMs are billed now, if you can densely pack the context with relevant information, you will come out ahead commercially. I don't see this changing with the way that LLM inference works. Really? Because to my understanding
258.
by golol 3y ago
I think one issue with this is that some candidates who might be great at the actual job could, for whatever reason, be bad at this verbal type of simulation. Perhaps they work by staring at the problem on their screen a lot, perhaps they s
259.
by golol 3y ago
Well for LLM services that do what they currently do google may have an advantage, but all this stuff is still only experimentation with the goal being hopefully much more advanced things, like almost-agi agents. If this happens then no one
260.
by golol 3y ago
LLMs are Marokov Chains in the following sense: States are vectors of context-length many tokens. Then the model describes a transitions matrix: For a given context-length sized vector of tokens it gives you probabilities for the next con
261.
by golol 3y ago
Energy is not really all that bottlenecked.
262.
by golol 3y ago
Exactly, there is a triangle of tradeoffs here: prettyness vs easyness vs responsiveness. You can only have 2 of them. pretty and easy is Latex. The reason people call CSS a nightmare is because responsiveness fundamentally makes it much mo
263.
by golol 3y ago
I know what you mean, but at some point when I played with it it could reasonably modify an image based on queries. Like, if I asked it to add smoke to the house's chimney, it would put grey blobs above the house, or if I asked it to g
264.
by golol 3y ago
Depends how you define the reddit model, but I think the model [question -> post question on reddit -> select top reply after 1 day -> answer] does have a world model. (It uses the world models of reddit users obv.)
265.
by golol 3y ago
It is largely a text-only model, but tiny amounts of information from other modalities are indeed represented in the text. The best example is GPT-4's drawing ability. From text only it might theoretically be possible to infer to some
266.
by golol 3y ago
I remember playing around with GPT-2. I was absolutely amazed to see that it knew some characters from Dota 2 or Supreme Commander. I thought damn this thing has a whole world model inside, because it can clearly memorize concepts and talk
267.
by golol 3y ago
I should've said even when it does not involve... English can be funny.
268.
by golol 3y ago
Religion is also deceptive and snake-oil even if it does not involve profit driven motivations.
269.
by golol 3y ago
> The primary purpose of the commercially and publicly available generative AI is to undercut human labour. As is the primary purpose of almost all technology, so not per se a bad thing. > What it serves up is frequently too similar t
270.
by golol 3y ago
> If these things don't need to be trained on the work of others for whom they don't have consent and have not paid a license fee to, then why are they? You made a point about meta training on non-publicly viewable/freely

More ›