didntreadarticl

16 ms·

61.
by didntreadarticl 4y ago
American news organisations are all paid for by advertisers who have a vested interest in the status quo
62.
by didntreadarticl 4y ago
It doesn't have to be a conspiracy, its just natural for big news corporations to promote news that benefits big news corporations, and to stay quiet about the news that doesn't benefit them https://en.wikipedia.org&#x2
63.
by didntreadarticl 4y ago
But maybe in the milliseconds where billions of GPUs across a vast network activate and process your input, and weigh up a billions parameters before assembling a reply, there is a spark of awareness. Who's to say?
64.
by didntreadarticl 4y ago
We dont know how self awareness works, so we're not in a position to say what has and hasnt got it
65.
by didntreadarticl 4y ago
lol I'm in too
66.
by didntreadarticl 4y ago
"Why, that would mean... I really don't know what the outside universe is like at all, for certain." "That's it." "Intriguing. I wish I had more time to discuss this matter" "Why don't you
67.
by didntreadarticl 4y ago
This Google and Microsoft thing does really remind me of Robocop, where there's a montage of various prototypes being unveiled and they all go disastrously wrong
68.
by didntreadarticl 4y ago
I lament the lack of flashing red matrix light displays on modern supercomputers
69.
by didntreadarticl 4y ago
Come to think of it, thats kindof what Tesla are building
70.
by didntreadarticl 4y ago
Except that the experiment happened before privatisation, rather than after, which is the point, I think?
71.
by didntreadarticl 4y ago
I dont think of the 4000 tokens as its memory as such. Its more like the size of its thinking workspace
72.
by didntreadarticl 4y ago
It predicts the next word based on the preceding 2000 words or so, thats the thing. And to do that takes serious modelling.
73.
by didntreadarticl 4y ago
If you imagine a log file that gets lines added to it now and then, its actually quite fiddly to do that with XML because of the closing outer tag
74.
by didntreadarticl 4y ago
[factorial joke]
75.
by didntreadarticl 4y ago
Whenever I hear people talk about JSON schema spec it reminds me of XML in the 90s.
76.
by didntreadarticl 4y ago
Its true, I can bang together an XML doc by hand with less worry than if I type out some JSON
77.
by didntreadarticl 4y ago
Thats "XML - the religion"
78.
by didntreadarticl 4y ago
Well, except that one happened in a time before the other, which was jossclimb's point, I believe.
79.
by didntreadarticl 4y ago
XML vs JSON is such a fascinating topic, a clash of different approaches, academic vs practical might be one way of describing it but I'm sure there's many others. Are there any good books or essays on it? And having been there in
80.
by didntreadarticl 4y ago
I know that. its a metaphor to adjust the 'Thai Language' intuition-pump that was presented. I'm making it easier to imagine how a Large Language Model might make a Model of the Language
81.
by didntreadarticl 4y ago
I think about its 4000 token length. For the brief amount of time that it absorbs and processes those 4000 tokens, is there a glimmer of a hint of sentience? Like it is microscopically sentient for very short bursts and then resets back to
82.
by didntreadarticl 4y ago
Oh of course its not it. The question is how it relates to some future better thing. Is it a step on the road or a dead end. I'm arguing against the 'its just a statistical model and its playing a clever trick on us' camp.
83.
by didntreadarticl 4y ago
me: wibble octopus downwards jelly tuesday banana chatGPT: I'm sorry, but I'm not sure what you're trying to communicate with that sentence. Could you please rephrase or provide more context?
84.
by didntreadarticl 4y ago
Ideally in that scenario you'd have a model that unified vision, language and an understanding of 'doing things' and manipulating objects. so it wouldnt just be an LLM, it would be a language-vision-doingthings model. There&#
85.
by didntreadarticl 4y ago
Ok I like your thought experiment. Lets change it a bit. Instead of it being an unknown language, its English (a language you know), but every single Noun, Verb, Adjective or Preposition has been changed to Thai (a language you dont know).
86.
by didntreadarticl 4y ago
So your proposed system would be a extremely interesting exploration of that! I look forward to it. Right, so lets virtualise it. Actually training AIs using real cameras and real robot arms will be really slow and expensive. So we provid
87.
by didntreadarticl 4y ago
your question is pretty confusing. What dog? station is a vague word. Train station, police station? Case is a vague word. And asking whats in the station is still asking whats in the case, in a way. Me: There's a blue suitcase in the
88.
by didntreadarticl 4y ago
There are two camps, evident in this thread. one camp is 'its just a statistical model, it cant possibly know these things' The other camp (that I'm in) sees that we might be onto something. We humans are obviously just more
89.
by didntreadarticl 4y ago
OK how about this: It 'knows' language, as in it has learnt about relationships between words (and thats really underselling it, in reality it has learnt very very subtle relationships between a great many words, and it can proces
90.
by didntreadarticl 4y ago
LLMs cant think and submarines cant swim

More ›