4 ms·
Tell me you've never heard of text embeddings without telling me you've never heard of text embeddings. The neural net you describe lacks memory. Memory, funda
by TeMPOraL 3y ago
Tell me you've never heard of text embeddings without telling me you've never heard of text embeddings.
The neural net you describe lacks memory. Memory, fundamentally, is a box with inputs and outputs. If you add it to your robot, and train the NN to use it, the robot may just be able to learn enough to be useful.
This setup is of course limited by NN's capability to use that memory I/O to alter its outputs in sensible and useful ways. Until recently, I don't think anyone would fault you for believing this capability is extremely limited, as NN's can't do anything that even begins to resemble reasoning. But this was then, and now things are different - as clearly demonstrated by GPT-4.
I mention text embeddings not because they're particularly optimal for the learning robot, but because they're a direct demonstration that it's now trivial to marry a sophisticated, (quasi-)reasoning-capable NN with a form of generic memory that can efficiently store anything the NN can work with, and which that NN can effectively search for the things it needs. You can verify the effectiveness of this on your own, for cheap, with GPT-4 and a vector database of your choice.
At this point, a prototype of a learning robot seems possible to implement by a combination of some image2text model, converting camera feeds to a description of what the robot "sees", some code (not even ML model, just regular code) to convert other sensory inputs into a higher-level textual description, an embedding model and a vector database to remember all that, GPT-4 for filtering, combining and summarizing inputs to be remembered, evaluating current situations, generating plans, perhaps even control outputs - all chained together by small amount of glue code (which GPT-4 will likely be able to write for you).
Will it work? There is no obvious reason why it shouldn't. We'll know soon enough - I expect a paper describing this to show up within next 6 months, if it hadn't already. It's too easy an experiment to make. Will it work well? Probably not at first. And it'll definitely be slow and expensive to run. But those are problems we know can be solved by throwing money at engineers and entrepreneurs.
- YeGoblynQueenne 3y ago>> Tell me you've never heard of text embeddings without telling me you've never heard of text embeddings. Just to clarify: are you trying to tell me I don't understand what word embeddings are? I want to be very clear about this before I formulate an answer, because if I'm right, the answer is going to be one of my [dead] comments with great certainty.
- TeMPOraL 3y agoThe way I see it, you either don't realize we already know how to give NNs useful forms of memory, or you're insisting that NNs are not good enough unless they continuously train themselves while interacting with the world. In the latter case, I'm trying to tell you that this is not a real problem, for roughly the same reasons that our inability to build self-replicating nanotech doesn't prevent us from building machines, including robots autonomously navigating the physical world.
- deleted 3y ago[deleted]
- YeGoblynQueenne 3y agoI see, so you've thought very hard about all the things I could be thinking of (all two of them!) and by sheer logical deduction you have arrived at the inescapable conclusion that I don't know what word embeddings are. Unfortunately HN does not allow me to ignore users so I don't have to see their comments, so I'm just gonna stick this conversation in a little bookmark and when I see your username and it reminds me of something, I'll check that bookmark to make sure, and ignore what you say. Wasted plenty of time as it is.