4 ms·
Funny how they don't mention the solution: to have AIs actively participate in the real world. I mean, it's hardly what people here want to see happen, but that
by candiodari 3y ago
Funny how they don't mention the solution: to have AIs actively participate in the real world. I mean, it's hardly what people here want to see happen, but that will solve it.
- courseofaction 3y agoHow?
- andai 3y agoBy releasing them from being confined to their own farts.
- rickdeckard 3y agoThat frames it like ML-models are caged intelligent beings which would prosper if only someone would set them free...
- candiodari 3y agoYou know, actual "intelligent beings" are also next-token-predictors that are caged in a mechanism that forces them to give certain outputs ...
- andai 3y agoI've been coming back to this comment and I'm not sure what you mean exactly. The brain is trapped in the body, and forced to meet its needs (e.g. regulate hormone levels). The brain and body are trapped in civilization, and forced to produce "outputs" it considers acceptable. All three, in turn, are trapped in natural selection.
- dimask 3y agoCurrent LLMs cannot "actively participate in the real world" as humans do because they cannot actively learn from their interaction with the real world. Their weights are fixed. Their further training and finetuning is mediated by external mechanisms. It has nothing to do with what "people here" want.
- exoverito 3y agoSure, though it seems there are a number of near term paths for improvement. Short and long term memory mechanisms would go a long way towards active learning. Fine tuning could be iteratively performed through mechanisms like low rank adaptation. It's been hypothesized that this is one of the purposes of sleep, and humans are consolidating memories during dreams.
- candiodari 3y agoNot true. There's plenty of easy ways to update the weights if you want to do that. You could for example DPO based on another LLM's evalution of how a conversation is going, or you could use whether the conversation keeps going.
- staticman2 3y ago>>>"You could for example DPO based on another LLM's evalution of how a conversation is going," You can update the weights based on a single point of data (response was bad) but you probably can't usefully update a model that way.
- candiodari 3y agoI can't seem to find anyone actually usefully trying this. Do you know of any data?
- staticman2 3y agoNo but Google (for example) recommends fine-tuning based on at least 500 examples of question response pairs. DPO as far as I know requires a good and bad example. It's not a technique based on just saying "ai response is bad".
- rickdeckard 3y agoBut that's practically what's being done in supervised learning. If you would isolate a child in front of a CCTV screen, it also wouldn't magically learn from the images what's our definition of a tree, a bush, a bike, a motorcycle, a car. Someone would have to take it aside and explain it first. In AI you just don't take it aside, you build a new child. Supervised learning is "Hello lil CCTV model. Here's a bucket of some 'world' data, labeled in a way for you to ingest. Here, some images of T-R-E-E-S...".