3 ms·
The models do not update based on input yet and the context windows are still relatively small, ie. no one has an actual "friend" longer than the context window
by MyFirstSass 3y ago
The models do not update based on input yet and the context windows are still relatively small, ie. no one has an actual "friend" longer than the context window?
I can understand losing an assistant that you have confided years of information too, but a few pages? Then you can just talk to the same model and have it "be the same" in a few hours?
Or are they actually in love with some simple fine tuning of some standard models done by these companies + a simple AI generated face?
- rwmj 3y agoMy cat's "context window" is pretty small, but I'm still talking to her every day. People do very strange things when you look at them analytically.
- MyFirstSass 3y agoThis makes a lot of sense, and has quite interesting implications. I guess you don't need that advanced AI before to get an actual attachment. Reminds me about several things, pets, tamagotchis, monkey experiments with mothers replaced by dolls, and stranded / lonely people creating inanimate friends, paying for a shrink. I guess it can be both very beautiful, but scary in a commercial context.
- hanselot 3y agoCouple of years ago 1k context was remarkable. Now we have public domain models with 200k context. Soon they will figure out how to fine tune the context in while conversing. Then context is only relevant for the current inference.
- deleted 3y ago[deleted]