4 ms·
If you cut some words out of a newspaper and a person writes words in those blanks then what has happened? If we cut out parts of a painting and a person paints
by just1morething 6y ago
If you cut some words out of a newspaper and a person writes words in those blanks then what has happened? If we cut out parts of a painting and a person paints in those blanks then what has happened? How is the person who wrote in the blanks or the person who painted in the blanks changed by writing or painting in the blanks? How are they changed when someone responds to what they've written or painted? How did the original writer or painter come to write and paint what was later blanked out?
Here are some words that I read but did not grasp firmly: learn, data, task, train, intelligence, general, model, skill, label, language, understanding, reality, observation, predictive, objects, concepts, act, hypotheses, knowledge, 'common sense', 'dark matter', 'artificial intelligence', teaching, classify, supervision, autonomous, 'self-supervised learning', recognize, patterns, representations, processing, systems, pretrained, vision, real-world, helpful, promising, 'energy-based models', prediction, uncertainty, 'joint embedding methods', 'latent-variable architectures', reasoning, 'predictive learning', 'supervisory signals', signals, structure, unobserved, property, input, 'co-occuring modalities', 'unsupervised learning', feedback, reinfrocement, 'downstream tasks', meaning, syntactic, word, associate, probability, vocabulary, 'convolutional network', network, 'prediction uncertainty', 'predicting missing words', computing, softmax layer, probability distribution, energy, incompatible, computer vision, and so on.
- visarga 6y agoOne could make a similarly long list of poorly understood concepts in psychology.
- just1morething 6y agoI've found that plucking words from paragraphs has, on occasion, brought them more firmly under my control-- most of them remain mysterious to me when they pop up in papers on programming or psychology. Rather than list "ideas" or "concepts" I try to make a record of what appeared and the response I had to its appearance. How are we to solve difficult problems if we stop mentioning them or their difficulty?
- fantod 6y agoIf the person who filled in the blanks already had a good grasp of the language, they probably didn't learn much. However, fill-in-the-blank exercises can be a good language learning tool for children as well as adults learning a foreign language.
- just1morething 6y agoThere is something special about that "lock and key" moment when you feel that satisfying "click" as your response opens the next opportunity.
- social_quotient 6y agoEscape rooms for language models :) (Context https://en.m.wikipedia.org/wiki/Escape_room https://en.m.wikipedia.org/wiki/Escape_room )
- jtsiskin 6y agoThe person isn’t changed, just like the weights aren’t changed. You’re missing the training step - after the person fills in the blank, then we tell them what was supposed to go in the blank. If I had you try to paint the the rest of the face of a portrait, you may do a poor job, but then if I showed you exactly what it was supposed to look like, you can see what you did wrong, and next time you will draw it better.