3 ms·
Doesn't understanding language require that a model understands trends in the features of text embeddings inputted into it? And haven't we found that the more t
by yeck 3y ago
Doesn't understanding language require that a model understands trends in the features of text embeddings inputted into it? And haven't we found that the more text and transformers the complex the trends it can understand in that text? If you have enough features present in medical records, why wouldn't it be able to find trends?
- astrange 3y agoBecause 1. it has a limited context window, so it has no permanent memory 2. you can't fine-tune ChatGPT/GPT-4 to get around this, and of course 3. language models don't do anything by themselves unless you input text into them.