3 ms·
Why you keep saying it's magical to me? You're the one describing the underlying maths as if it makes it special. To the model these 'high dimensional embedding
by namaria 2y ago
Why you keep saying it's magical to me? You're the one describing the underlying maths as if it makes it special. To the model these 'high dimensional embeddings' are just long lists of numbers.
I've said it before and I'll repeat. Using terabytes of number lists to achieve a decent NLP isn't all that impressive.
- danielmarkbruce 2y agoBecause you don't understand it, and it's understandable. Get a version of GPT-2 or something from huggingface. Go through layer by layer. Anyone with brain is impressed by the state of the art LLMs. What's next? The latest GPUs aren't impressive because "shoving a bunch of electrons all around the place to do elementary arithmetic isn't impressive"? The difficulty is getting a bajillion little things to come together in a way that is useful. Pointing out that some complex thing is not impressive because it's "just lots of little simple things" is dumb as hell.