3 ms·
Yeah, I was looking for a book about this topic, but there doesn't seem to be anything out there except for research articles, it is just too new. When I look
by auggierose 4y ago
Yeah, I was looking for a book about this topic, but there doesn't seem to be anything out there except for research articles, it is just too new.
When I look at the descriptions of the papers, it sounds incredibly complicated, and at the same time incredibly trivial. Clearly this whole domain is not well enough understood yet to be explained properly. Or maybe there is no interest yet in clear and concise explanations.
- KHRZ 4y agoThe description of the attention mechanism of GPT architectures and a couple of examples can be very brief. Then you have to supply your imagination and realize that the model simply found a whole bunch of very effective such attention measures by itself, which are all computed for every query, and they could be anything from the straight forward examples, or some more clever abstract types of attention. I think we'll need some more descriptions of what the more important attention measures it comes up with really are, to understand better.
- CongoDan 4y agoThat’s how blockchain was a few years back. Now everyone and their uncle has a “how blockchains work” article or video
- corbulo 4y agoAnd yet I feel like I know less at this point than I did then.