4 ms·
The difference is between something that makes sense (the way the model is intended to be used) and something that makes almost no sense (this repository). > b
by doctorpangloss 3y ago
The difference is between something that makes sense (the way the model is intended to be used) and something that makes almost no sense (this repository).
> benefit
In an intellectually honest way, it is not conclusive if there is a benefit to the approach in this repository. However, as a betting man: there is no benefit.
There are a lot of surprises! Riffusion and LCMs for me were super surprising. With no examples or meaningful investigation, I don’t think this is going to yield anything.
- MacsHeadroom 3y agoIt's funny that you think the way transformer models are "intended" to be used is the result of intentional engineering and not an accident that ML academics are no closer to giving some causal explanation for why it works today than they were when Attention is All You Need was published.