3 ms·
Recent and related: Mistral 7B - https://news.ycombinator.com/item?id=37675496 https://news.ycombinator.com/item?id=37675496 - Sept 2023 (618 comments) Is ther
by dang 3y ago
Recent and related: Mistral 7B - https://news.ycombinator.com/item?id=37675496 https://news.ycombinator.com/item?id=37675496 - Sept 2023 (618 comments)
Is there significant new information here? (That's the test we use for followups:
https://hn.algolia.com/?dateRange=all&page=0&prefix=false&sort=byDate&type=comment&query=%22significant%20new%20information%22%20by%3Adang https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so...
https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=follow-up%20downweight&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...)
- fgfm 3y agoWell, that was a blog post, but they just released a research paper. And in comparison to the blogpost, they indeed added more information regarding the attention mechanism they used, details about the architecture, more evaluation results (Arena Elo rating) etc. Not saying it's novel, but it's useful from a research perspective and well appreciated that they added new information in there I would say. But let me know if you feel differently