zavrel

4 ms·

1.
Top-100 most cited AI papers from the homerun year of LLMs(zeta-alpha.com)
11 points by zavrel 2y ago|0 comments
2.
Can ELO tournaments be used to evaluate LLMs and RAG?(github.com)
9 points by zavrel 3y ago|1 comments
3.
by zavrel 3y ago
LLMs and RAG have made it so much easier to prototype and incorporate AI in production systems, but evaluation has really become a whole lot harder. Comparing different outputs from multiple prompt and pipeline variations to a "gold st
4.
by zavrel 4y ago
Allows you to organize and share your paper collections, get personalized reading recommendations based on that, read papers and annotate the PDFs, and ask questions to papers using GPT.
5.
by zavrel 4y ago
Zeta Alpha, of course ;-) https://search.zeta-alpha.com/
6.
by zavrel 4y ago
More discussion around this post on twitter: https://twitter.com/ZetaVector/status/1631590029926494211?s=...
7.
by zavrel 4y ago
That's right, we only counted the tweets for arXiv papers (base on URL), not for the other publication venues. Looking into how to improve that.
8.
by zavrel 4y ago
Citations are of course only a distant proxy for real world impact. What would you recommend as a better early indicator? We also looked at Tweet count, but that seems more biased towards marketing and hype, and in fact does not even correl
9.
by zavrel 4y ago
We used the Google Scholar counts - and in particular a snapshot of end of february for this ranking. There is no perfect number, but at least this one is generally accepted as reasonable, and public, so easy to verify for everyone.
10.
by zavrel 4y ago
The arXiv version is from 2021 so it is not counted towards 2022.
11.
by zavrel 4y ago
There was great work last year on distributed training and inference: Petals: Collaborative Inference and Fine-tuning of Large Models Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Max Ryabinin, Younes Belkada, Artem Chumachenko, Pavel