4 ms·
If I understand correctly, your focus will be on smaller models and what can be built on top of them? How relevant do you think fine-tuning small models will be
by reqo 3y ago
If I understand correctly, your focus will be on smaller models and what can be built on top of them? How relevant do you think fine-tuning small models will be once AGI is widely accessible? Do you think smaller models can co-exit in a AGI future?
- ska 3y agoConversely, how relevant do you think 2023 techniques will be at all in a hypothetical AGI future? Doesn't the relevance of these questions embed some pretty strong assumptions?
- jph00 3y agoI plan to write a longer article about this in fact! In short, I think we already have AGI, but I'm not sure it's going to get dramatically better quickly (i.e I don't think it's a clear path to ASI). I think AGI is actually less important than we all expected it to be, and that it doesn't replace more tightly focused domain-specific models.
- pigeons 3y ago> I think we already have AGI, This is the only time I have seen anyone claim this. Can you elaborate?
- eries 3y agostay tuned
- lmeyerov 3y agoComputers that can reliably write programs / higher-order logic has long been one of my big fundamental bars for useful AGI. It will clearly get better, but for a lot of what knowledge workers already do... The bar has been cleared, and now engineering is playing a much easier game of catch-up. (Hi Jeremy!)
- Roark66 3y agoYes, I'm inclined to agree, it is very flawed AGI, but AGI nevertheless. When you ask chatgpt4, "tell me the pH an electric conductivity of a 0.5% solution of sodium 2-ethylhexanoate" and then it writes a python program to calculate it, that is pretty much AGI level ability in my book.
- jph00 3y agoSure, here's Norvig making this claim: https://www.noemamag.com/artificial-general-intelligence-is-already-here/ https://www.noemamag.com/artificial-general-intelligence-is-...