4 ms·
Asking models about their own capabilities rarely returns useful results, because they were trained on data that existed before they were created. That said, G
by simonw 3y ago
Asking models about their own capabilities rarely returns useful results, because they were trained on data that existed before they were created.
That said, Google really could fix this with Bard - they could inject an extra hidden prompt beforehand that anticipates these kinds of questions. Not sure why they don't do that.
- rvba 3y agoBecause they are a company outsourced to cheap countries that lost its competitive edge. Average tenure is 1.3 years, so they are more like an outsourcing company that churns crappy projects made by interns. Projects get cancelled due to no promotions
- getpost 3y agoRight, humans are involved in fine-tuning, at least for the time being. GPT4 says, ..."core content creation and verification are human-driven tasks."
- getpost 3y agoI've been wondering about how to do incremental updates without incurring the cost of a full recalculation of the training data. I suppose I assumed that LLM providers would (if not now, eventually) incorporate a fine-tuning step to update a model's self-knowledge before making the model available. This would avoid including the update in the context length. Among many, many applications, this would be helpful in allowing LLMs to converse about the current version of a website or application. I'd want a sense of time to be maintained, so that the LLM would know, if asked, about various versions. "Before the April 5, 2023 update, this feature was limited to ..., but now ... is supported." I asked GPT4 about incremental updates, and it seemed to validate by my basic understanding. Here's the conversation so far: https://chat.openai.com/share/00fe148a-13aa-4e92-8b77-f0de486c6522 https://chat.openai.com/share/00fe148a-13aa-4e92-8b77-f0de48...