dingclancy

6 ms·

31.
by dingclancy 4y ago
How about training data from interactions just by sheer usage numbers? Google does not have that. There is a reason why the quality of ChatGPT responses are better. RLHF.I am not sure though how Google can be 3x better than OpenAI to make u
32.
by dingclancy 4y ago
The biggest threat to Google is if people stops going to google.com. It does not matter now if ChatGPT is successful with their product. the fact that you can take these LLMs and put them anywhere EXCEPT google.com, Google is f'd up. T
33.
by dingclancy 4y ago
> That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows what will be next. You cannot assume what will happen in Web 2.0, mobile, iPhone, will happen here. Ge
34.
by dingclancy 4y ago
It is not just LLM though. Google is big tech and they have to fend off AI browsers, AI image generation, Github Co-Pilot, Office 365 with LLM, Notion AI. Chatbots is just one narrow product. So far they have an inferior chatbot layer to t
35.
by dingclancy 4y ago
Sundar.
36.
by dingclancy 4y ago
Been reading that really quick responses. I think Google would be happy if the the chatbot is so really slow because people have been using it a lot.
37.
by dingclancy 4y ago
There would be parameters to evade the obvious picks. temperature can actually go up to 2 in the API and you can also go use top_p < 1. but for the more out of this world stuff, this is where fine tuning will come in. The main model wil
38.
by dingclancy 4y ago
Actually if ChatGPT gives you a bad/wrong answer, and you reply telling it is wrong and why it is wrong, it will answer with something that you think is correct. So you are already doing a kind of real time RLHF in the chat. That is ho
39.
by dingclancy 4y ago
LLM's right now are just a beast that everyone has it own idea of taming it. Like everyone was given a lion, and now it is our job to turn it into a cat that is useful for us. There are dangers and benefits to it. In this context, this
40.
by dingclancy 4y ago
I have never seen a human made website with a truth-fiction slider. The answers can be straight up false and scary, but it is no different from other publications out there. Even with the most credible news sources, it is still up to the pe