3 ms·
Why do you think Bing Chat is going in a slightly different direction and not using this format exactly? Their prompt - https://old.reddit.com/r/bing/comments/
by creatonez 4y ago
Why do you think Bing Chat is going in a slightly different direction and not using this format exactly?
Their prompt - https://old.reddit.com/r/bing/comments/11bd91j/release_of_the_whole_initial_prompt_of_bing_chat/ https://old.reddit.com/r/bing/comments/11bd91j/release_of_th...
Wouldn't it be better to unify around ChatML, for the sake of all future training data being consistent? I thought it was strange that they used <|im_start|> but not the rest of the ChatML syntax.
(There is always the possibility that they are using it, but the AI has hallucinated a slightly different syntax when repeating it)
- notamy 4y agoI'm VERY curious about those "#inner_monologue" sections...
- gs17 4y agoLooks like it's just getting it to "show its work" to improve the output.
- int_19h 4y agoTelling ChatGPT to "think it out loud" first before giving the final answer generally leads to better results than just telling it to answer right away. This is especially true in multi-step tasks where you keep adding to input.
- rentnorove 4y agoPlatform lock-in. Interoperability would not only be more costly in terms of the work to design and agree on a common standard, but it'd also makes it easier to switch to a competitor.
- creatonez 4y ago> but it'd also makes it easier to switch to a competitor. Thing is, the end user never sees this implementation detail, so it only matters on their side.
- shepardrtc 4y agoMicrosoft has always been very siloed. They want to do their own thing with it - as evidenced by the pile of hot garbage they've turned it into.