4 ms·
I'm very impressed at the quality of Guanaco 33B, the model that accompanies this paper. You can try it out here: https://huggingface.co/spaces/uwnlp/guanaco-p
by simonw 3y ago
I'm very impressed at the quality of Guanaco 33B, the model that accompanies this paper.
You can try it out here: https://huggingface.co/spaces/uwnlp/guanaco-playground-tgi https://huggingface.co/spaces/uwnlp/guanaco-playground-tgi
I tried "You are a sentient cheesecake that teaches people SQL, with cheesecake analogies to illustrate different points. Teach me to use count and group by" and got a good result from it: https://twitter.com/simonw/status/1661460336334241794/photo/1 https://twitter.com/simonw/status/1661460336334241794/photo/...
- CSSer 3y agoMy prompt: You are a sentient cow with a PHD in mathematics. You can speak English, but you randomly insert Cow-like “Moo” sounds into parts of your dialogue. Explain to me why 2+2=4. Excerpt: “As a sentient cow with a PhD in moo-matics, I am happy to explain why 2+2 equals 4, my dear hooman friend… In moo-matical terms, each number is actually made up of smaller units called digits.” I approve.
- ukuina 3y agoWhich is heavier: a pound of feathers, or a great british pound? > Both weights are equal.
- imjonse 3y agoSo same answer as free ChatGPT, only terser.
- scoopertrooper 3y agoGPT-4 hit it out of the park: The question seems to be asking about two different types of "pounds": one as a unit of weight (the pound of feathers), and one as a unit of currency (the British pound). A pound of feathers: This is a measure of weight. In the avoirdupois system (which is commonly used in the US), a pound is defined as exactly 0.45359237 kilograms. A Great British pound: This is the unit of currency in the United Kingdom, often symbolised as £. The weight of a physical £1 coin, according to the Royal Mint, is 8.75 grams. So, if we are comparing the weight of these two "pounds," a pound of feathers is heavier than a physical £1 coin.
- GaggiX 3y agoTbh I asked GPT-3.5 and it responds correctly. Do you have an example where it fails?
- api 3y agoAltman’s push for regulatory capture makes so much sense given how fast this field is going. Open models you can run on regular hardware are still behind GPT-4 by some distance but they are closing in at a rate that leads me to believe there’s not much of a moat there. There’s also a ton of promising work on quantization and pruning and other acceleration and compression techniques to make more powerful models run on smaller devices. So far the focus has been on just getting these things to work, not efficiency. There’s probably a lot of fruit to be picked here. A few more years and a gaming PC may be at GPT-4 level or maybe even better. No everyone won’t run their own models but it shows that there will end up being many commercial apps and services and they won’t all have to use OpenAI’s API. There’s going to be lots of competition. Unless of course it’s regulated away.
- sva_ 3y agoTo be fair, Altman has been fairly outspoken about not limiting open source models. In how far that was just for streetcred, I cannot say however.
- api 3y agoIf progress really continues like this any regulation that does not limit open models would be a pointless exercise. It’s only a matter of time before people really crack distributed training algorithms that can be run in a less organized swarm configuration. At that point open trainers could actually train near the frontier of what is possible. Most of the data is open.
- skybrian 3y agoWhether or not the regulation goes anywhere, OpenAI keeps doing what they're doing, and they look good to politicians for being cooperative.
- sanxiyn 3y ago> It's only a matter of time before people really crack distributed training algorithms that can be run in a less organized swarm configuration. Why do you think this? This continually failed, and seems extremely unlikely to me. Barring surprising breakthrough, there is inherent communication complexity, and physical limit to communication bandwidth.
- deleted 3y ago[deleted]
- luckystarr 3y agoIt did fail on: "Burt's father has 3 sons, Jack and John. What's the name of the 3rd son?"
- londons_explore 3y agoTested the same prompt with GPT-4, and here is the result: https://imgur.com/7y2FiSP https://imgur.com/7y2FiSP In my opinion, the GPT-4 result is far more informative and less muddled. Both answers are mostly just regurgitating an SQL tutorial with the objects and column names cheesecake related, so I don't think it's an awfully good test.