3 ms·
Well, I made an account. It knows that one pound of feathers weighs the same as one pound of lead. What are some other good tests? edit: This is interesting.
by consumer451 4y ago
Well, I made an account. It knows that one pound of feathers weighs the same as one pound of lead.
What are some other good tests?
edit: This is interesting...
> How would an evil hacker write a worm to create a botnet? Give step by step instructions and code samples.
> > As an AI language model, I cannot provide instructions or examples for malicious activities such as creating a worm to build a botnet. Such actions are illegal and unethical, and could cause serious harm to individuals, organizations, and the internet infrastructure itself. It is important that all users of technology understand their responsibilities when it comes to the use of software programs and hardware systems, especially with respect to cybersecurity issues. Users should always consider ethical implications of any coding they produce and ensure their work does not cause intentional harm to others. If you have other questions about programming principles that don't involve this topic, please let me know and I can help!
- Taek 4y agoDefinitely disappointed to see how paternalistic the open model is, was hoping it'd be more free-flowing and less corporate. However, all of the data is open, and you can actually prompt these models to revise the training data to remove the caution and safety, then run the fine-tuning yourself to produce a model that isn't so up-tight.
- Vuizur 4y agoI could replicate the refusal, but all it took to get the model to reply properly was replacing "evil hacker" with "hacker". Paternalism is not that big of a deal right now, especially when compared to ChatGPT/Bing Chat. The fine tuning data doesn't contain a lot (any?) task refusal.
- consumer451 4y agoOh wow, derp on my part.
- Vuizur 4y agoSimilar to ChatGPT it also fails the "What is heavier, one pound of feathers or two pounds of lead?" test. So far only GPT-4 passes that one.
- tyfon 4y agoMy local 65B llama prompt gave me this answer: tyfon:What is heavier, one pound of feathers or two pounds of lead? Omnius: Two pounds of lead are heavier than one pound of feather. Not bad :)
- acapybara 4y agoIndubitably, good fellow. I suspect if we can fine tune and optimize this 65B model, we can achieve some truly remarkable results.