14 ms·

If you are comfortable with sending your most intimate thoughts over the internet, to a for-profit entity (capped profit as they call themselves, but potato pot

by NhanH 4y ago

If you are comfortable with sending your most intimate thoughts over the internet, to a for-profit entity (capped profit as they call themselves, but potato potato), I really implore you to either reconsider the level of introspection you have for yourself, or to spend the next 10000 days journaling figuring out if you really and truly thinks it through. Your journal should often time have things that you would barely be able to talk to your therapist. I am sorry for being a downer, but this is a horrible idea.

azinman2 4y ago
What is the actual risk here? That it’ll be publicly posted? Integrated into their next model? Leverage for some unknown evil action?
- m3kw9 4y ago
  Only thing is maybe able be identified back to you. In the future this info can leak and some create a website for fun to see what this or that person has leaked info(tho likely illegal), but if someone wanted to doxx you they don’t care, so there is that risk. The other one I can think of is unscrupulous insurance company or job agency want to get an edge on you
  - Pietbull 4y ago
    I'm thinking of creating something similar to OP app (Without the "ChatBot therapist" part). However, what could the actual risk to "Dear Diary, today I cheated on my wife" be if that information is sent to GPT3/similiar anonymously? I.e. no metadata able to ID the user?
- roywiggins 4y ago
  Any of the above. It's not like people haven't had the idea of trying to weaponize therapist notes before: https://www.smithsonianmag.com/history/the-worlds-most-famous-filing-cabinet-36568830/ https://www.smithsonianmag.com/history/the-worlds-most-famou...
- cf141q5325 4y ago
  That you get perfectly personalized propaganda. You are writing a spec for getting brainwashed.
  - azinman2 4y ago
    You think OpenAI is using this to somehow nefariously brain wash you? I can’t tell if you’re being serious or not.
    - cf141q5325 4y ago
      This isnt about assuming somebody has nefarious ends in mind, its about what data becomes available and what power you give somebody with that. I am saying the data you are creating during usage will at some point become useable this way. As mentioned elsewhere in this thread, this only starts to work well once you allow for memorizing earlier conversations. Which means the product here is the chatbot + your personalized configuration. Think about how your search pattern and internet usage is currently used to personalize advertisements and recommendations of stuff that is tailored for engagement. Which already went as far as influencing your decision to vote. This is a lot more powerful because it doesnt just categorize you into groups that got split-tested for reactions but allows for learning your values, shortcomings and decision making process. In essence you are explaining why you think what and what your weak points are. I find it hard to ignore the overlap to where the work on IBMs Watson led to a few years ago. Though in a positively framed manner with Juliane Gallinas "Patton in your pocket", a tool to aid peoples process. In the end its both operations in the information space that can be used to aid or exploit your thinking. Brainwashing is a loaded term but thats what propaganda is. Its framing things in a way to get predictable reactions out of you and have your cognitive biases defend those reactions. We are talking a lot about miss- and dissinformation, but the missing context is a lot more powerful, especially when its used with cognitive biases that have you for example be very loyal to the first point of view you encountered and identified with on an issue. What a journal bot is is a tool you use to help you with the shortcomings in your sense making and decision making process which is weighted for what you value. Giving that information away to a centralized entity is placing a lot of trust in that entity overcoming the economic incentives to use that data in an economically beneficial way. With the lines between economically beneficial and politically beneficial being very easy to cross. In short, I find training a personalized crowbar for your brain and giving it away to whoever highly irresponsible. edit: Framing it as brainwashing is an unfortunate but good example. It creates another reaction then using terms like influencing. You are likely to have an adversarial reaction due to you being smart and your brain not being up for any washing. Framing creates grooves people get caught up in with cognitive biases acting as inertia and gravity towards the grooves.
- frabcus 4y ago
  It’s that your subconscious mind won’t feel safe, so you won’t unpack things to yourself that you would otherwise.
6510 4y ago
I found myself almost instantly talking about stuff mortals would not debate.
- 6510 4y ago
  I couldn't find it anymore but on usenet a bunch of physicists one day compiled a list of topic forbidden to research or debate. The only thing that stuck with me was how amazingly long the list was.
deleted 4y ago
[deleted]
HorizonXP 4y ago
I love this article for giving me the idea of using AI to help with journaling. I love this comment because it's exactly how I felt too. All the more reason to get GPT-J running on my GPU.

by NhanH 4y ago

azinman2 4y ago

What is the actual risk here? That it’ll be publicly posted? Integrated into their next model? Leverage for some unknown evil action?

m3kw9 4y ago
Only thing is maybe able be identified back to you. In the future this info can leak and some create a website for fun to see what this or that person has leaked info(tho likely illegal), but if someone wanted to doxx you they don’t care, so there is that risk. The other one I can think of is unscrupulous insurance company or job agency want to get an edge on you
- Pietbull 4y ago
  I'm thinking of creating something similar to OP app (Without the "ChatBot therapist" part). However, what could the actual risk to "Dear Diary, today I cheated on my wife" be if that information is sent to GPT3/similiar anonymously? I.e. no metadata able to ID the user?
roywiggins 4y ago
Any of the above. It's not like people haven't had the idea of trying to weaponize therapist notes before: https://www.smithsonianmag.com/history/the-worlds-most-famous-filing-cabinet-36568830/ https://www.smithsonianmag.com/history/the-worlds-most-famou...
cf141q5325 4y ago
That you get perfectly personalized propaganda. You are writing a spec for getting brainwashed.
- azinman2 4y ago
  You think OpenAI is using this to somehow nefariously brain wash you? I can’t tell if you’re being serious or not.
  - cf141q5325 4y ago
    This isnt about assuming somebody has nefarious ends in mind, its about what data becomes available and what power you give somebody with that. I am saying the data you are creating during usage will at some point become useable this way. As mentioned elsewhere in this thread, this only starts to work well once you allow for memorizing earlier conversations. Which means the product here is the chatbot + your personalized configuration. Think about how your search pattern and internet usage is currently used to personalize advertisements and recommendations of stuff that is tailored for engagement. Which already went as far as influencing your decision to vote. This is a lot more powerful because it doesnt just categorize you into groups that got split-tested for reactions but allows for learning your values, shortcomings and decision making process. In essence you are explaining why you think what and what your weak points are. I find it hard to ignore the overlap to where the work on IBMs Watson led to a few years ago. Though in a positively framed manner with Juliane Gallinas "Patton in your pocket", a tool to aid peoples process. In the end its both operations in the information space that can be used to aid or exploit your thinking. Brainwashing is a loaded term but thats what propaganda is. Its framing things in a way to get predictable reactions out of you and have your cognitive biases defend those reactions. We are talking a lot about miss- and dissinformation, but the missing context is a lot more powerful, especially when its used with cognitive biases that have you for example be very loyal to the first point of view you encountered and identified with on an issue. What a journal bot is is a tool you use to help you with the shortcomings in your sense making and decision making process which is weighted for what you value. Giving that information away to a centralized entity is placing a lot of trust in that entity overcoming the economic incentives to use that data in an economically beneficial way. With the lines between economically beneficial and politically beneficial being very easy to cross. In short, I find training a personalized crowbar for your brain and giving it away to whoever highly irresponsible. edit: Framing it as brainwashing is an unfortunate but good example. It creates another reaction then using terms like influencing. You are likely to have an adversarial reaction due to you being smart and your brain not being up for any washing. Framing creates grooves people get caught up in with cognitive biases acting as inertia and gravity towards the grooves.
frabcus 4y ago
It’s that your subconscious mind won’t feel safe, so you won’t unpack things to yourself that you would otherwise.

6510 4y ago

I found myself almost instantly talking about stuff mortals would not debate.

6510 4y ago
I couldn't find it anymore but on usenet a bunch of physicists one day compiled a list of topic forbidden to research or debate. The only thing that stuck with me was how amazingly long the list was.

deleted 4y ago

[deleted]

HorizonXP 4y ago

I love this article for giving me the idea of using AI to help with journaling. I love this comment because it's exactly how I felt too. All the more reason to get GPT-J running on my GPU.