5 ms·
How to Talk When a Machine Is Listening: Corporate Disclosure in the Age of AI
- mensetmanusman 6y agoThis is great. Again proof that any metric that is measured will eventually affect the person being measured. It reminds me a lot of quantum mechanics: “The act of observing disturbs the observed“
- etothepii 6y agoI prefer, "whatever gets measured gets done." Though it doesn't apply in the quantum realm.
- otoburb 6y agoThere's always Goodhart's Law as a counterpoint.[1] [1] https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law
- igorlev 6y ago"En Engine, Not a Camera", a great book and posits that this effect drives a large portion of modern (post-1970s) financial markets. https://www.goodreads.com/book/show/134474.An_Engine_Not_a_Camera https://www.goodreads.com/book/show/134474.An_Engine_Not_a_C...
- curiousllama 6y agoI wonder how long until a corporate disclosure ends up accidentally (or purposefully?) serving as an adversarial attack. Back when I studied it, there were plenty of known 'soft-spots' in different methods (implied negation, euphemism, etc.) that corporate nonsense-speak seems well-suited to replicate. Then again... https://xkcd.com/1958/ https://xkcd.com/1958/
- paulorlando 6y agoInteresting how the CEO feedback effect also relies on a study of what volume of their stock is traded algorithmically. Also seeing things like this monitoring, for example in AI to predict whether students are cheating. https://unintendedconsequenc.es/ceos-students-algorithms/ https://unintendedconsequenc.es/ceos-students-algorithms/
- everling 6y agoA great example of why the success of ML in typical ML domains can't be trivially translated to finance. Typical domains lack feedback. A dog won't alter its appearance as a result of being classified by image recognition algos.
- chordalkeyboard 6y agoThis is a good point but allow me to play devil’s advocate. If a breeder uses an ML system to select from many possibilities to find breeding specimens, then the product of those specimens is used for the next generation of ML system, there is now the possibility of a feedback loop.
- motohagiography 6y agoIs there a use case for ML where it is not perceived as predatory by its human subjects?
- deleted 6y ago[deleted]
- CodesInChaos 6y agoThere are plenty beneficial applications of ML. Some examples I came up in 5 mins: * Recommender engines (e.g. music similar to the one I'm listening to) * Spam filters * Gmail's email classification (not sure how well it works in practice) * OCRing documents * Automated video transcription * Opponents in games * Face unlocks for phones
- tristor 6y ago> * Recommender engines (e.g. music similar to the one I'm listening to) Is only ethical when opt-in, otherwise it violates user privacy to build preference profiles and requires additional private data to make accurate inferences. > Face unlocks for phones Heavily racially biased. Facial recognition in general is heavily racially biased. Other than that, I guess that's a good list. If ML stayed in those arenas it might be a net good, unfortunately those things on the list are mostly side-effects rather than targeted intentions from where research is going (where it's funded). The vast majority of ML/AI work is focused on hijacking people's private data to steal their attention and psychologically manipulate them.
- UnFleshedOne 6y ago"Not working as good" is not the same as "actively working against". Unless of course a perfect Aryan visage serves as a master key to all face-locked phones.
- bobyfyfy 6y agoThe question wasn't "which ML use cases are potentially good", it was "which ML use cases are seen as predatory by users". So it doesn't matter that face detection has the possibility to be good, it's currently bad
- baxtr 6y agoFascinating. Is there already a nice buzzword for this phenomenon in general? I mean IAs read financial reports and will do online shopping for us in the future. Maybe something like IAO? Intelligent Agent Optimization? Just asking for a friend of course...
- larrydag 6y agoOr in other words SEO for corporate filings
- georgeecollins 6y agoWhat I think is funny about this is that some people worry that AI will control us. But if AI were really controlling our lives would we even know? In the example of the paper, machines have taught us how it would prefer we talk about equities. Wouldn't a great intelligence just find subtle ways to incentivize us to do what it wanted without announcing itself or it's motives? Maybe the machines already took over.
- olefoo 6y agoI wonder how long until we see the first lawsuits for stock price manipulation using this feedback loop? If an unscrupulous executive were to make factually true statements that were engineered to mislead automated assessment algorithms so that they or their associates could buy the dip. Would it even technically be against the law?
- liminal 6y ago"Before we begin, we'd like to say the following words to help our share buyback program: difficult, concerning, challenges, headwinds, losses, failure, negative, consequences, layoffs, closures, adverse events. Thank you. We will now begin our earnings call..."
- ssivark 6y agoI wonder if this opens the platforms to adversarial use cases, such as gate crashing the Q&A session with such keywords, eventually spoken out at some ultrasound frequencies so that humans can’t hear it, but machines will (if fed raw audio rather than meeting minutes, in an attempt to pick up emotions)... :-D 2025: CEO apologizes after barely audible cries of infant in the background of a WFH earnings call tanks stock price, as deep learning algorithms trained on misery detection interpret that to mean company is in dire straits.