16 ms·
The stockmarket is now run by computers, algorithms and passive managers
- gandalfian 7y agoIn theory the small investor who has the freedom of not being obliged to track the index and is small enough not to be troubled by low liquidity could potentially exploit these advantages?
- dajohnson89 7y agoHas this not been the case for well over a decade?
- garmaine 7y agoThe article is about that history.
- monkeydust 7y agoIts more prevalent now than a decade ago - also OTC type products are automatically being priced and traded (that's a big change from a decade ago).
- Nuzzerino 7y agoAI has been a dominant force in the market since at least the 1980's.
- brokensegue 7y agocitation?
- maximente 7y agomy guess is he is using the acronym AI to mean statistics/modeling/inference vis a vis actual intelligence (understanding/conceptualization/novelty)
- onion2k 7y ago"Computers and algorithms" is just a synonym for people; people implement ideas in code, design the algorithms, pick the weights for training machine learning, etc. No matter how many levels of abstraction you go through it's always people at the top. If anything happens in the society there's always a person who made the decision to make it happen somewhere. Deferring that responsibility to "computers did it" is dangerous bullshit.
- swsieber 7y agoHmmm... I both agree and disagree. While humans program the general strategy, and even the bugs they didn't think they were adding, there is a substantial difference: computers can and will act in such a completely stupid way as to be obviously stupid to even the most uninformed human. What I fear the most is a silly bug causing a crash in a way no manually triggered series of trades would.
- dsfyu404ed 7y ago>What I fear the most is a silly bug causing a crash in a way no manually triggered series of trades would. Banks are run by smart people and they worry about the same things. There's dedicated systems checking to ensure algorithms aren't running away. All the big banks and brokers have been buying them for a decade or so. Nobody wants a crash and the algorithmic traders are mostly using a line of credit from the bank with which to do their trading and the bank usually take a commission on the profit so the banks have a strong interest in seeing them make money as opposed to crash the market and disappear into bankruptcy proceedings. Of course the government also swooped in and saved the day by mandating risk checking systems a couple years after everyone who cared was already using them (thereby solidifying the status quo for better or worse).
- benj111 7y agoCould you not say the same kind of thing about mortgage backed securities, Fannie Mae etc? We've had flash crashes, which aren't in peoples interests, they still happened. I don't think its reasonable to hand wave it away, because "smart people". Programmers are supposedly smart people,I've yet to come across a perfect bug free program.
- cjblomqvist 7y agohttps://outline.com/JE65Eu https://outline.com/JE65Eu
- chaseha 7y agoThank you
- INGELRII 7y agoI find it easier to select what companies not to buy. It's hard to do it cost effectively and with low risk. Short selling or put options is not the answer. Idea for a new fund directed at retail investors: S&P 520 index fund. It's basically just low cost S&P 500 index fund, except that the index tracks 520 largest companies listed and individual investors can remove any 20 companies from their index. If you don't know what to drop, the fund managers drop the 20 smallest and the index becomes S&P 500. The catch is how to implement this strategy with low cost. In practice the fund as a whole would take input from every fund owner at the time they do rebalancing. Then they would adjust the ownership of the fund based on how the investor performs relative to the whole fund in the next rebalancing. How to implement this may be tricky.
- oh_sigh 7y agoWouldn't the effect of, say 15 of your picks underperforming(good for you) be dwarfed by the other 480 ones performing the same? Couldn't you simulate this fund by buying s&p index fund and buying puts on your 15 picks?
- reascenda 7y agoIt's actually the other way around, at least historically speaking. Typically a very small number of names account for the lions share of the index return.
- kasey_junk 7y agoJust to add an important note, this is true but it’s different names for different people depending on when they enter & exit the index.
- fauigerzigerk 7y agoI think with a sufficient number of investors, this fund would correlate very strongly with the S&P 500 itself. So it should be relatively cheap for the issuer to simply buy the S&P 500 and enter into a swap agreement to cover any difference.
- cjblomqvist 7y agoOne possibly interesting consequence of this is that companies that want to optimize their stock value may now try and find what factors the financial algorithms are looking for and optimize their business based on that. Might be an opportunity for some creative upper management people?
- logicchains 7y agoExecutives were already doing this for the factors human investors look at (hence the "Wall St. driven short-termism" complaints).
- cjblomqvist 7y agoAbsolutely, I guess what I'm saying is that this might bring about new types of factors to look for - meaning whole new categories of strategies.
- logicchains 7y agoThey're still going to be factors that a human already thought was relevant to making investment decisions. Machine learning data pipelines don't write themselves.
- Havoc 7y ago>what factors the financial algorithms are looking for and optimize Except you've already got algo's trying to outguess each other. It's a bit of an arms race with little space left for mortals
- pjc50 7y agoIs this .. bad? > FIFTY YEARS ago investing was a distinctly human affair. “People would have to take each other out, and dealers would entertain fund managers, and no one would know what the prices were,” Was this, on the other hand, good? If we take the doctrine that a market is a system for transforming information into decisions through the medium of prices (see e.g. Red Plenty), then using an increasingly sophisticated information system to do it seems only right and natural? And that it should reduce overheads of fund management? (As an aside, that initial-cap "F" looks really nice and is a neat bit of CSS)
- alexgmcm 7y agoI agree - it is far better to have computers do it than run the market at "the clock speed of a babushka at a market stall" as Francis Spufford put it. Although in this case it'd be the clock speed of a fund manager on a golf course.
- nicoburns 7y agoDo you really think that clock speeds measured in nanoseconds allow enough time for good decisions to be made?
- logicchains 7y agoA computer can do in a few nanoseconds calculations that would take a human days.
- nicoburns 7y agoI don't that's true. Single clock-cycles of CPUs are measured in nano-seconds, and human's aren't that slow.
- pjc50 7y agoThat comment was obviously a metaphor choosing "nano" as it's the coolest prefix, but since this is Hacker news I suppose now we have to fact-check a metaphor. A Geforce 1080, at the high end of "normal" computing claims about 350 gigaflops. Divide through and we get 350 floating point calculations per nanosecond as an absolute maximum. Depending on what the numbers actually are and what method we make the human use (expert abacus users are surprisingly fast) that looks more like an hour's work for the human. This just highlights how absolutely tiny a nanosecond is, though. Those speeds are only valid for numbers already within the processor; fetching from DRAM could be hundreds of nanoseconds. Also recall Grace Hopper's excellent video with a nanosecond of cable length, which is about a foot long.
- deleted 7y ago[deleted]
- mongol 7y agoHow are inputs entered into these systems. Consider for example Trump's decision to withdraw US from Syria. I assume there is a human somewhere that needs to tweak a variable "Conflict risks in the Middle East" or something as soon as possible after this news breaks? That can not be automated... or?
- AznHisoka 7y agothe algorithms usually trade based on sentiment. If it makes a bad trade, the humans override them afterwards and reversed the trade.
- posnet 7y agoIt's now just a built feature of a traders bloomberg terminal. https://www.bloomberg.com/company/press/bloomberg-launches-twitter-feed-optimized-trading/ https://www.bloomberg.com/company/press/bloomberg-launches-t...
- alfiedotwtf 7y agoImagine people advocating to go back to open outcry and wining and dining leads
- _Nat_ 7y agoMost of the comments strike me as negative, like the article's discussing a bad thing. This is weird because the article itself is very positive. From the conclusion: > It is natural to be fearful of the consequences, for it is a leap into the unknown. But the more accurate and efficient markets are, the better both investors and companies are served. Sure this is bad for people who wanted to do the jobs getting automated, much as self-driving trucks are bad for people who wanted a career in driving trucks. But if we automate away all of the jobs with machines that do them better than humans ever could, is that really a bad thing? I mean, sure, we'll need to rework our economic systems to adapt to a world in which the economy neither requires nor desires human laborers -- and, yeah, that's gonna require quite the overhaul -- but is a world in which people don't need jobs to survive really so scary?
- kthejoker2 7y agoWhy such an optimistic assumption that the extreme rent seeking of today won't just balloon to unknown heights in the wake of a seismic shift between labor and capital, creating a permanent class of haves and have nots? Especially once personal security, law enforcement, and military operations are automated... There's certainly a Brave New World style dystopia available in your scenario where only a select few are free and even fewer are wealthy.
- deleted 7y ago[deleted]
- _Nat_ 7y agoI'm not particularly worried about dystopian outcomes like that because I don't see how they'd actually happen. I figure that there're basically two cases: 1. Automation kicks in slowly enough that the government isn't toppled, allowing people to simply vote on a more equitable way of doing things. 2. Automation kicks in quickly enough that powerful individuals can openly defy the government, acting above the law. The first case doesn't seem problematic. I simply can't see a society with >99% unemployment and mass poverty, with booming wealth in the hands of <1%, not voting to distribute the wealth, so long as they have the ability. The second case would then have sub-cases, depending on how the powerful-faction chooses to behave: a. The powerful-faction chooses to comply with the government despite being powerful enough to topple it. Then stuff turns out like in Case (1) anyway. b. The powerful-faction refuses to trade with everyone else. Then they'd have their own, exclusive economic system, but everyone else could still trade with each other. Then they might not be as wealthy as the powerful-faction, but they could still be much wealthier than people today. c. If the powerful-faction chooses to kill-off or cage everyone else, that'd be bad. So, sure, there's that hypothetical scenario in which people who rapidly rise to power would leverage that power to kill off everyone else. But, that just doesn't seem particularly plausible to me. And most of the other scenarios seem to have positive outcomes.
- Merrill 7y agoThe growth of "dark pools" for electronic trading off of the stock exchanges has also been an important development in the last couple of decades. https://en.wikipedia.org/wiki/Dark_pool https://en.wikipedia.org/wiki/Dark_pool
- deleted 7y ago[deleted]
- yumraj 7y agoAnyone who thinks this is a good thing should read Flash Boys by Michael Lewis, and look into front-running and HFT.
- goldstone26 7y agoFlash Boys is written to entertain, though, not inform. It is littered with inaccuracies and dramatization to the point of lying. Front-running, for the record, is illegal and nobody does it. Michael Lewis perverts the phrase to mean "using publicly available information and extremely expensive- though publicly available- radio technology to move stock information faster than competitors". Which you might still think is "unfair", though I would argue it's only unfair in the same sense that WalMart and Target make it hard for small shops to compete because they can't afford ultra-efficient trillion dollar supply chains. It's not illegal, it's objectively more efficient, and the only thing that prevents anyone from "just doing it too" is capital. "Dark Pools" by Scott Patterson is a much more educated and in-the-know look at electronic trading.
- jandrese 7y agoI'm not sure Michael Lewis said it was so much "unfair" as it was "nonproductive". The HFT firms weren't creating any value for the markets. They weren't making markets. They weren't helping liquidity except on paper by making every trade show up as multiple trades. At the end of the day they held zero position. The problem is that they were basically taxing everybody who couldn't build quite as close to the physical location of the servers as they could. They were just parasites.
- lend000 7y agoEvery non-fraudulent profitable trade makes prices more efficient (in either time or value), and in this case it's time. Their competitors aren't you and me, and someone is going to make money from the arbitrage, so what's the big deal? The capital they spent to set up their edge just comes out of the profits that their competitors would be enjoying without them.
- deepnotderp 7y agoOld news. Companies like rentech have been doing this for decades.
- starpilot 7y agoSome day we'll have central AI-planned economies, and we'll laugh at our "free markets" of olde. Computers will allocate capital far better than humans can.
- Synaesthesia 7y agoWe’ll hand over economic decision making to a computer? Doubt it
- InvisibleCities 7y agoYou say that as if you think we will have a choice in that matter. A centrally planned economy is the kind of numerical optimization problem that computers are far better at solving than humans are. Eventually, some country will implement an AI-driven centrally planned economy that will function far more efficiently than our current market-driven model, at which point everyone else will either out-competed by this new more efficient system, or adopt something similar.
- ryanwaggoner 7y agoEventually, some country will implement an AI-driven centrally planned economy that will function far more efficiently than our current market-driven model Your core assumption is that it's possible for an AI-driven centrally planned economy to be "far more efficient" than a market economy. There are two problems here: getting your AI the information they need to make the right decisions, and the political risks of implementing a perfectly efficient centrally planned economy, which will by necessity cause all kinds of suffering and death as a result of its allocation decisions (which, by the way, will probably be guided by value judgments made by humans, but I digress). Both of these are huge challenges, and it's not clear to me that either of them will be easier to accomplish with a AI-driven planned economy vs. a pure market economy (which also has its problems, I know!). They're ultimately just two different kinds of algorithms, and it's unclear to me that the top-down centrally planned approach is necessarily better, even given general AI and tons of input information.
- 7y ago
- davidwitt415 7y agoWhat is missing here is the Big Picture: trading activity has totally decoupled from value creation, and technology has sped up the process exponentially. These are not investors, they are speculators, and it is creating a form of technical debt that has the inherent capability to take down the productive parts of the system.
- CobrastanJorji 7y agoIf you buy stock in a public company which does not pay dividends, what are you if not a speculator?
- xeRTRex 7y agoSpeculators have shorter windows than retail investors looking to store value for long-terms gains. Owning a non-dividend stock in my retirement fund is not equivalent to speculation.
- shkkmo 7y agoWhy does the time frame make a difference?
- 0xEFF 7y agoBecause what the market will do between now and next week is pure speculation. Over the next 30 years you can expect value to grow about 7% per year on average. edit: s/the market/value/
- shkkmo 7y agoI'm not sure that continuous growth can be reliably predicted over a 30 year span. There is reason to believe that we may need to move away from economic systems dependent on continuous growth. (edit: though I highly suspect this is more than 30 years away.) Buying a range of stocks and holding them for the long term may reduce your risks, but that doesn't mean it isn't speculation. Speculation just means that you are buying something with the expectation that you will sell it for a higher value. When your assets don't produce direct value (such as dividends, rental income, functional utility, etc) then investment in those assets is speculation, regardless of the risk level or time frame.
- d--b 7y agoThis completely misses the point. The stock-market is a gamification of financing. While financing has been invented to direct money to the most useful project, stock-market transformed this usefulness function into a score: the return on investment. The problem of the algorithmication of finance is not that we don't know where it's going, but that it's lost its objective of optimizing for utility in favor of optimizing pure profit. This has been a problem since the 80s with the "greed is good mentality". But that's not true, maximizing profit does not maximize societal utility.
- totaldude87 7y agoOk time for a stupid question: if machines trade 90% who is on the other side of buying , or if a machine (or algo or whatever) sells to another machine, cant it be manipulated?
- otakucode 7y agoIt surprises me that a multitude of separately developed systems acting in the same 'playground' don't give rise to more emergent behavior. I would expect accidental death spirals as systems unknowingly couple together and get caught in a loop of failing together, along with the polar opposite of just astronomical growth spurred by nothing but the systems bidding logic interlocking in unexpected ways. Sure there have been catastrophic failures like Knight Capital, but those, at leas the ones I am aware of, all boil down to the system having flaws. I have yet to see a system which worked and followed the logic the designers intended, but which is accidentally (or purposely?) exploited by other automated systems doing the same. Shouldn't the complexity of these systems make such a thing almost inevitable and common?
- 1e-9 7y agoThey undoubtedly do to an extent, but the exchanges use price limits, trading halts, and mandatory nonstop human supervision to keep things under control and allow human operators time to kill errant systems that are losing money. Trading firms and clearing firms require additional safeguards to limit instability and losses. Also, if some group of trading systems does go wheels-off in a positive feedback loop, there's likely to be another, larger group of trading systems operating correctly and taking the other side to eventually stabilize prices.