10 ms·
Watch High-Speed Trading Bots Go Berserk
- danso 14y agoI know HN's frontpage has had a few posts dealing with what financial industry coders do and the validity of it. The ones who claim to be HFT-bot coders argue that they're highly-skilled coders...but it was not always clear if their skill is in algorithm-implementation, or in engineering. That is, they may be great at working with the traders in coming up with a highly performant bot, but they have less ability in exception-handling and design, which may be things that their bosses don't really think about. (I honestly don't know, was just wondering if someone could competently recap the relevant discussions.)
- radikalus 14y agoMost everybody I know (in the field) is in disbelief concerning the length of time the Knight disaster unfolded over. I've had systems "loop" in BAD ways, but never for more than 1-3 seconds. Safeties are paramount in the field. There's many layers of protections to avoid *ing yourself. Most of these are deployed in ways that are not terribly expensive on the 'critical path' -- that said, there are a LOT of people doing REALLY stupid things in the field. (As there are in any field, it's just more 'scandalous' when an error in a financial application occurs) Algorithm implementation is largely trivial, and the high pricetags paid developers in the industry are usually for specific engineering skills along with the semi-requirement that developers be 'all-hands-on-deck' when the situation calls for it. (There's a bug in the new strategy...well you need to fix it before tomorrow's open etc) At least, that's how I see it.
- MarkPNeyer 14y agoi worked in electronic trading for a few years. we weren't high frequency, though - it took us a few milliseconds to respond to price movements, which is why i left for the startup scene in 2010. exception-handling is something we took very seriously, because the consequeneces of a fuckup are so bad. in late 2008, our firm lost around 300k in ~2 seconds. one of the exchanges sent a signal that the interest rate was now 0, which, according to their spec, meant that something wasn't right. our system didnt' handle that properly, so the algos went nuts because hey money is free! the fuse system caught it a few seconds later, but not before we shot orders at everything in sight. i wrote a system that handled federation and service location, and as part of the design, i constructed four state machines which were used to handle the four possible cases in the formal model we developed. i went over the state machines many times by hand, and coded unit tests for each possible (State, Input) transition, followed by a battery of stress tests. these guys are good - but nobody's good enough to never make mistakes.
- rgarcia 14y agoAnyone know what the y-axis measures? The original Nanex source doesn't label it either[1]. [1] http://www.nanex.net/aqck/2804.HTML http://www.nanex.net/aqck/2804.HTML
- lt 14y agoLooks to me like the time of the day.
- gahahaha 14y agoYou are correct. Felix Salmon comments: http://blogs.reuters.com/felix-salmon/2012/08/06/chart-of-the-day-hft-edition/ http://blogs.reuters.com/felix-salmon/2012/08/06/chart-of-th... > in 2008, a pattern starts to emerge: a big spike right at the close, at 4pm, which is soon mirrored by another spike at the open. This is the era of traders going off to play golf in the middle of the day, because nothing interesting happens except at the beginning and the end of the trading day. But it doesn’t last long.
- rgarcia 14y agoThat's the x-axis.
- devingoldfish 14y agoPresumably share volume, though I'm not sure what the multiplier is (my guess would be 1000x).
- curiousDog 14y agoAny idea how much Knight ended up losing? I remember interviewing with this company, Allston Trading in college. They were the only ones who showed up at the Career fair with the salary printed out on brochures. $100k for a fresh java developer. During the interview in their plush offices in the Chicago stock exchange, they were casually discussing how they ended up losing $5million in forex last night. All of them were young, brash and looked like they had little regard for investors money. One trading guy was telling us how he flies to vegas just for the weekend to get with hookers (during a lunch interview!). The managers seemed like your typical alpha-male..bullish, dominating and little regard for morals. Although some computer scientists that they had seemed brilliant and were genuinely interested in building safer, better algos. So i wouldn't be surprised if it's these wall st. types that are pushing the limits further even if deemed unsafe.
- mhurron 14y ago>i wouldn't be surprised if it's these wall st. types that are pushing the limits further even if deemed unsafe. It's human greed. Those 'wall st. types' and those brilliant computer scientists are all in it to make as much money as possible. Those you looked up to as hero's were not corrupted by those you wish to look down on, they all went into it wanting the same thing. The environment changed allowing them to try and get it faster.
- theorique 14y agoConsensus number seems to be $440M in losses on the bulk liquidation of $4.5B in unwanted positions to Goldman Sachs. This represents about a 10% loss. GS does bulk liquidations like this and typically takes a haircut of 2-5%, presumably based on a risk and liquidity assessment.
- damoncali 14y agoThey lost $40 million and 73% of the company plus 3 board seats. Ouch.
- tectonic 14y agoDoes HFT create value in any way? It strikes me as purely driven by greed and so utterly irresponsible for society as a whole.
- damoncali 14y agoIt helps liquidity. How much that matters is up for debate.
- rdtsc 14y agoI think the implication was, is the liquidity level of 2007 inadequate and we need the liquidity level of end of 2011 (which is about an order of magnitude higher). In the end maybe I don't care if these firms just transferring money between themselves but when people's retirement accounts and the fate of whole companies in their hands it seems there should be something preventing this (another meta-algo that punishes aggressive and pushy algorithm...?)
- damoncali 14y agoI think the concern is not that they lose someones money, but that they break the whole system. Knight did that the other day, on a small scale, nearly destroying the company. If that isn't enough to get you to test your software, nothing is. And if they're that crazy, who knows what damage they can cause. They either need to figure out how to do it safely, or slow the heck down before they break the whole damn thing.
- slapshot 14y agoAs has been pointed out a few times in connection with this incident, Knight is largely a market-maker (not an HFT firm): Knight keeps open quotes on both buy and sell sides of transactions at all times and provides liquidity. Their strategy to make money is the "spread" -- they price the buy a couple of cents lower than the sell and on average they end up buying a couple cents lower than selling. They are part of the infrastructure of the major markets; a company listing on NASDAQ or NYSE is required by the market to choose at least one market-maker who will be designated to always keep open buy and sell orders on the books. As it happens, Knight does its market-making through computers; this replaces sweaty men who would stand in the "pit" of the trading floor and trade by waving fingers at each other (including, occasionally, the middle one). It looks like HFT in that computers trade quickly, but it is intended to be a liquidity-providing service to the market: there is always somebody willing to buy or sell anytime the market is open. (In contrast, HFT does not require always-open buy and sell quotes.)
- samstave 14y agoHFT should b illegal. Period. What value is there in any system where trades over "pennies millions of times per second" is provided at all to real world conditions/humans. This is simply a tool by a few to make money in an invisible, unregulated and uncontrollable space. This is simply not sane.
- cpeterso 14y agoIf we agree (and I do) that trading should be throttled, what is a reasonable speed limit? Once per second? Per day? Is there a precedent?
- samstave 14y agoMaybe we need much tighter rules around how the trades can be made. I have no clue at this point what the model should be - but HFT is something that is completely undoable for a human, though it can have impact on humans at large scale and should be thought of more critically before they can be deployed into production. I say impose a moratorium on all HFT until a determination of their value, impact, risk etc can be done and published and debated widely.
- koglerjs 14y agoWhat I've heard, and this is almost worse than anecdotal evidence, is that HFT helps stocks converge on their true 'value' or 'equilibrium' much faster. This could, of course, be utter bullocks, and I have no way of tracking down the source, but it's at least an interesting idea.
- MarkPNeyer 14y agohigh frequency trading is very important! without it, investors would not be easily able to change their minds about how much other investors think wildly complex financial instruments are worth! think of the children!
- theorique 14y agoValue: accurate pricing, reduction of bid-ask spreads, transaction automation causing reduction of commissions.
- joering2 14y agoThis should be illegal long time ago -- think Captcha for buying/selling stocks. The real issue here is that -- whoever was in charge of those stock exchanges hasn't properly addressed this issue as we all can see now its been growing slowly but constantly since 2007.
- pavel_lishin 14y ago> think Captcha for buying/selling stocks. I like that the side-effect would be a drastic improvement in OCR technology.
- radikalus 14y agoThis would be awesome. (Time to bust out your DBNs)
- Symmetry 14y agoOr just only permit trades at 100ms intervals or something. There are simpler solutions than Captchas.
- waqf 14y agoI'm imagining this would mean an auction (something like the current opening/closing auctions) every 100ms ... I like it. It seems more scalable than the current system.
- yummyfajitas 14y agoLets stop and think for a moment about what we are discussing. Knight gave other people about $400M by making some bad trades. Also, some graphs wiggled. The net impact on the market was negligible. If you buy on the timescale of days to weeks, you can completely ignore HFT. Here is a blog post with graphs demonstrating the market impact of various HFT events: http://www.chrisstucchio.com/blog/2012/flash_crash_flash_in_the_pan.html http://www.chrisstucchio.com/blog/2012/flash_crash_flash_in_...
- damoncali 14y agoThey shut down the markets. That's bad.
- photon137 14y ago"If you buy on the timescale of days to weeks, you can completely ignore HFT" Not if you have to deal with intra-day margin calls or stop losses. The trouble with most HFT-based algos is that most of them rely on a set of common signals (regardless of how "diverse" their creators may claim them to be) and end up making the various markets and assets highly correlated. So when stops trigger, they cause a massive cascade. This needs to be protected against at the exchange-level (edit: they do so via various mechanisms). Most bots usually don't have the sophistication to protect against tail-events.
- MarkPNeyer 14y agothe technology used by HFT firms to make markets in microseconds makes the web development world look like children. pubsub is the hot new thing here in the valley - welcome to wall street, circa ten years ago. asynchronous is the new synchronous? what is that - a new album by smash mouth? if you completely ignore HFT, you'd think there would be way more programmers and mathematicians available for hire.
- zanny 14y ago> if you completely ignore HFT, you'd think there would be way more programmers and mathematicians available for hire. Can you clarify this? My interpretation is that if you discount mathematicians / programmers working in HFT, you would expect more of them to be in the market for jobs?
- hexagonal 14y agoBlogspam. OP is http://blogs.reuters.com/felix-salmon/2012/08/06/chart-of-the-day-hft-edition/ http://blogs.reuters.com/felix-salmon/2012/08/06/chart-of-th...
- powertower 14y agoDo HFT firms have contracts with larger banks to take their positions with a discount in situations like this, so the stocks are not imidiatly dumped on the market causing havok? Or to insure them against loss? Sounds like we could segment, rate, and pacakge these contracts up into insured "credit-default-swap" type-of vehicles and make money making/selling/buying/trading them.
- sprobertson 14y agoIf computers are running the markets, and the markets have such a large influence over society, does that mean the computers have already quietly started their takeover?
- angersock 14y agowhat does that even mean go away
- zacharyvoase 14y agoWhen I was in high school, my math teacher instilled me with the value of always labeling axes when plotting graphs. This GIF provides us with exactly no information on anything, but it sure seems scary enough. The line is getting higher and more erratic! This can’t be good! Let’s piece apart some of the language here: * “High-Speed Trading Bots Go Berserk” — doesn’t mean anything, they’re processes, they’re just following their algorithm. * “…unnerving the financial markets.” — doesn’t mean anything, ‘markets’ don’t have nerves. In fact, I once wrote about the dangers of reification: http://blog.zacharyvoase.com/2012/03/31/reification/ http://blog.zacharyvoase.com/2012/03/31/reification/ * “activity becomes much, much more frenetic and erratic” — to a human observer. These algorithms don’t have concepts of ‘frenetic’ or ‘erratic’; neither does the universe. * “…so complex that its potential systemic repercussions are literally unknowable” — suggests that systemic repercussions of anything were ever ‘knowable’. If they were, we wouldn’t have markets. c.f.: http://mises.org/daily/2608/ http://mises.org/daily/2608/ Don’t just read. Think. Thanks.
- jobu 14y agoBased on the Nanex article (http://www.nanex.net/aqck/2804.HTML http://www.nanex.net/aqck/2804.HTML), it appears the chart is showing thousands of quotes per second on the left, vs time of day on the bottom.
- mvzink 14y agoYeah, but you have to admit that this is pretty skilled sensationalist journalism :P How convenient Nanex didn't include labels in the graphics they provided! [1] In fact, they specifically say that high frequency trading doesn't concern them, and are talking about quote spamming. Not. The. Same. The animated graph used in the article combines metrics of both, as far as I can tell, but Nanex makes it clear that High Frequency Trading is stalled or declining while High Frequency Quoting is on the rise. Furthermore, the bit saying "activity becomes much, much more frenetic and erratic" is just... totally silly. Partly because of what you mentioned, but also because... well I don't know what else to say, it's just so utterly, embarrassingly silly. I'd wager the graph's movement isn't even nearly as 'frenetic' as the stock market itself. In any case, it's quite clear that the author didn't even peek at the page he got the graph from. Ugh. This kind of 'journalism' makes me sick. [1] http://www.nanex.net/aqck/2804.HTML http://www.nanex.net/aqck/2804.HTML linked all-too-subtly in the article
- TomGullen 14y agoIf the chart is showing frequency of trades it's just showing that there are more trades right? I find it a little misleading that the graph is presented as somehow being connected to market instability. If they are correlated, they haven't demonstrated the relationship clearly to me. Am I misreading this? Also I fail to see how someone else's algorithm going nuts could impact regular Joe traders as the article also suggests. If a stock price starts plummeting because of a bug in a trading algo goes haywire, a savvy trader would look to their news sources and realise nothing has happened. Or if they are passive investors probably by the time they mobilise to panic sell it's already corrected itself.
- ShabbyDoo 14y agoI'd like to see a graph of average spreads between 2007 and now.
- ck2 14y agoI don't know stocks but this strikes me to be the same mindset as domain tasting and should be ended entirely, not regulated, just killed, regardless of any claims of industries being built around it - it's just wrong.
- kerryiob 14y agoMost of comments here are missing the big picture. Most of the general public and individual investors do not have clear insight into how HFTs work, or if they are beneficial or not. Most are inclined to be scared of crashes and erratic behavior traced back to HFTs. Trading off liquidity for a loss of trust in capital markets is a bad deal. When investors lose trust in the system, it all falls apart.
- retrogradeorbit 14y agoTech journalist discovers zerohedge. They ran this story back in February. http://www.zerohedge.com/news/presenting-rise-hft-machine-visual-confirmation-how-skynet-broke-stock-market-us-downgrade-day http://www.zerohedge.com/news/presenting-rise-hft-machine-vi...