6 ms·
I was working in HFT myself, though in Europe, and I asked around about this. Specifically WTF do they do with this line from Chicago to New York that's so insa
by lordnacho 8y ago
I was working in HFT myself, though in Europe, and I asked around about this. Specifically WTF do they do with this line from Chicago to New York that's so insanely important?
The US market has this interesting phenomenon that the futures trade in Chicago, but the single stocks trade in New York. For those who are not familiar, this means you can make a bet on the S&P 500 index as a whole in Chicago by buying or selling futures. But if you wanted to replicate the basket, you would go to New York.
Naturally there's a relationship between the two. If the futures are going down, the prices of all the stocks needs to be adjusted. And if you look at stock prices, it turns out quite a lot of any stock price is simply exposure to the market at large. So you really want to know as soon as possible if the market is moving.
Now you might have thought that the index is the index of shares, which is in NYC, so why does it matter what Chicago thinks? Well actually the tail wags the dog in this case. The futures are how people express a view on which way the index is going, and you want to know that view immediately.
How does it actually work? Variants on "if the market goes down, pull all your bid orders". Basically if things are fine you are happy to look at queue position and imbalance as an indicator of whether you want to leave orders to capture spread with. But the moment there's an indication from Chicago that the market is dipping, you forget that and pull your orders. Or if you're really fast dump a sell order on the guy behind you in the queue.
There's a huge amount of stock trading in NY each day, so it's worth your while to have this line that you use to send the warnings down.
- BonesJustice 8y agoThere’s also more straightforward reasons to want a microwave connection from NYC to Chicago. Say you want to trade off news signals: you want to relay the headlines (from Bloomberg, DJ, etc.) to your colo sites as quickly as possible.
- pgwhalen 8y agoCan anyone in the industry comment on whether this kind of strategy really exists? Surely any automated, news-based strategy's bottleneck is not due to sub-microsecond latencies stemming from microwave tower placement. I've always assumed that the strategies that require microwave networks are using market data and only market data as a primary input.
- BonesJustice 8y agoI can confirm first-hand that this is a real thing, and that if there’s significant movement immediately following a headline, you likely won’t end up with more than table crumbs if you’re not one of the first two or three players to respond.
- dmix 8y agoInteresting. I’m curious, can you give an example of what kind of news? Some earnings reports or acquisition or something? And are the reactions automated based on some NLP? Milliseconds wouldn’t matter if a human has to still parse it, correct?
- darawk 8y agoYes, NLP, and sometimes structured data released by special services that receive the news alerts early, process them into a structured form, and then make them available at the same moment that the normal services do.
- ineedasername 8y agoYep, NLP. As a grad student in comp linguistics, I was surprised to find out that financial news was an enourmous application space for NLP, for exactly this sort of reason. Including the automation of content creation. Much financial news isn't written by a human, and hasn't been for a long while. It's too slow. Faster content creation equals faster actionable data equals huge advantage.
- BonesJustice 8y agoNLP is a possibility, but bear in mind that HFT is all about optimization. The confidence levels desired can vary significantly based on what you intend to do with the information. Acting on M&A news by taking a more aggressive position generally requires more confidence than, say, backing off based on ‘bad’ news. In the first case, you want to be pretty sure of the headline before taking action. In the latter, the mere presence of words like ‘fraud’ and ‘investigation’ might be enough to play it safe and say, “we’re going to back off trading this underlying until a human has a chance to look at this.”
- nodesocket 8y agoThanks for this explanation. I previously thought the distance fight was over being closest to the NASDAQ co-location building in New York, not connecting Chicago and New York. I am still not clear why microwave is faster than fiber though. Is it simply that the fiber lines are multi-tenant, so there is not a direct hop?
- jmole 8y agothe index of refraction of a material is essentially a ratio to the speed of light in the material, where free space is 1. Glass, being around 1.5, has a lower speed of light.
- lukateake 8y agoSo that's why my diamond optic cables never achieved product-market fit! http://hyperphysics.phy-astr.gsu.edu/hbase/Tables/indrf.html http://hyperphysics.phy-astr.gsu.edu/hbase/Tables/indrf.html
- hyeonwho4 8y agoThat, and how the fick do you machine diamond... regular glass fiber optics needs to be cut to a smooth surface and fused together. The devices to do this use diamond-coated blades. Oh, and diamond has a large birefringence due to its crystal structure, which would cause temporal smear in signals.
- consz 8y agoLight signals in an optic fiber bounce off the walls (repeatedly, frequently) of the cable they're in -- the actual physical path the light is taking in this case is approx. 1.5x the path of the cable itself.
- kazinator 8y agoI think the distance is less of an issue than the temporal smear that the bouncing causes. A clean square pulse turns into a blob.
- chirau 8y agoIt's basically arbitrage. Information and time difference arbitrage. Different exchanges on the East Coast, because of their different locations receive trade info at different times. This is what they are trying to capitalize on. And also, the obvious race to first receiver of information from Chicago.
- MuffinFlavored 8y agoI'd be curious to hear some statistics on how much money a ~10ms difference in time of information received can actually make.
- deleted 8y ago[deleted]
- kasey_junk 8y agoI don’t have any statistics but I have an anecdote. I built a trading platform ~6 years ago that had a 100 microsecond tick to trade (a term that means from the time a market update hits your nic to the time an order leaves your nic). We knew then that we were too slow for large swaths of the HFT space & wouldn’t even attempt those trades. I haven’t kept up with the industry but I’d guess tick to trade times at the speed edge are in the low hundreds of nanos now. In an environment like that a 1ms time improvement is out of the capabilities of your software/hardware engineers and can only happen at the network.
- aldanor 8y agoIf we’re really talking “at the speed edge”, low hundreds of nanos would be already considered too slow these days :)
- chirau 8y agoHold my beer ... https://www.youtube.com/watch?v=L5cZaIZ5bWc https://www.youtube.com/watch?v=L5cZaIZ5bWc And that was more than 6 years ago, one ticker symbol only. You can imagine now.
- shagie 8y agoFollowing up on this... The blog post Islands at the Speed of Light ( http://www.bldgblog.com/2011/03/islands-at-the-speed-of-light/ http://www.bldgblog.com/2011/03/islands-at-the-speed-of-ligh... ) with a "global map of 'optimal intermediate locations between trading centers,' based on the earth’s geometry and the speed of light" There's a similar article at When The Speed Of Light Is Too Slow: Trading at the Edge ( http://www.kurzweilai.net/when-the-speed-of-light-is-too-slow http://www.kurzweilai.net/when-the-speed-of-light-is-too-slo... ) The paper that both of these articles are based on: Relativistic statistical arbitrage https://www.alexwg.org/publications/PhysRevE_82-056104.pdf https://www.alexwg.org/publications/PhysRevE_82-056104.pdf which opens with: > Recent advances in high-frequency financial trading have brought typical trading latencies below 500 µs, at which point light propagation delays due to geographically separated information sources become relevant for trading strategies and coordination e.g., it takes 67 ms, over 100 times longer, for light to travel between antipodal points along the Earth’s surface. Moreover, as trading times continue to decrease in coming years e.g., latencies in the microseconds are already being targeted by traders, this feature will become even more pronounced.
- dmurray 8y agoI've seen this paper before, or something like it. It's incredible to me that anyone would publish this. It's like reading a paper on astrology or dowsing, written in the style of a physics paper. You don't get any benefit from putting your trading system half way between the two exchanges, you colocate it with one or the other (or both). Likewise if there are three exchanges to trade on, you don't build a datacentre at the circumcentre of the triangle or whatever voodoo geometry nonsense. You colocate at each of the three and buy/rent/build a line for each of the three point-to-point connections. Source: worked in HFT for more than 15 minutes.
- mattrp 8y agoI know the author well and he would likely conced to you some of the practical points you’re making about collocation and market microstructure. However he wrote the paper to illustrate how global compute networks could someday collaborate using the techniques described to facilitate AI. Hft is a early form of AI so if that’s an area of interest for you maybe take another look at that paper.
- rhizome 8y agoIs this why people move to Pittsburgh and Cleveland?
- deleted 8y ago[deleted]
- tcbawo 8y agoThe L1 repeaters along the path add very little latency and require no real presence.