5 ms·
Lets stop and think for a moment about what we are discussing. Knight gave other people about $400M by making some bad trades. Also, some graphs wiggled. The n
by yummyfajitas 14y ago
Lets stop and think for a moment about what we are discussing. Knight gave other people about $400M by making some bad trades. Also, some graphs wiggled.
The net impact on the market was negligible. If you buy on the timescale of days to weeks, you can completely ignore HFT. Here is a blog post with graphs demonstrating the market impact of various HFT events:
http://www.chrisstucchio.com/blog/2012/flash_crash_flash_in_the_pan.html http://www.chrisstucchio.com/blog/2012/flash_crash_flash_in_...
- damoncali 14y agoThey shut down the markets. That's bad.
- photon137 14y ago"If you buy on the timescale of days to weeks, you can completely ignore HFT" Not if you have to deal with intra-day margin calls or stop losses. The trouble with most HFT-based algos is that most of them rely on a set of common signals (regardless of how "diverse" their creators may claim them to be) and end up making the various markets and assets highly correlated. So when stops trigger, they cause a massive cascade. This needs to be protected against at the exchange-level (edit: they do so via various mechanisms). Most bots usually don't have the sophistication to protect against tail-events.
- MarkPNeyer 14y agothe technology used by HFT firms to make markets in microseconds makes the web development world look like children. pubsub is the hot new thing here in the valley - welcome to wall street, circa ten years ago. asynchronous is the new synchronous? what is that - a new album by smash mouth? if you completely ignore HFT, you'd think there would be way more programmers and mathematicians available for hire.
- zanny 14y ago> if you completely ignore HFT, you'd think there would be way more programmers and mathematicians available for hire. Can you clarify this? My interpretation is that if you discount mathematicians / programmers working in HFT, you would expect more of them to be in the market for jobs?
- MarkPNeyer 14y agosorry, my argument was very vague. if you completely ignore HFT, you will ignore that there are many very qualified people working in that field, and therefore overestimate the number of those people available for you to hire.
- zanny 14y agoThanks for the clarification!
- dasil003 14y agoOn the other hand, web development is solving many many more problems for many many more people. HFT firms are solving the single problem of making their owners rich with the authoritatively, hand-wringingly repeated justification about how critically important that liquidity is to everyone and their grandmother.
- MarkPNeyer 14y agoright, that's why i left HFT. i was just trying (inarticulately) to make the argument that even if the "only" cost of HFT is the massive amount of talent going into that field, it's still a huge cost.
- Aloisius 14y agoAs someone who has designed, built and ran systems that operated at a scale that made the software that HFT firms look like toys and built several web companies, I can honestly say that you have absolutely no idea what you are talking about. Web development and low-level systems engineering are entirely different and neither one is particularly harder than the other. If anything, both are simply tedious. And pubsub was old by the time wall street got a hold of it.
- MarkPNeyer 14y agoyes, pubsub is an old pattern. what HFT experience do you have that makes you think of those systems as toys? a webpage that responds to requests in 10 milliseconds is fast. a trading engine that responds to requests in 10 milliseconds is a joke.
- true_religion 14y agoIt's not as if many webpages couldn't be made to respond to faster. Not to brag, but I've built trading engines in the past year that can process 20 years worth of data in less than a ms. Now I'm a founder at your usually derrided photos-sharing start up. Sure we could make most requests come out of the server in less than 2ms, but what of it? It's still going to take the user upwards of 1.5 seconds to load all of the content, and at least 100ms spent on the wire. Working at a consumer level startup, there's no point in optimizing the server yet when network costs are so high, and there's no point in improving the network when there's no ROI in it. ---- Answering to his question: > what HFT experience do you have that makes you think of those systems as toys? I'd imagine that massive distributed systems are more complex to think through that HFT systems because the later are more monolithic due to speed constraints.
- MarkPNeyer 14y agoHFT systems _are_ massive distributed systems. where i worked - a small shop with 10 engineers - we had 350 machines running in 5 different data centers in chicago, new jersey, and korea. each machine ran around 100 different processes, which were coordinated using a combination of several different pubsub systems: - in house reliable tcp-based broker mediated (we called it pubsub3 ) - in house unrelaiable ip-multicast system (i named it blue ray because i thought that sounded cool) - 3rd party implementation of a PGM derivative that we licensed for god knows how much the engines subscribed to various topics on the system, processed market ticks (sent by marketdata publishers over blue ray) and fired orders at whatever instrument they were handling the risk engines modeled risk scenarios inresponse to trading shifts, powering through the risk models our quant trader wrote in c. we had a 'calcparser' system that constructed a DAG rerpresenting the AST of the c code and distributed the DAG across several machines. shit was nuts. i miss it.
- thetabyte 14y agoYes, but does the fact that "nothing bad has ever happened" mean that "nothing bad will ever happen"? As a developer, I'm familiar with the fickleness of software. What happens when we see HFT algorithms error in unison? What have we not thought about?
- SoftwareMaven 14y agoThings like the Flash Crash[1] are what occur. Te scary thing in my mind is that error states are the hardest to test for and tend to be multiplicative in cascading severity. The HFT world is hiring a lot of really smart people. We have no choice but to trust that enough of that brain power is going towards addressing those error states. 1. https://en.wikipedia.org/wiki/2010_Flash_Crash https://en.wikipedia.org/wiki/2010_Flash_Crash
- seunosewa 14y agoWhat harm was done by the flash crash, really?
- jobu 14y agoThey're sucking a few pennies out of every transaction on these exchanges, the long-term effect is that of a parasite in a larger host. Sure they may have some small benefit of improving liquidity to the market, but overall they're causing harm by reducing the returns of legitimate traders.
- zacharyvoase 14y agoDefine ‘legitimate’.
- theorique 14y ago"Trading at the right speed. Not unfairly fast." (TBD by your trusty government and regulators: what speed is fair and what is too fast.)
- zanny 14y agoI hear doing things faster relative to how it was done in prior times is sometimes called progress.
- tedunangst 14y agoI think we need the government to step in and slow down google. They return search results unfairly fast, it prevents underfunded companies from competing.
- dllthomas 14y agoIf they're adding a lot of liquidity, I'm happy with them reducing my returns a little. If they add a little liquidity, I'm not happy with them reducing my returns a lot. There are questions to be answered that we can't get at from an armchair (at least, the metaphorical armchair).
- mark-r 14y agoIf there are people making money off those HFT trades, then somebody else is losing money. It's a persistent tax on the entire market. Just because it's in the background where you can't see it doesn't mean it isn't affecting you.
- yummyfajitas 14y agoIf there are people making money off those barbershops, webapps and grocery stores, then somebody else is losing money.
- Evbn 14y agoYes but the money losers are gaining hair style, cat pictures, and and food, not just intraday liquidity that they didn't know they were paying for and didn't want or need.
- yummyfajitas 14y agoI'm confused - there is a bid/ask spread of $10.00/10.05. A person comes along and deliberately chooses to buy at $10.05, rather than placing a passive ALO buy order at $10.00 or $10.01. Why do you think this person didn't want or need liquidity? And why do you feel that it's worse for a machine to sell it to him at a low price than for a human to sell it to him at a high price?