8 ms·

This blog actually got me into HFT. It's a fascinating industry with a lot of fun bleeding edge tech challenges.

amelius 6y ago
I could be totally wrong, and perhaps I should read that blog, but working in HFT doesn't sound very rewarding except perhaps in a pure financial sense. It seems to me that the field contributes nothing to society, and has only negative externalities like raising barriers of entry to markets and using insane amount of resources.
- b3lvedere 6y ago
  It is 100% for making money by gaming the current systems. Perhaps one day something good comes out of it. For example: Formula 1 racing is also totally not necessary, but can bring nice innovations for the 'normal' automotive industry.
- harryh 6y ago
  HFT has significantly lowered trading costs for all investors. Here's a statement from the CEO of Vanguard espousing this position: https://www.cnbc.com/2014/04/25/vanguard-chief-defends-high-frequency-trading-firms.html https://www.cnbc.com/2014/04/25/vanguard-chief-defends-high-... Because of automation, the amount of resources used for trading have actually decreased. Computers are a lot cheaper that the many many humans who used to be involved in the process.
  - hendzen 6y ago
    I think it’s more nuanced in reality. There are liquidity providing HFT strategies that profit off the spread - this is good for people moving big size like Vanguard. Then there are liquidity taking strategies that profit by picking off quotes in anticipation of a probable price move. I don’t see how those strategies help Vanguard. Also, most HFT firms do a mix of both types strategies...
    - harryh 6y ago
      Ya, it's certainly more nuanced than I was going to get across in just a few sentences. Mainly I wanted to push back against: "the field contributes nothing to society, and has only negative externalities"
      - VRay 6y ago
        I think it's fair to say that someone is going to contribute less to society working on HFT than they would by using the same skills to work at NASA or SpaceX, though
        rhexs 6y ago
        No....uh....”liquidity”.
    - 1e-9 6y ago
      The markets need aggressive orders as well as passive orders. There is nothing inherently bad about liquidity taking. It is generally just as beneficial as liquidity providing. If anything, the misuse of passive orders is probably more common than the misuse of aggressive orders because passive orders can be used to influence a market without trading. Even the taking of liquidity in the anticipation of a price move is not inherently bad. It is only bad if it degrades market efficiency (for example, by adding instability). An aggressive order that anticipates a price move due to an existing market inefficiency (for example, a sudden over-reaction to a report) benefits the market by speeding price discovery and adding stability. As to your question of how an aggressive HFT strategy could benefit Vanguard, consider that if Vanguard places a passive order, it is because Vanguard hopes to attract an aggressive matching order. If they are unable to attract one within their time requirement, they will likely need to change their order to a less-profitable price. Their time requirement could be quite short during times of great volatility. An HFT strategy able to more-quickly recognize that Vanguard's original price was attractive would save Vanguard the cost of a price change. This benefit can be particularly large during significant market stress when participants are forced to liquidate assets in order to manage risk.
  - chiph 6y ago
    I remember the days in the early 80's when Merrill Lynch would charge $70 for a trade. That's the equivalent to $190 today. And people paid it because the low-cost firms like Schwab weren't well-known and people thought "If they're that cheap, they can't be any good."
    - deleted 6y ago
      [deleted]
    - uplyftcapital 6y ago
      You can thank HFT for the ubiquitous free trades that most brokers now provide.
  - tehjoker 6y ago
    If you have to justify the contribution to society in terms of the stock market instead of some materially useful metric like meals served, people put in housing, technologies invented or some such thing, there are ways to provide retirement plans that have nothing to do with the stock market.
    - harryh 6y ago
      Thinking of the stock market as merely "a way to provide retirement plans" is wrong. It costs money to serve meals, put people in housing and invent technologies. Where does a lot of that money come from? Our financial system (of which the stock market is a key component). A better functioning financial system enables progress in lots of other industries.
      - tehjoker 6y ago
        You can have a financial system without a stock market. It would be constituted with public banks or various kinds of credit unions. The reason I cited retirement plans is that is the most sympathetic argument I could think of for caring about the stock market going up. Only ~20% of Americans own stocks, so it going up basically just enriches 1/5th of the population at the expense of the rest.
        harryh 6y ago
        You can have a financial system without a stock market. It would be constituted with public banks or various kinds of credit unions. Not really. A financial system that only consisted of debt and not equity would not be able to support anything like our current economy. We would all be much poorer for it. Loans are simply not suitable for a huge variety of financial risks.
        yellowstuff 6y ago
        You can imagine a successful financial system without a stock market if you don't know much about financial systems, in the same way that you can imagine a jet flying without wings if you don't know much about aerodynamics. I believe that the rise of importance of finance has been a net good for humanity, but I know that's an unpopular opinion and I've seen good arguments that it's a net harm. But I don't think you can make a reasonable argument that we could have a modern world anything like the current one without stock markets. Banks and credit unions don't, can't and shouldn't provide the kind of funding that equity markets do.
- dcolkitt 6y ago
  I guess it depends on your underlying viewpoint towards markets and capitalism. I certainly don't think liquid financial markets and efficient asset prices qualify as "contributing nothing to society". Those components are extremely critical to the efficient allocation of investment capital, and overall functioning of the broader economy. But if you're generally skeptical of markets and capitalism then you may not agree. However I'd say that should have a lot bigger fish to fry than the $2 billion HFT industry. For example the $300 billion advertising industry, or the $100 billion accounting industry, or the $100 billion credit card industry.
  - WJW 6y ago
    Or even the $145 billion makeup industry.
- doublesCs 6y ago
  It's a lot of fun. Unlike selling ads for google.
  - b20000 6y ago
    this
- greenshackle2 6y ago
  Can you explain how HFT raises the barrier to entry? Barriers to entry for who? Arguably, payment for order flow has decreased the barrier to entry for retail investors by helping enable zero-commission brokerages.
- 1e-9 6y ago
  > It seems to me that the field contributes nothing to society,... Better markets allow our economy to prioritize resources better and convert assets more efficiently. This increases prosperity. Good HFT improves markets. Of course, there is bad HFT, but such actors tend to not last long due to natural market dynamics and regulatory enforcement.
- xwdv 6y ago
  It doesn’t “raise barrier to entry”, it lowers it. Before HFT spreads on stocks were hell, imagine a quarter size spread. Now it’s mere pennies, fractions. Also, for people who love computers, HFT is very exciting. Imagine a job where no optimization is too premature, where everything must be done to get the fastest possible speeds and push machines and software to physical limits. Very challenging and very fun. And the rewards are great!
  - client4 6y ago
    This comment really hits the nail on the head. Want to write code that never hits the L2 cache? Write packet headers before you even know what's going inside? Do the math to see if Starlink provides a better latency based on distance between markets? The questions and answers are endless, difficult, and rewarding to solve.
    - xwdv 6y ago
      Love reading about HFT optimizations, unfortunately it’s rare since a lot of the techniques used are basically trade secrets. Everyone’s always looking for an edge.
- cascom 6y ago
  By that measure most of Silicon Valley is not “rewarding”. While reasonable people can debate HFT’s benefit to society and resource use, how does HFT raise barriers of entry to markets?
- alasdair_ 6y ago
  > It seems to me that the field contributes nothing to society, and has only negative externalities like raising barriers of entry to markets and using insane amount of resources. I thought the same way for a long time. HFT helps make markets more liquid and (somewhat) may aid price discovery. Now, assuming you buy that, the standard response is “sure, but how does pouring all these resources into shaving picoseconds off of a transaction help the world?” Fair point. In my mind, the markets are really just a giant computer running a resource optimization problem whose inputs change constantly. Improving the latency of getting a result back can open up completely new applications. This is a bit hazy, but think of what is possible with todays computers versus those of fifty years ago. Both can perform the same calculations, one is just faster, yet just making calculations faster has changed the world. HFT means speeding up the computations for the allocations of resources for the entire world. This is a really important set of calculations- it affects, indirectly, almost every human on the planet. Making this faster by just a tiny fraction can make it more efficient and when that efficiency is multiplied by the trillions of dollars involved, that can mean huge savings for humanity as a whole. Or, you know, the benefits could all be spent on hookers and cocaine, your choice.
  - yellowstuff 6y ago
    I'm generally supportive of HFT, I think the massive reduction in total profits to market makers relative to 20 years ago is proof of a positive-sum efficiency gain. But I'm not sure I buy your argument for why the nanosecond arms race is good. Computers getting faster has allowed us to do more and different stuff with computers. What are the actual benefits of HFT "efficiency"? If stocks had an auction every millisecond wouldn't that still be plenty fast enough for any practical purpose? Only other HFTs will notice or care that AAPL's price got updated in 1 nanosecond instead of 2. Or to go the other way, how would we be better off if stocks ticked every femtosecond? Every attosecond? Is there some limit where the benefits of this "efficiency" aren't worth the resources to pursue it?
  - xmot7 6y ago
    But faster price discovery doesn't actually do anything. Outside of other HFT firms, efficient pricing only matters for large events that happen on a macro timescale - share issuance, buybacks, dividends, etc. Unless one of those macro events occurs, knowing whether a stock is worth $10 or $11 doesn't actually matter - there's no efficiency gained or resources allocated based on that difference. Resources aren't allocated on a nanosecond timeframe, no matter how fast your trades are. Actual resource allocation happens on a weeks to months timeframe.
- b20000 6y ago
  working for facebook where you get to inflict pain and insecurity on millions of people is a better investment of your time?
- client4 6y ago
  The other replies have valuable points, I can only offer my own. I design low latency fiber routes (not wireless like sniper) and find HFT's are willing to spend a large amount of money for infrastructure (AKA will let me trench 100 miles of fiber if it pencils out). This then translates to better connectivity for regular internet users and lower costs for average internet users, as the primary infra providers are recouping their profits on the high margin customers.
- deleted 6y ago
  [deleted]
person_of_color 6y ago
Where do you now work?
minhazm423 6y ago
What has your journey looked like since then? What other note-worthy resources/articles/blogs/books have you come across since then? TIA
- 1e-9 6y ago
  You might find the Meanderful blog informative. https://meanderful.blogspot.com/ https://meanderful.blogspot.com/

I could be totally wrong, and perhaps I should read that blog, but working in HFT doesn't sound very rewarding except perhaps in a pure financial sense. It seems to me that the field contributes nothing to society, and has only negative externalities like raising barriers of entry to markets and using insane amount of resources.

b3lvedere 6y ago
It is 100% for making money by gaming the current systems. Perhaps one day something good comes out of it. For example: Formula 1 racing is also totally not necessary, but can bring nice innovations for the 'normal' automotive industry.
harryh 6y ago
HFT has significantly lowered trading costs for all investors. Here's a statement from the CEO of Vanguard espousing this position: https://www.cnbc.com/2014/04/25/vanguard-chief-defends-high-frequency-trading-firms.html https://www.cnbc.com/2014/04/25/vanguard-chief-defends-high-... Because of automation, the amount of resources used for trading have actually decreased. Computers are a lot cheaper that the many many humans who used to be involved in the process.
- hendzen 6y ago
  I think it’s more nuanced in reality. There are liquidity providing HFT strategies that profit off the spread - this is good for people moving big size like Vanguard. Then there are liquidity taking strategies that profit by picking off quotes in anticipation of a probable price move. I don’t see how those strategies help Vanguard. Also, most HFT firms do a mix of both types strategies...
  - harryh 6y ago
    Ya, it's certainly more nuanced than I was going to get across in just a few sentences. Mainly I wanted to push back against: "the field contributes nothing to society, and has only negative externalities"
    - VRay 6y ago
      I think it's fair to say that someone is going to contribute less to society working on HFT than they would by using the same skills to work at NASA or SpaceX, though
      - rhexs 6y ago
        No....uh....”liquidity”.
  - 1e-9 6y ago
    The markets need aggressive orders as well as passive orders. There is nothing inherently bad about liquidity taking. It is generally just as beneficial as liquidity providing. If anything, the misuse of passive orders is probably more common than the misuse of aggressive orders because passive orders can be used to influence a market without trading. Even the taking of liquidity in the anticipation of a price move is not inherently bad. It is only bad if it degrades market efficiency (for example, by adding instability). An aggressive order that anticipates a price move due to an existing market inefficiency (for example, a sudden over-reaction to a report) benefits the market by speeding price discovery and adding stability. As to your question of how an aggressive HFT strategy could benefit Vanguard, consider that if Vanguard places a passive order, it is because Vanguard hopes to attract an aggressive matching order. If they are unable to attract one within their time requirement, they will likely need to change their order to a less-profitable price. Their time requirement could be quite short during times of great volatility. An HFT strategy able to more-quickly recognize that Vanguard's original price was attractive would save Vanguard the cost of a price change. This benefit can be particularly large during significant market stress when participants are forced to liquidate assets in order to manage risk.
- chiph 6y ago
  I remember the days in the early 80's when Merrill Lynch would charge $70 for a trade. That's the equivalent to $190 today. And people paid it because the low-cost firms like Schwab weren't well-known and people thought "If they're that cheap, they can't be any good."
  - deleted 6y ago
    [deleted]
  - uplyftcapital 6y ago
    You can thank HFT for the ubiquitous free trades that most brokers now provide.
- tehjoker 6y ago
  If you have to justify the contribution to society in terms of the stock market instead of some materially useful metric like meals served, people put in housing, technologies invented or some such thing, there are ways to provide retirement plans that have nothing to do with the stock market.
  - harryh 6y ago
    Thinking of the stock market as merely "a way to provide retirement plans" is wrong. It costs money to serve meals, put people in housing and invent technologies. Where does a lot of that money come from? Our financial system (of which the stock market is a key component). A better functioning financial system enables progress in lots of other industries.
    - tehjoker 6y ago
      You can have a financial system without a stock market. It would be constituted with public banks or various kinds of credit unions. The reason I cited retirement plans is that is the most sympathetic argument I could think of for caring about the stock market going up. Only ~20% of Americans own stocks, so it going up basically just enriches 1/5th of the population at the expense of the rest.
      - harryh 6y ago
        You can have a financial system without a stock market. It would be constituted with public banks or various kinds of credit unions. Not really. A financial system that only consisted of debt and not equity would not be able to support anything like our current economy. We would all be much poorer for it. Loans are simply not suitable for a huge variety of financial risks.
      - yellowstuff 6y ago
        You can imagine a successful financial system without a stock market if you don't know much about financial systems, in the same way that you can imagine a jet flying without wings if you don't know much about aerodynamics. I believe that the rise of importance of finance has been a net good for humanity, but I know that's an unpopular opinion and I've seen good arguments that it's a net harm. But I don't think you can make a reasonable argument that we could have a modern world anything like the current one without stock markets. Banks and credit unions don't, can't and shouldn't provide the kind of funding that equity markets do.
dcolkitt 6y ago
I guess it depends on your underlying viewpoint towards markets and capitalism. I certainly don't think liquid financial markets and efficient asset prices qualify as "contributing nothing to society". Those components are extremely critical to the efficient allocation of investment capital, and overall functioning of the broader economy. But if you're generally skeptical of markets and capitalism then you may not agree. However I'd say that should have a lot bigger fish to fry than the $2 billion HFT industry. For example the $300 billion advertising industry, or the $100 billion accounting industry, or the $100 billion credit card industry.
- WJW 6y ago
  Or even the $145 billion makeup industry.
doublesCs 6y ago
It's a lot of fun. Unlike selling ads for google.
- b20000 6y ago
  this
greenshackle2 6y ago
Can you explain how HFT raises the barrier to entry? Barriers to entry for who? Arguably, payment for order flow has decreased the barrier to entry for retail investors by helping enable zero-commission brokerages.
1e-9 6y ago
> It seems to me that the field contributes nothing to society,... Better markets allow our economy to prioritize resources better and convert assets more efficiently. This increases prosperity. Good HFT improves markets. Of course, there is bad HFT, but such actors tend to not last long due to natural market dynamics and regulatory enforcement.
xwdv 6y ago
It doesn’t “raise barrier to entry”, it lowers it. Before HFT spreads on stocks were hell, imagine a quarter size spread. Now it’s mere pennies, fractions. Also, for people who love computers, HFT is very exciting. Imagine a job where no optimization is too premature, where everything must be done to get the fastest possible speeds and push machines and software to physical limits. Very challenging and very fun. And the rewards are great!
- client4 6y ago
  This comment really hits the nail on the head. Want to write code that never hits the L2 cache? Write packet headers before you even know what's going inside? Do the math to see if Starlink provides a better latency based on distance between markets? The questions and answers are endless, difficult, and rewarding to solve.
  - xwdv 6y ago
    Love reading about HFT optimizations, unfortunately it’s rare since a lot of the techniques used are basically trade secrets. Everyone’s always looking for an edge.
cascom 6y ago
By that measure most of Silicon Valley is not “rewarding”. While reasonable people can debate HFT’s benefit to society and resource use, how does HFT raise barriers of entry to markets?
alasdair_ 6y ago
> It seems to me that the field contributes nothing to society, and has only negative externalities like raising barriers of entry to markets and using insane amount of resources. I thought the same way for a long time. HFT helps make markets more liquid and (somewhat) may aid price discovery. Now, assuming you buy that, the standard response is “sure, but how does pouring all these resources into shaving picoseconds off of a transaction help the world?” Fair point. In my mind, the markets are really just a giant computer running a resource optimization problem whose inputs change constantly. Improving the latency of getting a result back can open up completely new applications. This is a bit hazy, but think of what is possible with todays computers versus those of fifty years ago. Both can perform the same calculations, one is just faster, yet just making calculations faster has changed the world. HFT means speeding up the computations for the allocations of resources for the entire world. This is a really important set of calculations- it affects, indirectly, almost every human on the planet. Making this faster by just a tiny fraction can make it more efficient and when that efficiency is multiplied by the trillions of dollars involved, that can mean huge savings for humanity as a whole. Or, you know, the benefits could all be spent on hookers and cocaine, your choice.
- yellowstuff 6y ago
  I'm generally supportive of HFT, I think the massive reduction in total profits to market makers relative to 20 years ago is proof of a positive-sum efficiency gain. But I'm not sure I buy your argument for why the nanosecond arms race is good. Computers getting faster has allowed us to do more and different stuff with computers. What are the actual benefits of HFT "efficiency"? If stocks had an auction every millisecond wouldn't that still be plenty fast enough for any practical purpose? Only other HFTs will notice or care that AAPL's price got updated in 1 nanosecond instead of 2. Or to go the other way, how would we be better off if stocks ticked every femtosecond? Every attosecond? Is there some limit where the benefits of this "efficiency" aren't worth the resources to pursue it?
- xmot7 6y ago
  But faster price discovery doesn't actually do anything. Outside of other HFT firms, efficient pricing only matters for large events that happen on a macro timescale - share issuance, buybacks, dividends, etc. Unless one of those macro events occurs, knowing whether a stock is worth $10 or $11 doesn't actually matter - there's no efficiency gained or resources allocated based on that difference. Resources aren't allocated on a nanosecond timeframe, no matter how fast your trades are. Actual resource allocation happens on a weeks to months timeframe.
b20000 6y ago
working for facebook where you get to inflict pain and insecurity on millions of people is a better investment of your time?
client4 6y ago
The other replies have valuable points, I can only offer my own. I design low latency fiber routes (not wireless like sniper) and find HFT's are willing to spend a large amount of money for infrastructure (AKA will let me trench 100 miles of fiber if it pencils out). This then translates to better connectivity for regular internet users and lower costs for average internet users, as the primary infra providers are recouping their profits on the high margin customers.
deleted 6y ago
[deleted]

person_of_color 6y ago

Where do you now work?

minhazm423 6y ago

What has your journey looked like since then? What other note-worthy resources/articles/blogs/books have you come across since then? TIA

1e-9 6y ago
You might find the Meanderful blog informative. https://meanderful.blogspot.com/ https://meanderful.blogspot.com/