35 ms·
The quant hedge fund world is possibly the area where secrecy hurts the most. I worked for many years on a strategy that my colleagues were convinced was specia
by lordnacho 11y ago
The quant hedge fund world is possibly the area where secrecy hurts the most. I worked for many years on a strategy that my colleagues were convinced was special. It did make a lot of money, but looking back it really suffered from not being able to take in any outside feedback. We had a meeting where I was the only dissenting voice in the question of whether to give any transparency into how the model worked.
There's some really bad issues with trying to do anything like this in total secrecy:
- We couldn't tell investors how the strategy worked. This is bad for building trust. When things go well, people will invest anyway. But they are quick to leave you when they don't.
- We couldn't hire anyone without bolting down everything. I ended up having to do all the coding while making sure nothing went into the repo that was the secret sauce, having to send a new binary to a consultant (whom everyone knew) every time the sauce changed, and so forth. As a tiny team we had a lot of fiddling with the network to make sure nobody with the wrong credentials could get things they weren't supposed to.
- It affected how we tried to hire people for other things, like new strategies. When you think everything you have is special, you tend to devalue what other people do. You also end up thinking you can take their secret sauce. There's at least one well known fund that thinks it can just interview people and get their ideas. It's pretty obvious when it's happening.
- Because truly original ideas are hard to find, you stop looking and you think that's it. Or, as it happens, you read some paper, slightly modify it, and you announce your revolutionary new idea to the team. Unfortunately, people seemed to buy this. They couldn't just accept that a trading strategy is a whole bunch of ideas that come and go over time. And certainly not the idea that a tiny little tweak that makes everything work is probably a dangerous thing.
- You end up not comparing your findings to the real world. Nobody was reading what was happening in the machine learning world (the guys are essentially using high school math to implement the model). Attempts at introducing things that were completely ordinary in software development were met with derision. Basically if something wasn't more secret sauce it wasn't interesting.
- The crux of this thinking is you tend to think implementation is easy and idea generation is separate and difficult. Probably most people will find the opposite to be true. In truth, if you look at the financial code, it would fit on a screen. The other tens of kLoC was was implementation: back office checking, execution, writing things to database, connections to all the exchanges, and so on.
If you look at the wider industry, you can talk to people at large funds where they don't actually care that lots of people are looking at the strategy. They know what the techniques are, that know how to build code collaboratively.
- berntb 11y ago>> The quant hedge fund world is possibly the area where secrecy hurts the most. Cool comment, thanks. I always assumed that the secret world of spies, secret organizations and their technology development was more inefficient than the secret corporate worlds? Because (a) CIA et al have the same problems and (b) they aren't even limited by having to earn money -- they can even stamp embarrassing foul ups as state secrets!
- arethuza 11y agoIf have encountered situations where people are secret because there is nothing there - I was doing work with a team that had been acquired by my employer at the time and they supposedly had a "secret" approach for evaluating a problem in their domain. Eventually the admitted there wasn't anything special there - they simply looked at a graph of the data and made a judgement call. It wasn't a big deal as it wasn't why they had been acquired, but they really put up every barrier possible - including the "how can we trust you" line. Had to get escalated all the way to execs of a $600M business to get someone to tell them to tell me exactly what they were doing...
- lordnacho 11y agoWell that's basically what happened. Smart people are very good at finding ways to convince themselves they're right and the whole world is wrong.
- mizzao 11y agoWise people know that they don't know everything and are able to realize that even if they know a lot, someone else may know more about X than they do and absorb their perspective.
- coliveira 11y ago> if you look at the financial code, it would fit on a screen This is exactly why people shouldn't be afraid at somebody else looking at the code. What is important here is not specifically the code that is implemented, but the ideas, model testing, analytical thinking that went into the writing of those few lines. The problem with many researchers in this area is to think that it would be easy to go from an idea or simple implementation into a full investment system. Most of these ideas have already been published, it is just that few people know how to use them to make money.