12 ms·
7,500 Faceless Coders Paid in Bitcoin Built a Hedge Fund’s Brain
- tlrobinson 10y agoThis is about 2 (big) steps from the plot of "Daemon".
- popol12 10y agoSo it could be 1 dev who supplied 7500 different models.
- aresant 10y agoThe company the article refers to is https://numer.ai/about https://numer.ai/about From their homepage: "February 27th 2016, an artificial intelligence named NCVSAI joined Numerai. . . He uses an untraceable email address. . . He is completely anonymous. His strongest prediction: buy Salmar ASA — a Norwegian salmon company. . . Numerai’s hedge fund went long Salmar ASA." Ok, so how is this anything but an anonymous proxy to arbitrage insider information? Wrap confidential, non-public information under the guise of developing "AI" for trading? I am serious, I don't necessarily understand the need for the data scientists to maintain anonymity, seems like the only functional reason is to let them break the law?
- benmmurphy 10y agoThe numeri.ai data they give to their researchers is anonymised.
- nohat 10y agoThe data is anonymized too. Numerai could be playing a shell game, but it would require submitting their own solutions, or publishing confidential information, both presumably illegal (and particularly indefensible if caught).
- otoburb 10y ago"Though most of these data scientists are anonymous, a small handful are not, including [named individual] of Buffalo, New York." Most data scientists are anonymous, but they don't need to be. The datasets provided to the data scientists must be and are anonymized.
- markovbling 10y agoYou don't know what stocks your model is predicting to buy - it's all anonymized using homomorphic encryption
- acdha 10y agoHow many de-anonymization schemes have withstood more than casual attacks? There's so much stock data available that I wouldn't want to bet against someone using historical data to de-anonymize a stock and then place a bet using insider information. The use of ML would even give plausible deniability – just imagine a prosecutor thinking about the odds of successfully arguing that your model couldn't have produced that result?
- lkowalcz 10y agoI'm almost positive it's not using homomorphic encryption (at least in any real sense). It's misleading how they seem to suggest that they are, though.
- antognini 10y agoI've been participating in Numerai for a few months now. (I've only made some beer money from it, nothing serious.) When you get the data, you have no idea what it is. It's just a file with ~70,000 data points, each of which has 21 features. Each feature is uniformly distributed between 0 and 1. All you have to do is make a binary classification of 0 or 1 (or, more accurately, the probability that the data point is in class 0 or 1). They don't tell you what the 21 features represent. As far as you know, these predictions could be used to make currency trades, or stock predictions, or real estate purchase, or something more exotic. You really have no idea. And since you don't know what these data points represent you can't use any insider knowledge about anything to help you.
- markovbling 10y agoI went to school with Richard and so clearly remember him explaining this to me over coffee less than a year ago when the website had an under-construction style landing page and it's been amazing to watch this grow so fast. The platform is great and I'd strongly recommend anyone wanting to get machine learning experience or who has played with Kaggle to check out Numerai! The homomorphic encryption piece is fascinating and I think it'll be an important piece in balancing the privacy vs. utility of personal data as machine learning seeps deeper into the fabric of our lives.
- CN7R 10y ago> The trouble with homomorphic encryption is that it can significantly slow down data analysis tasks. “Homomorphic encryption requires a tremendous about of computation time,” says Ameesh Divatia, the CEO of Baffle, a company that’s building encryption similar to what Craib describes. > According to Raphael Bost, a visiting scientist at MIT’s Computer Science and Artificial Intelligence Laboratory who has explored the use of machine learning with encrypted data, Numerai is likely using a method similar to the one described by Microsoft, where the data is encrypted but not in a completely secure way. Doesn't this imply that homomorphic encryption isn't being used, but something like it instead?
- lkowalcz 10y agoI am pretty sure homomorphic encryption is not being used. In fact, I suspect that no real encryption is being used. Isn't it the case that if I just removed the labels, and renormalized all my data to fall in [0, 1], then what I end up with looks a lot like what Numer.ai gives you? I'm not aware of any homomorphic encryption / structure preserving schemes that have homomorphic evaluation on ciphertexts equivalent to literal multiplication and addition of ciphertexts, and this seems to be what they want you to do to train your model. (unless I'm misunderstanding how to interact with the "encrypted" dataset) EDIT: seems like most people think they are using Order Preserving Encryption, which allows one to compare ciphertexts with the "less than" predicate. This makes more sense looking at what they give, but I never saw anything where they say "only do comparisons on the encrypted data."
- deleted 10y ago
- deleted 10y ago[deleted]
- Uptrenda 10y agoA while ago I wrote about how AI might be trained on a data set and then used to form the basis of an alternative cryptocurrency for data mining. I.E. maybe you train the AI to recognize images of mountains and then use that as your proof-of-work algorithm to reward "miners" for finding related images on the Internet. What I never imagined is that you might outsource the process of building that AI itself as a separate entity (maybe even a separate blockchain.) You could do the entire thing with commitments: * Build a blockchain that is about rewarding data scientists for predictive models on data sets. * Commit to a hash of a data set (the challenge to the network.) * Hash enters chain. * Release data set. * Give them a dead line for a solution after which they commit to a hash of their solution / predictive model along with an ECDSA pub key for a reward. * Solutions are released after N blocks. * Top N solutions automatically receive rewards in this new cryptoasset. * Zero trust would be required since it operate on outcomes that anyone can check. * (This could also be done as an Ethereum smart contract instead of a blockchain.) Scaling that would be quite hard though and you would need to use standard proof-of-work to avoid attacks. IMO: What I find the most interesting about this article is that they're using masked data as the input which I think is the kind of futuristic cipherpunk vision a lot of people had in mind for Ethereum when it launched. Ethereum + AI + crypto + game theory is a match made in heaven and we probably haven't even scratched the surface of what's possible in this space. I can't wait to see the kinds of things people come up with in the future. Edit: formatting.
- billconan 10y agogreat idea! although sharing data or model with blockchain is very costly I think?
- surrey-fringe 10y agoThat would make it a bad idea.
- irln 10y agoNo sarcasm intended here: Does it matter in terms of social utility whether these types of predictive models are making predictions of human decisions to buy or sell a stock versus predictions of AI based decisions to buy or sell a stock?
- lmm 10y agoA model that we understand seems more useful than one that we don't. If the hedge fund is saying "buy company X but not company Y because company Y leases its equipment and that will cost them in the long term" (say), that's notionally more valuable than "buy company X because the computer says so", because other companies can learn the lesson of this and not lease their equipment. In practice given that hedge funds tend to be secretive anyway maybe it makes very little difference.
- huac 10y agoIt's reasonably easy (not trivial, not impossible) to track the trades of hedge funds, since they do have to disclose their transactions. And some guys will even tell you! [1] [2] [3] Why they make their decisions is another question. [1]: https://www.bloomberg.com/gadfly/articles/2016-09-14/herbalife-leave-it-for-icahn-and-ackman https://www.bloomberg.com/gadfly/articles/2016-09-14/herbali... [2]: http://etfdb.com/etfdb-category/hedge-fund/ http://etfdb.com/etfdb-category/hedge-fund/ [3]: https://whalewisdom.com/ https://whalewisdom.com/
- Twisell 10y agoI might be wrong but this look like Bernard Madoff in disguise. "Give me your money and trust my big black box that nobody understand!" Then just to be more credible add some meaningless data point "We have 7 500 anonymous data scientists" because it is known, the less you now about people who write abstract model that manage your money the more you should be reassured. "My son told me about anonymous they are a hell of good hackers!"
- usefulcat 10y agoUnless they require some sort of financial contribution from the 7500, it seems like the biggest risk (apart from wasting your time) is that if you do come up with something useful you have no way to know the value of it; you basically just have to trust them.
- azernik 10y agoI think parent's concern is scamming of investors, not programmers.
- aaron695 10y agoIt's a free market, not getting payed enough for great work you just leave? But then why would they want to risk you leaving by not paying fair value? Like any job, if you invent something that makes the company millions, you were always free to have left years ago and started your own business if you truly were worth more.
- 10y ago
- deleted 10y ago[deleted]
- bluetwo 10y agoThat all sounds awesome and impressive, but I have the same problem with it that I have with any of the previous neural network hedge funds or, for that matter any of the 24-hour business news stations: * If you truly had the ability to predict the price direction of ANY stock/fund/option in ANY consistent time frame (24-hours/week/month/quarter/year) ahead of time, with ANY accuracy greater than a coin flip, it would be ridiculously easy to turn this information into piles of cash. So, if you are NOT talking to me from atop your piles of cash, I have to assume your accuracy is no better than the flip of the quarter in my right pocket.
- spuz 10y agoThe article says: "Numerai’s fund has been trading stocks for a year. Though he declines to say just how successful it has been, due to government regulations around the release of such information, he does say it’s making money. And an increasingly large number of big-name investors have pumped money into the company" So perhaps they are sitting on piles of cash?
- nkrisc 10y agoInvestor cash, it sounds like.
- bluetwo 10y agoThe stock market itself has gone up in the last year. Exactly what regulation prevents funds from releasing information about their track record? Any fund you buy is provided to show you their track record, as well as "SEC Yield" a normalized measure of recent returns. Sound to me like they are trying to avoid being compared to other metrics, because they don't fare as well.
- piker 10y agoLaws against making a public offering, which hedge funds are generally subject to, prevent public disclosure of track records.
- stokilo 10y agoInvesting like this it is like implementing Texas Holdem Poker AI without knowing history of previous hands and your opponents attitude. Just won't work, all marketing around it is just a bubble.
- macandcheese 10y agoHow does this compare to Quantopian?
- CN7R 10y ago> Write your algorithm in your browser. Then backtest it, for free, over 14 years of minute-level US equities data, and soon, US futures. (source: Quantopian website) Numerai encrypts the data they give you, so you can't just take your algorithm and start your own hedge fund (because you won't have any data to improve with).
- Paul-ish 10y agoWithout knowing much how they obfuscate the data, if anyone could figure out a way to unblind the data, they could reasonably predict what trades Numerai will make, right? Even more important, they could influence those trades.
- NumberCruncher 10y agoThis remembers me of the "neural network black box based forex trading" companies 10 years ago, based in countries where finance fraud did not count es a crime.
- saycheese 10y ago>> " If you are a US taxpayer and have tournament winnings, you will be required to submit to Numerai a Form W-9 with your Taxpayer Identification Number, and you will receive from Numerai a Form 1099." Bit of a stretch to say they do not know any of the names of coders. Anyone know how many valid W-9s they've received? Seems like if the user was connecting from an IP in the US that the user would need to prove they're not a US taxpayer.
- HappyTypist 10y agoYou have the option to self declare to be not a US resident.
- arbuge 10y agoIf you actually are a US resident and declare that, you would be breaking the law. And if you receive payment in a US bank account and declare yourself a non-resident, expect questions to be asked.
- HappyTypist 10y agoPayment is in bitcoin.
- saycheese 10y agoFact it's paid in Bitcoin is irrelevant both to being taxable or being tracked down if need be.
- HappyTypist 10y agoIt's much more difficult to track. You can convert your bitcoin to cold hard cash at an ATM anonymously.
- tinco 10y agoI wonder if in the end there will be just a single model, and a single faceless coder who actually makes the best predictions, and the whole of Numerai will be just an elaborate way of finding that particular person and his model to make the market.
- BickNowstrom 10y agoWith meta-modeling you can build an ensemble (single model) that beats any individual model. This should also have less variance (See Breiman's Bagging Predictors). I'm saying that even if there is a super talent on Numerai, one should still use, say, 0.95 to 0.05 weights, to "hedge your bets" and improve accuracy. With enough competitors, it becomes near impossible for a single agent to beat all the others combined. Kaggle competitions also see this. https://www.boozallen.com/content/dam/boozallen/documents/2015/12/2015-FIeld-Guide-To-Data-Science.pdf https://www.boozallen.com/content/dam/boozallen/documents/20... [page 93] shows a graph where a simple average of the top models in a competition gives an ensemble model with higher accuracy than any of the individual competitors. I think that is largely the beauty of Numerai. Using adversarial agents to build a "collaborative" model. Disclaimer: Won a few bitcoin on Numerai.
- CN7R 10y agoDoesn't this assume that market is composed of completely rational actors? On the same note, why not just do sentiment analysis on the people trading and buying stocks?
- cwyers 10y agoThe idea that data science is some kind of numerical alchemy where you can just anonymize the data so much that the people doing the modeling don't even know what the problem domain is just irks me. It's utter nonsense.
- lkowalcz 10y agoAnyone want to speculate about how the data is being "encrypted"? It seems like they don't want to say, which immediately sets off red flags in my head... I am pretty sure homomorphic encryption is not being used. I think if they are doing anything rigorous, maybe they are using order-preserving encryption (http://www.cc.gatech.edu/~aboldyre/papers/bclo.pdf http://www.cc.gatech.edu/~aboldyre/papers/bclo.pdf). This would mean that the only valid operations on the ciphertexts are comparison operations. I can't seem to find anywhere where numer.ai actually says how to interact with the "encrypted" data. I think it's a little strange that they would suggest that they are using homomorphic encryption yet have only comparison operations actually make sense on their "encrypted" data. A second hypothesis would be that no encryption is being used at all, and this is just unlabeled features that have been renormalized within [0,1]. A third would be that order-preserving encryption is being used, but in an ineffective way which is basically just resulting in the second scenario. (understanding the security guarantees of order-preserving encryption is practice is very complicated)
- siliconc0w 10y agoI'm pretty sure they're using Order Preserving Encryption and not true Fully Homomorphic Encryption. Marketing is great though - I love the look and messaging.
- mizchief2 10y agoSounds like a Ponzi scheme with a high-tech spin.