26 ms·
> Only Singh, Bankman-Fried and a few other top FTX and Alameda executives knew about the exemption in the code, according to three former executives briefed on
by hn_throwaway_99 4y ago
> Only Singh, Bankman-Fried and a few other top FTX and Alameda executives knew about the exemption in the code, according to three former executives briefed on the matter. A digital dashboard used by staff to track FTX customer assets and liabilities was programmed so it would not take into account that Alameda had withdrawn the client funds, according to two of the people and a screenshot of the portal that Reuters has previously reported.
If you want to see what you should never do as a software engineer if you like not being in jail, this is it.
Singh will definitely get prison time as well, though I'm sure all the higher-ups in FTX are trying to point fingers to get deals. In the Madoff scandal, 2 of Madoff's programmers were sentenced to 2 1/2 years each. In this case, Singh has much more culpability as a higher-up (not to mention a pre-collapse billionaire).
- alar44 4y agoReally? I feel like intent would be really hard to prove. "Hey, due to the way our accounting works I need you to subtract X from our dashboard." "Ok boss." Are programmers expected to know finance law? If I build a program for a dairy farmer am I supposed to know the laws of the interstate dairy trade? I can't believe that would be the case.
- hn_throwaway_99 4y agoNishad Singh wasn't some low-level coder. He was FTX's Director of Engineering. > "Hey, due to the way our accounting works I need you to subtract X from our dashboard." That is not what happened here. The fact alone that very few people knew about Alameda's special treatment, and, importantly, deliberately conspired to keep that treatment secret is a pretty strong indicator that he knew it was wrong.
- barbariangrunge 4y agoDirector of engineering != product manager in charge of deciding what features to include. If somebody tells engineering, “we will not use this feature illegally,” then it’s the fault of the higher ups who are possibly (?) trying to scapegoat somebody to protect themselves
- oshkarr 4y ago"I was just following orders" went out of style in 1946. Software engineers are not mindless drones.
- r_hoods_ghost 4y agoDirectors have specific, well defined legal duties to their company which includes a duty of fiduciary responsibility. That is why they're directors rather than "head of product" or "VP of marketing" or whatever other meaningless title people bestow on themselves. Saying "my boss told me to do it so it is not my fault" is nonsense because you have no boss beyond your shareholders.
- astrange 4y agoIsn't VP usually a higher title than director? (Well, it's not in finance, but it could be in tech-like crypto finance.)
- reverius42 4y agoThat's Director as in Board of Directors. In this case, "Director of Engineering" probably just means "Manager of managers of engineers".
- ummonk 4y agoHolding the title "director of X" doesn't mean you're necessarily on the board of directors.
- xdavidliu 4y agoin fact, the two are probably anti-correlated
- echelon 4y ago> Are programmers expected to know finance law? Working on fintech and transaction rails? Probably. I had to know regulations when I worked in fintech. Plus, you don't have to know the law to be found guilty of breaking it. The engineers working on this are innocent until proven guilty, but you'd better believe all internal comms, meeting notes, and commit messages will be scrutinized. Someone had to ask for the system to behave this way, and that will have produced certain artifacts. Engineers with knowledge may be cut deals to testify against the bigger players.
- eternalban 4y ago> The engineers working on this are innocent until proven guilty I believe in due process [& friendship, too]. But alas for the engineers concerned, SBF does not: https://www.businessinsider.com/ftx-collapse-bankman-fried-execs-quit-gary-wang-nishad-singh-2022-11 https://www.businessinsider.com/ftx-collapse-bankman-fried-e... "When asked to clarify whether they were both gone, Bankman-Fried said that Wang was "scared" and Singh was "ashamed and guilty" because FTX customers' deposits had been lost." Isn't that a strange thing to say? Singh is the guy who made the change, per Reuters, and this snake knew that.
- jacquesm 4y ago> Plus, you don't have to know the law to be found guilty of breaking it. Precisely, ignorance is never a valid defense.
- jerrysievert 4y agoi worked for a fintech startup in a similar space: > Are programmers expected to know finance law? in our case, we were. it was drilled in, and tested, reviewed, and audited. i’m not saying that something like this couldn’t have happened, but in my case anyone who would have been involved would definitely have known the legality.
- arcbyte 4y agoDevelopers need to know the business better than the business people. Always. Otherwise you can't implement the software very well.
- parksoha 4y agoIsn't it completely unscalable? I work for a big automaker, there's literally people whose only job is to be compliant and inform the necessary leads about it. There's hundreds of countries, each with very specific things. If I study everything, I can't code. When knowledge arrives at my team, is already condensed to the point of: "in X country, you must tell the prices of a call if you show a phone number for assistance" Why should I explore every loophole of law to be compliant? That's the companies job, not mine.
- acdha 4y agoDown to the trivia level for an entire global company, sure, but this is a lot more general and bigger. Like if you have rules against accepting gifts from vendors, maybe you don’t remember if the threshold is $10 or $15, but you shouldn’t need to ask to know it’s not $30k in a suitcase.
- hn_throwaway_99 4y agoFor some reason, I've seen a lot of people try to make arguments around FTX that completely miss the scale and malfeasance that occurred. This wasn't a case of "oh, you got some esoteric GAAP depreciation rule wrong". This was an engineering leader putting a ton of special cases in the code saying "For our most beloved partner, none of the rules apply, including letting them take unlimited amounts of customer funds. Oh, and be sure to hide this from the dashboards the rest of the company uses." This is not hard. Nobody needs to be versed in the ins-and-outs of jurisdictional compliance rules to see this was blatant and egregious. If any of this looks remotely familiar to any software devs out there, you should really re-examine your morals. Or at least hire a lawyer.
- parksoha 4y ago
- dereg 4y agoThis is why Caroline is an important witness for the prosecution. It seems like most of the nefarious stuff occurred in Signal.
- tekla 4y agoDevelopers should know to ask questions when a weird request is made. Developers presumably know how to think and have a vague idea of what the business does to know that a ask to futz with internal financials programmatically is fucking wierd.
- deathanatos 4y agoIME, it depends on your chain of command. I've literally been reprimanded in my career for asking questions. My boss at that time was crap. I didn't choose him. Asking questions can very likely get you fired. Also got reprimanded for disobeying an order at once; my boss — same one as above — would not take "no, we are in a regulated industry, and I cannot do that" for an answer. I ended up going behind his back, getting the approvals he should have gotten himself, and once I'd secured those, granted him the access he wanted. I also tried to escalate to his boss (my grand-boss) … but he didn't respond until it was all moot. But there is a lot of stress when you're fearing for your job, even though you're just trying to do things by the book. I'm inclined to side with engineers, to a degree: the chain of command's responsibility is to never put eng in that position. (Although here, the eng in question seems far higher up than I am. I'm just a bottom rung eng…) > Developers presumably know how to think and have a vague idea of what the business does to know that a ask to futz with internal financials programmatically is fucking wierd. They should but IME they often don't, and even if they do, people are lazy. It's a struggle to get people to do the things they should do some days.
- salawat 4y agoYou want Engineer in your job title? Then you say no, and you damned well ask questions, and you damned well make sure to leave the moment they make it impossible for you to act ethically.
- notch656a 4y agoThis should apply to anyone. IMO engineers aren't special. As a human you should try not to fuck over other people.
- steveBK123 4y agoIf Jamie Dimon asked a developer at the bank "hey can you have Chase ATMs allow these 10 accounts that are in my name to withdraw unlimited funds?" everyone involved would be in jail. This is not dissimilar.
- stickfigure 4y ago"For testing purposes, these 10 account numbers should be allowed to remove cash from any of our ATMs. The testers will put the money back." It doesn't sound that nefarious. If you told me this is how ATMs are currently being tested in the industry, I wouldn't be able to contradict you.
- salawat 4y ago...A bench test of an ATM probably doesn't involve real money. No one in finance is stupid enough to use real money on production environments for testing purposes. There is test... And there is PROD. Never do the two meet. Ever. If someone out there does, please make yourself known so we can get the investigators over there ASAP.
- ragtete 4y agoHuh? You're telling me that you think they never test ATMs in prod? That's ridiculous. You think they're just guessing that the test environment perfectly matches the prod environment?
- malandrew 4y agoYou can test in production if you have multi-tenancy aware services, where tenancy is some string value like Foo to make sure reads to Foo can only read data that was written to Foo.
- headsoup 4y agoThat's not testing in production, that's just the same as saying your test VMWare environment is in the same datacentre as your prod VMWare environment.
- MonkeyMalarky 4y agoI don't know about finance but for HIPAA and CCPA, the answer is yes. Is there an accounting equivalent to the yearly, mandatory 20 minute compliance training videos?
- drunkpotato 4y agoYes, in US fintech there are mandatory courses in anti-money laundering and know your customer laws that programmers are required to take along with everyone else. I don’t know what exists in the crypto world operating in the Bahamas, but I’m not going to lose a lot of sleep if the FTX director of engineering winds up going to prison for this.
- mianos 4y agoI have been working in finance my whole life. A senior developer of anything in this area would be expected to fully understand the risk implications of this. I have written the code to closeout positions automatically multiple times in multiple jobs. It may have been possible someone directed a junior developer to make this change, but then it would be a case of hunting down who told them. If that happened in my team I'd be documenting everything I saw and running, not walking, not walking briskly, out the door. This said, nothing is black and white. For example, due to immature processes, they might have told the developer that the main account was only one of many accounts they can call on, but the code only allows for one, so we have to make an exception. I'd still be freaking out.
- tmaly 4y agoMost companies in financial services require training around compliance topics such as AML. If you are trading or working with customer money, you usually have to take the Series 7 exam. So I would say for regulated industries, programmers are expected to know some degree of financial law.
- bigger_cheese 4y agoI think it depends a lot on the jurisdiction. In some countries there are laws around ethics and disclosure especially if you work in a certified occupation (i.e. a licensed profession, such as traditional engineering). Software probably makes things even more hazy but in traditional engineering world there are very clear cut rules around professional ethics, personal liability and disclosure.
- TuringNYC 4y ago>> Are programmers expected to know finance law? https://adage.com/article/marketing-news-strategy/tom-brady-and-gisele-bundchen-star-ftx-crypto-campaign/2363821 https://adage.com/article/marketing-news-strategy/tom-brady-... I'm surprised that even Football players are being expected to have evaluated the company's legitimacy, which seems unreasonable.
- thombat 4y agoInteresting article! So Brady took "an equity stake in the company and [got] a signing bonus in crypto", then went on to make advertisements even though "The NFL has banned cryptocurrency and NFT sponsorships for its teams". Seems that he, or likely his lawyer and/or financial adviser, will have been evaluated the legitimacy since he's deep into caveat emptor territory. Like innocently buying a stolen car: you're unlikely to be in legal peril but you will lose the car (and gain a claim against the thief that sold it to you)
- jacquesm 4y agoIgnorance of the law is never an excuse if you are found to be breaking the law. So if you think what you are doing is possibly in violation of the law you better bone up or ask a lawyer for a statement on letterhead that what you are doing is ok.
- megablast 4y agoSo every dev needs to also be an expert lawyer and financier??? OK.
- jacquesm 4y agoNo, not every dev.
- hef19898 4y agoPropably not, but a solid understanding of the rules and regulations, and legal requirements, of your field and thebindustry your working in is actually a pretty good thing.
- baq 4y agoIf you are in finance or law it is a good idea to know what you can go to jail for. Engineers are people and people can go to jail for breaking laws they didn’t know about.
- VBprogrammer 4y agoThere are blatantly illegal things you can do in any field of work. You need to be aware of what is and isn't within the law on a loose basis yes. Even labourers on a building site have to do some training to avoid breaching health and safety legislation (or at least to minimise the companies liability when they error). You also need to have faith in the compliance team and senior management. If your company works in legally sticky territory like crypto doubly so.
- headsoup 4y agoIf you work in a company where there is no one that has some idea about the laws that apply to what you do that you could check with, you would be a little concerned.
- nullc 4y ago> If you want to see what you should never do as a software engineer if you like not being in jail, this is it. > Singh will definitely get prison time as well But how long? Jerome O'Hara and George Perez were arguably more complicit in Madoff's scheme than anyone, having written the computer software to generate the fake investment return reports and even actively helped dupe the investigating regulators but were only sentenced to two and a half years in prison.
- jacquesm 4y agoFor a non-violent crime which saw the recovery of a large fraction of the loot that's not 'only'.
- nullc 4y agoIt is relative to the other participants.
- jacquesm 4y agoThat's true, but likely factors were: they were in an adversarial power relationship with some of the other participants (notably: Madoff himself who repeatedly assured them that he actually made the trades that they reported but I fail to see how they could have been so gullible) and may have been put under significant pressure and it likely is a first offense all of which would result in a lesser sentence. But it still is obviously a very serious transgression, and none of their claims that they didn't know what was really going on seem to have fooled the jury. Even the most kind reading of the situation leaves little doubt that they knew exactly what was going on.
- nullc 4y agoPerhaps a small upside to computer programmers / techs often being viewed as low status compared to other highly paid professionals. :)
- helsinkiandrew 4y ago> Singh will definitely get prison time as well Remember Alamada wasn’t a normal customer. It was acting as a market maker/counterparty of last resort to many other FTX customers. In that case there could be situations where ‘normal customer liquidation rules’ shouldn’t apply - it can go in the red temporarily to enable others to trade (and FTX to make commission). From the facts in the article (which are obviously not complete) if I was Singh my defence would be I assumed/was told the changes were to support Alamadas role as market maker and their actual long term exposure was being monitored elsewhere.
- lumost 4y agoThis seems flaky at best. Either becoming an extreme lapse of judgment - or intentional ignorance. His position as a higher up makes claiming the former difficult.
- edouard-harris 4y ago> Remember Alamada wasn’t a normal customer. It was acting as a market maker/counterparty of last resort to many other FTX customers. In that case there could be situations where ‘normal customer liquidation rules’ shouldn’t apply This might be a reasonable argument in a vacuum, except that: > [SBF] told investors and prospective investors that FTX had top-notch, sophisticated automated risk measures in place to protect customer assets, that those assets were safe and secure, and that Alameda was just another platform customer with no special privileges. [emphasis added] And also: > Bankman-Fried also told investors, and directed other FTX and Alameda employees to tell investors, that Alameda received no preferential treatment from FTX. For example, Bankman-Fried told the Wall Street Journal in or around July 2022: “There are no parties that have privileged access.” Likewise, in a Bloomberg article published in or about September 2022, Bankman-Fried claimed that “Alameda is a wholly separate entity” than FTX. In the same article, Ellison is quoted as stating about Alameda: “We’re at arm’s length and don’t get any different treatment from other market makers.” Bankman-Fried made similar statements directly to investors. [emphasis added] (The above are direct quotes from the SEC complaint [1] against SBF.) Singh might argue that he wasn't aware of the private statements to investors. But the WSJ and Bloomberg stories show the "arm's length" claim was something they consistently messaged to the public at the highest levels. To argue that Alameda's role as market maker of last resort justified a privileged status would be inconsistent with all their prior public claims to the contrary. "We lied to the public repeatedly about our risk management" isn't a defense; it's a confession. [1] https://www.sec.gov/litigation/complaints/2022/comp-pr2022-219.pdf https://www.sec.gov/litigation/complaints/2022/comp-pr2022-2...
- megablast 4y ago> If you want to see what you should never do as a software engineer if you like not being in jail, this is it. Strange comment. Are the engineers who made the code change responsible?? Do engineers need to be lawyers and financial gurus too, and evaluate every ticket they are given for possible illegality in every country the software is used??
- lawn 4y agoIf the engineer(s) should be responsible or not doesn't really matter, you could still get blamed either way.
- CSMastermind 4y agoI don't know, we hold other engineers responsible for the consequences of their work, personally I think the industry would be better off if we had more accountability for programmers.
- renewiltord 4y agoSoftware engineers are some of the highest quality engineers there are. Objectively by a simple metric: lives ended through incompetence. Software engineers lead. No other engineering discipline comes close.
- galaxyLogic 4y agoBut we don't hold the gun-industry accountable for mass-shootings. Maybe we should. But situation is a little bit similar here. The engineer created the gun. He didn't use the software to shoot people. Or maybe he did. The question is did he personally benefit from the change made more than his usual salary? Or think about people who build bridges. They just follow the orders they get from higher ups. Bridge collapses. The higher-ups should be held accountable not the workers. The question I think is did the engineer here just follow orders? Perhaps he understood very little about finance, only about programming.
- pavlov 4y ago
- jwmoz 4y agoMy claim to fame is that I dealt with SBF and Nishad to get some Python code for their api client merged in, the first non-FTX committer. I coded up a lot of the api functionalities that were missing. They never gave me a tip. A couple years later when I pitched for investment they declined it as they "were looking for more volume".
- DonsDiscountGas 4y agoYou probably dodged a bullet
- jahnu 4y ago> If you want to see what you should never do as a software engineer if you like not being in jail, this is it. Exactly. And if you suspect you _are_ doing stuff like this right now, speak to a lawyer, today.
- fatnoah 4y ago> If you want to see what you should never do as a software engineer if you like not being in jail, this is it. Not quite the same level, but in my early days working on a payment system, a request from the product team was to create a summary screen where customer service reps could see payment histories AND THE CC INFORMATION USED FOR THE PAYMENTS. In my mind, there was no way that would end well, so I strenuously objected and had to endure some very heated conversations over the course of a month or two. Eventually product team agreed to last 4 digits + expiration. Nowadays it wouldn't even be a conversation, but in the early 2000's, it was a different world.
- IWillForgetThis 4y agoMy first job out of college (2007) involved a lot of removal of early 2000s one-off custom payment processing code. Access DBs full of years worth of credit card numbers, code that just emailed the credit card details to the site owner without keeping a record, etc. It was definitely a different world. Most of them, I just switched to PayPal shopping cart and checkout. In retrospect, I didn't know wtf I was doing and probably shouldn't have been working on it.
- michaelbuckbee 4y agoIf it's any consolation, the entire industry was in that state: poor controls, poor encryption, and security, etc.
- a2tech 4y ago"was"? It still seems like a confused mess with lots and log 'security' that people ignore
- michaelbuckbee 4y agoSure, there's always room for improvement, but at the very least SSL/TLS is ubiquitous now, there actual TLS versions are much better, developers generally view holding onto CC data directly as toxic (the growth of things like Stripe checkout, etc.)