29 ms·
Do you use an API? Or just scraping? I've done the same, but stopped using it. Afraid my bank, if they detect it, might not like it.
by tokenizerrr 9y ago
Do you use an API? Or just scraping? I've done the same, but stopped using it. Afraid my bank, if they detect it, might not like it.
- rb808 9y agoI want to do this too. Details would be handy. Even if its extracting data from PDF statements or saved HTML pages.
- kensoh 9y agoBasically use a web automation tool to simulate the login process and then grab the data you want, save it to .csv file or something. For saved HTML pages, web automation tools generally can work with them. For saved PDF I'm not sure what is good.
- tokenizerrr 9y agoI used CasperJS to download a specific CSV file, providing the chrome user agent. Then I used a simple NodeJS script to parse this.
- kensoh 9y agoI did the same lol (via scraping), run every midnight to multiple bank accounts, then sync to google spreadsheet. I was writing web automation scripts the hard way for a while, until I made a tool to simplify the process of writing web automation scripts - https://github.com/tebelorg/TagUI https://github.com/tebelorg/TagUI (frankly I am surprised why my banks never banned or send me a letter)
- dmak 9y agoI clicked it expecting a basic script, but this is pretty comprehensive. Nice work!
- ams6110 9y agoYour bank would object to you accessing your own transaction data?
- kensoh 9y agoIn theory they shouldn't, though I believe many financial websites explicitly declare in their terms of use that automated access or web scraping data is not allowed.
- tokenizerrr 9y agoDo a careful reading of your banks terms of service and you will likely find a clause either barring you from doing this completely, or voiding fraud protection.
- dmak 9y agoWhole businesses like Yodelee and Plaid do this.
- tmerr 9y agoI use Selenium to drive a firefox browser under the assumption that banks don't care enough to detect it: https://github.com/tmerr/bank_wrangler https://github.com/tmerr/bank_wrangler . I am also slightly worried about banks not liking it, but if they do care I guess I will receive a scary cease and desist in the mail and I will cease and desist.
- tokenizerrr 9y agoMy concern is about what will happen if fraudulent activity happens, such as my account getting hacked somehow. Then they look into my account, discover I've been doing this somehow, tell me I've broken their TOS and I'm on my own.
- sly010 9y agoOn the upside you are more likely to notice a fraudulent activity if your script combs through your transactions daily.
- jessedhillon 9y agoI used to use pyofx and a lot of custom scraping to get this, but now I use Plaid. I work at Plaid now, but I used it before I got this position.