4 ms·
I was wondering regarding Web3 data, if anyone was succesful to self-host the transactions in some local database. When I was trying to do that, my local syste
by i_like_waiting 4y ago
I was wondering regarding Web3 data, if anyone was succesful to self-host the transactions in some local database.
When I was trying to do that, my local system could keep up only with doing writes, but not much more.
What specs you need to have for that? I guess now its like 10tb of transactions in Ethereum, 1m transactions per day.
- i_like_waiting 4y agoAlso if somebody wants to get into this type, I would recommend infura as source of data, or some other similar providers.
- ushakov 4y agoi'd also add alchemy (alchemy.com) to the list
- ushakov 4y agoGoogle was https://cloud.google.com/blog/products/data-analytics/introducing-six-new-cryptocurrencies-in-bigquery-public-datasets-and-how-to-analyze-them?hl=en_US https://cloud.google.com/blog/products/data-analytics/introd... storing billions of records in database is hard, but querying them is harder if you want to try, get yourself some proper tools first: https://github.com/blockchain-etl https://github.com/blockchain-etl or you can just query transactions via RPC
- mritchie712 4y agoYes, it's well into the TBs of data now. Even compressed we're over 1TB for just Ethereum at Luabase (https://luabase.com/ https://luabase.com/, we provide a "data stack in a box" for blockchain data)