4 ms·
You have to understand that some aspects of the work stuff is covered under NDA :) HOwever.. The personal project is a social network site (still under develo
by ErrantX 18y ago
You have to understand that some aspects of the work stuff is covered under NDA :)
HOwever..
The personal project is a social network site (still under development) - I built the scalable back end because we secured some funding and were thinking of launching until other factors caused us to re-evaluate. We built the architecture because it is running an evolved version caching server I wrote at university plus some other parallel applications (my thesis was in these areas) I wrote to load balance the Databases :)
On the work front the smaller cluster is essentially a massive cache cluster (like BigTable) I wrote based on my previous work that we use in office for storing the large fast-access tables we use. We process & access numerous pre-generated hashes daily (upwards of a billion). The software can scale as we add / remove nodes. If it needs extra storage it can temporairily grab one of the other servers used for other purposes. If this happens a lot it notifies us we need a new addition: commodity hardware, 64Bit OS with jack lots of RAM and voila :D
The second setup is the hash generation system. The server side of this is a distributed storage system (again custom written). It does work closely with the hash database too.
I cant realy talk about the client side of the above :)
Coding in the scalability was the hardest part of all 3 exercises.
EDIT: and if that sounds cool, well, it is. But it is also a lot of headaches too :)