3 ms·
Does anyone know if Couchbase can be used as a TB sized data warehouse? Seems a bit difficult since it seems all keys must be stored in memory.
by devanti 12y ago
Does anyone know if Couchbase can be used as a TB sized data warehouse? Seems a bit difficult since it seems all keys must be stored in memory.
- skjhn 12y agoIt can and it is, but it might have to be scaled out. http://www.couchbase.com/liveperson http://www.couchbase.com/liveperson http://www.couchbase.com/paypal http://www.couchbase.com/paypal
- devanti 12y agothanks!
- danws6 12y agoAt my previous company we experimented with a 12 node cluster (128GB per node) used as a datastore. At one point we had over 1 billion keys. This was back in the 1.x version where they persisted data into sqlite files so each file would have 100+ million rows in it. Persisting data took forever. Rebalancing took forever. When it worked, it was very fast. When you lost a node, things went bad. The java client would lose it's mind trying to cope with an outage. We ended up writing a connection pool were we could just recreate our connections when we detected a node went out. That said, it was the best distributed NoSQL solution we tried and might have improved a lot since I last used it.
- devanti 12y agoreally helpful info. thanks!