6 ms·
Apache Pegasus - A horizontally scalable, high-performance key-value store
- scary-size 4y agoIs it me or are most of the docs only available in Chinese?
- hasperdi 4y agoAnyone using this in production? If so, how do you find it, is it good?
- spockz 4y agoWhy yet another key value store?
- sidcool 4y agoKV stores are a complex topic and research continues. Each new tool comes with its own set of trade offs. It would help to go through the documentation.
- jstummbillig 4y ago> Each new tool comes with its own set of trade offs Is the cognitive load this produces still worth the consideration? At what level do you have to operate for the gains to actually make viable business sense to even consider? Sometimes I am thinking "Well, surely at Google level" – and then I load up one of their interfaces, for example Google Ads, and I have to sit around for 10s before anything even shows up.
- prox 4y agoOr not at all like last week. Screens would take forever! It was better the next day luckily.
- sidcool 4y agoThere are so many startups in the KV DB space that it's absolutely worth it. Now if one is a consultancy, they can very well used any available key value stores. But beyond a certain scale, it's very useful to try and customize a KV store. That's where it becomes useful.
- ramraj07 4y agoYou could do a million other interesting things academically or commercially before diving into yet another KV store though.
- robertlagrant 4y agoHard to know what the point is of this line of reasoning. Someone or some company thought it was interesting, so they made it.
- tmikaeld 4y agoWill be interesting to see the benchmarks! There's a lot of KV engines that uses RocksDB now, like CockroachDB (Forked into PebbleDB though), YugabyteDB and TiDB. Those are all many times slower than Redis though, so having a middle-ground aimed to be similar to Redis, that doesn't eat all RAM, is very exciting!
- c0balt 4y agoIsn't TiDB built on top of TiKV?[0] [0]: https://github.com/pingcap/tidb https://github.com/pingcap/tidb
- yla92 4y ago> Those are all many times slower than Redis though I'd appreciate if there any links/doc that I could look into to learn more about this?
- ddorian43 4y agoBlog post from antirez http://oldblog.antirez.com/post/redis-persistence-demystified.html http://oldblog.antirez.com/post/redis-persistence-demystifie...
- xwowsersx 4y agoThanks for the link. In that post, he writes "Note: when we talk about disk controller we actually mean the caching performed by the controller or the disk itself. In environments where durability is important system administrators usually disable this layer of caching." I'm not sure I completely understand that note. Can you illuminate?
- pknerd 4y agoAnother key/Value store system. There are already like RocksDB, LevelDB and many others!
- seeekr 4y agoNote that this seems to be a relatively old project, first commits from 2015. The project seems active, but most of the work seems to have been done around its inception, with some significant activity from 2020 onwards. Speculation/interpretation: So this might be a project that was used internally by some company, but perhaps not any more, and they've decided to open-source it at some point (2017-2018?) because some folks were/are still excited about it and want to keep developing it. This might explain some of the "why yet another RocksDB-based KV store?" line of questioning.
- pas 4y ago> yet another RocksDB-based KV store Aaah, there was a super informative talk about the different databases at Facebook, most of them built on RocksDB, with different trade offs. (And I can't find the video :((((( ) Anyway, it makes sense to have yet another it if serves a different purpose. Eg. for read-heavy workloads (caches, serving user feeds, whatever), or write-heavy (monitoring, storing that sweet sweet tracking juice that then gets read once or twice while building the recommendation models), small or large blobs, latency requirements, HA/consistency requirements, how complicated queries are going to be, does it support secondary indices or not, etc.
- michaeltlewis 4y agoThat video sounds interesting, if you do manage to find it.
- xani_ 4y agoApache foundation is retirement home for projects so it checks out
- studmuffin650 4y agoI wouldn't say thats accurate. Theres many super successful and active apache projects still. To name a few: Kafka, Cassandra, Zookeeper, Spark, Tomcat, Superset, Storm, Lucene,Log4j2, Hadoop, etc. The list goes on, but I would safely say that a majority of the world's systems run on Apache projects which are for the most part actively developed
- endisneigh 4y agoBe curious to see differences between this and FoundationDB.
- truth_seeker 4y agowhy would I choose it over TiKV or RIAK ?
- hk1337 4y agoThis seems very interesting and I am peaked but the documentation and web page is lacking a lot to tell me what it is and how it's intended to be used. I know it's a key value store and it's supposed to be fast but that's it.