rockeetterark

7 ms·

1.
Show HN: Relational-to-KV – AI maps relational models to ToplingDB/RocksDB(github.com)
5 points by rockeetterark 2mo ago|0 comments
2.
by rockeetterark 8mo ago
database are often used to store data and search data by 'conditions', ex: `select * from ... where <conditions>`. on the other side, in many cases we need to store MANY 'conditions' and search the stored condition
3.
We Developed a Rule Database(github.com)
1 points by rockeetterark 8mo ago|2 comments
4.
by rockeetterark 1y ago
Thank you for highlighting our project's activity! You're absolutely right -- this project is actively developed and growing .
5.
by rockeetterark 1y ago
Thank you, we have fixed READM, now it's very easy to start with ToplingDB by the tutorial in README.
6.
by rockeetterark 1y ago
Yes, we have S3 solution with ToplingDB for enterprise users.
7.
by rockeetterark 1y ago
Thank you!
8.
by rockeetterark 1y ago
Sure, MyTopling(MySQL) is based on ToplingDB and get the perf gains. There are other DBs also based on ToplingDB.
9.
by rockeetterark 1y ago
We keep the core component as private repo, which builds the ToplingZipTable files -- the SST with the searchable compression algo for speed. -- Although even without this component, ToplingDB is still outperforms RocksDB.
10.
by rockeetterark 1y ago
Sure, this is one of the reason we develop the framework of json/yaml conf and the embedded http server, with this framework, we discover several RocksDB bugs by this framework(we have contributed 100+ PRs and 60+ issues for RocksDB).
11.
by rockeetterark 1y ago
It depends on workloads, in most cases, there is at least 3x perf gain. One of our customer get 20x perf gain(point search). Another significant improvement is `select count(*) from SomeTable` in MyTopling, I optimized such query by 30x+ fa
12.
by rockeetterark 1y ago
Yes, you have exactly got the key points.
13.
by rockeetterark 1y ago
Yes, ToplingDB embeds an http server for showing DB info and online conf changes, this http server is very light weight and does not introduce any visible overhead. -- prometheus is supported by this this http server.
14.
Show HN: ToplingDB - A Persistent Key-Value Store for External Storage(github.com)
73 points by rockeetterark 1y ago|26 comments
15.
Todis: A New Redis server on external storage(github.com)
2 points by rockeetterark 5y ago|1 comments
16.
by rockeetterark 5y ago
Todis is a massive, persistent Redis server developed by Topling Inc which is a new start up company. The Todis author was also the author of TerarkDB/Terark which was acquired by Bytedance at 2019. Todis is Cloud Native, users can exp
17.
by rockeetterark 9y ago
The day they offer a download, I promise you we'll run a benchmark ;)
18.
by rockeetterark 9y ago
Sure! Our benchmark against MySQL is here: https://github.com/Terark/mysql-on-terarkdb/wiki/YCSB-on-9.1... We used YCSB on 9.1Gb of movie data. This benchmark is comparing MySQL with our product "MySQL o
19.
by rockeetterark 9y ago
Yep, this is an article we published on our blog to give a bit of background information on databases performance. It's very general. For benchmarks on TerarkDB's performance in particular, you can have a look here: https:/&
20.
by rockeetterark 9y ago
Thanks for mentioning it! Yes, for Chinese speakers, our CTO Lei Peng has answered a lot of questions on Zhihu (the Chinese Quora).
21.
by rockeetterark 9y ago
It works, but it's not the best scenario for us. Scenarios with financial data are most likely sequential read (gimme all data for the last 50 trading days) and write heavy (tick-level write). We're blowing away the rest of the pa
22.
by rockeetterark 9y ago
In our situation, making it fully open source for wide adoption would oblige us to become a consulting company with revenue based on support. This would require a large headcount that we cannot support as a mostly bootstrapped startup. So,
23.
by rockeetterark 9y ago
Thanks. These assertions are here to give a basic background and overview of databases performance in general. The real game changer with Terark is our novel compression algorithm. It's more space efficient, that's one thing, but
24.
by rockeetterark 9y ago
Thank you, we really appreciate your comment. As I mentioned in an other reply, we understand the claim may sound outlandish, so we try to be as transparent as possible: - We provide several different benchmark results and detailed procedur
25.
by rockeetterark 9y ago
That is correct. We simply built a storage engine technology. You run it yourself on your own servers. Everything is open source except for the core compression algorithms that are loaded as a proprietary dynamic library. Being a young star
26.
by rockeetterark 9y ago
In 200x improvement in random read performance, compared to RocksDB or WiredTiger (MongoDB's storage engine). You can find benchmarks on our website: https://terark.com/en/index And here: https://github
27.
by rockeetterark 9y ago
TerichDB is an experimental repo. We'll take it private to avoid confusion. Thanks for pointing this out. Regarding the license of our products: the core of TerarkDB is a plug-in for RocksDB. It is loaded as a dynamic library for libro
28.
by rockeetterark 9y ago
Sorry, I know the article is kind of sensational but it also has some good information and we're here to discuss the real substance in the thread. Terark built a new storage engine for Database and Data Systems based on the Succinct Ne
29.
Terark (YC W17) is a profitable database compression company based in Beijing(techinasia.com)
44 points by rockeetterark 9y ago|29 comments