3 ms·
Hi everyone, many thanks for all your comments - though there may have been some misunderstanding that we address below: WE (at Nanosai.com) will attempt to bu
by bamborde_zaiku 7y ago
Hi everyone, many thanks for all your comments - though there may have been some misunderstanding that we address below:
WE (at Nanosai.com) will attempt to build a data streaming engine that can process 1 billion records per second, and release it as open source. If YOU want to try the challenge too, that's fine (e.g. someone already working on data streaming engine tech). We did not mean for YOU to solve this problem for US.
Our initial measurements and calculations show that it should be possible to reach 1BRS, although the records would have to be small. Still, a data streaming engine will always have some record iteration overhead, so it would take some tuning to get that overhead small enough to reach 1BRS even with 1 byte records.