4 ms·
You are correct, doing this at 10GbE wire speed does not require any exotic hardware, just savvy high-performance software. Assuming your NIC and related driver
by jandrewrogers 13y ago
You are correct, doing this at 10GbE wire speed does not require any exotic hardware, just savvy high-performance software. Assuming your NIC and related drivers are of good quality (e.g. Intel) then it is just a matter of good design to have simple database-like operations (insertion, selection) keep up with the wire without ultra-powerful CPUs.
In fact, I've designed systems that go quite a bit beyond simple key-value stores e.g. wire speed polygon indexes with spatial operators. On modern hardware, if the system is efficient, the "put" side of a key-value store should only require a core or two to saturate the wire; the rest of the cores can be dedicated to saturating the outbound "get" side. It is dead simple to do at 1GbE; at 10GbE it does require some skill at high-performance algorithm design but I've seen it done many times.
- erichocean 13y ago+1 on not needing exotic hardware. This is—while not trivial—not exactly hard today with an Intel E5 processor and it's DPDK. What's strange is that they used an FPGA at all. The entire industry for network processors is moving the opposite way.