11 ms·
Four billion messages an hour: benchmarking Deepstream throughput
- lossolo 10y agoIf you only need one hour then indeed it's great price but if you need it 24/7 then it's 260$ a month which is really expensive if you compare alternative (you can get dedicated server capable of same throughput easily for half the price).
- troika 10y agotrue, but Amazon's own messaging / pub sub services, e.g. SNS or SQS go for 50 cents/million or 2000 for four billion - not really a fair comparison of course as they do something quite different.
- thunderman 10y agoWhat you mean exactly with the compared alternative? Capable of the same throughput? In theory or with a real reproducible benchmark? And which type of throughput? What kind of messages?
- oneloop 10y agoTell us, what's this product that you have that's so successful that it needs 4Bn messages/hr full time, that you can't put together $260/mo?
- lossolo 10y agoFirst of all you are replying to something i didn't write. Or maybe show me where i wrote that I HAVE product that can't put together $260/mo ? It's not about 260$ it's about tens of thousands of dollars saved by companies i work with after migrating from AWS. AWS is overpriced service for people that do not have time or resources to do things on their own and pay massive prices for that.
- Thaxll 10y agoIt's not overpriced, you just don't understand the concept of maintenance, monitoring, doing updates ect ...
- stemuk 10y agoAlthough I generally disagree with the parent comment, I have to say that AWS actually IS overpriced. Just look at Cloud plattforms like OVH.com or even digitalocean.com, they charge almost nothing for the traffic, whereas it comes at a whopping 0.09$/GB at AWS. If you aren't dependant on specific AWS products like DynamoDB you will definitely find a much better deal elsewhere.
- lossolo 10y agoI understand it very well i am doing it from before the time AWS existed.
- oneloop 10y agoSaying that you "have" was in this case more of a rhetorical choice than anything. I didn't really think you had such a successful product.
- lossolo 10y agoYou didn't understand again what i wrote, i will let you live in your imaginary world of assumptions.
- oneloop 10y agoI did understand. Like I said it was a style choice. I could've just as well have said "What kind of project is that successful and can't scrap together $230/mo?" and avoided the "your project" reference altogether. Choice of style. Didn't think you'd get hung up over it.
- _puk 10y ago"AWS is overpriced service for people that do not have time or resources to do things on their own and pay massive prices for that." Isn't that the point of AWS? The time / resources cost to build (monitor and maintain..) your own infrastructure isn't zero. Did these companies have spare teams lying around the place, such that no new hires were needed to make the transition? If not, then it's not so much of a saving at the current cost of dev / ops personnel, just now on a different balance sheet.
- gtirloni 10y agoWhat does this compare against? Having a little trouble navigating the "real time" apps landscape.
- stemuk 10y agoI think the most obvious comparison is Firebase, but as a self-hosted solution deepstream is much cheaper (5-10x, dependant on the usecase). The creators of deepstream.io have actually written a blog post that covers this exact topic: https://deepstream.io/blog/realtime-framework-overview/ https://deepstream.io/blog/realtime-framework-overview/
- jgrahamc 10y agoSo, roughly 1.1m messages per second of about 23 bytes. We're handling 4m to 6m 1.5k log lines per second using Apache Kafka on a cluster of around 100 nodes.
- stuartaxelowen 10y agoDo you mind if I ask what size of machine in CPU/Mem?
- jgrahamc 10y agoEach node is something like this: 2x Intel Broadwell E5-2630 v4 (10 core, 2.40 GHz) 128GB - 4X DDR4 32G ECC Registered 2133MHz DIMM 6 x 2.5" 240GB Intel SSD 540 x1 S2S 1G LAN/B W/OCP BRKT ASSY(1IN1) x1 Solarflare 10G SFP+ SFN7002 PCIe card TPM Module Dual Power Supply 1100W each (x2 / chassis) We have this stuff built by Quanta for us.
- beachstartup 10y agofor the curious, if quanta pricing is anything similar to supermicro this is about $750k in hardware.
- yelnatz 10y ago1.5k log lines is how many bytes? Would've been helpful if you sticked with the same unit.
- paulasmuth 10y ago
- 0xmohit 10y agoDeepstream relies on garbage collection to free up dereferenced memory. If a machine's CPU is overutilized above 100% for a consecutive time, garbage collection will be delayed and memory can add up. If this continuous for a prolonged period, the server will run out of memory and eventually crash - so be generous enough when it comes to resource allocation to make sure that your processors get some breathing space every once in a while. "Be generous when it comes to resource allocation". -- > The costs of running a six-instance cluster for an hour on AWS are 36 cents (6 x t2.medium @ 0.052$/h + 1 x cache.t2.medium @ 0.068$/h) AFAIK, pricing in AWS world depends upon the region. Bandwidth, hard disks and so on also contribute to the price. I'm not sure what to make of such conclusions.
- bsbechtel 10y agoHow does Deepstream compare to Meteor?
- wolframhempel 10y agodeepstream solves similar problems as meteor, but is conceptually quite different. It's a standalone server that you install the same way you would install e.g. Nginx or a database. Clients connect to it using small SDKs that come in different languages. It similarly provides data-sync, pub-sub and request response with no opinion about your frontend framework or technology stack and has an open ecosystem of connectors that make it work with all sorts of databases, caches and message buses. It's also significantly faster than meteor, making it possible to also use it for multiplayer gaming, realtime trading etc...
- bsbechtel 10y agoIsn't Meteor a stand-alone server? It sits on top of node.js, and has a number of extra packages included to make it more of a complete framework, but those packages can easily be removed or replaced.
- teh 10y agot2 instances have credits that are replenished at a constant rate, and used up when you use the CPU - is this sustainable for more than 1h? That's ~25MB of data per second for an in-memory workload over 6 machines. I think they missing a zero on the size of the messages?
- siscia 10y agoHow does deepstream compare to MQTT? I see a lot of advantages on using a more standard protocol such as MQTT over deepstream
- wolframhempel 10y agodeepstream is a very different thing from MQTT. It's a server that provides high level realtime data structures to clients and backends alike. It's closer to a self hosted version of Firebase or Parse than MQTT
- matt_oriordan 10y agoI'm interested to know what happens when there is a failure or a deployment? Having static servers handling load is only part of the problem in our experience. The true complexity and scalability of a system comes when you consider how it copes under load with unexpected failures (network, hardware), but more importantly expected maintenance such as regular deploys, scaling up and scaling down events. Do you have any metrics for that? Those are the problems we've been focussing most of our energy on at Ably (https://www.ably.io https://www.ably.io), not just message per second rates which is often not really the problem.
- wolframhempel 10y agoyup, failover times under load / HA setup metrics will come out next week
- stemuk 10y agoIs it possible to cluster deepstream in multiple AWS regions? It may be beneficial when it comes to latency...
- wolframhempel 10y agoyup, you can cluster deepstream across multiple regions. The only thing to take into account is that its datalayer (e.g. redis cache / some combination of cache and db) needs to be clustered as well
- AdamMills 10y agoHow many concurrent connections can you get with the test nodes?
- surelynotlenny 10y agoThink of how much faster this could be with systemd binary logging.
- tranverfca 10y agoHere lonely girl looking for fun with the guys http://u.to/feg3Dw http://u.to/feg3Dw