tylertreat

16 ms·

1. 151.▲
   by tylertreat 12y ago

   Fair criticism :) The reason I mostly focused on various Bloom filters was because I actually encountered a problem at work recently that required them to deduplicate messages in a distributed messaging system. Mostly was journaling my res
2. 152.▲
   Stream Processing and Probabilistic Methods: Data at Scale(bravenewgeek.com)

   25 points by tylertreat 12y ago|6 comments
3. 153.▲
   Go-datastructures – high-performance data structures(github.com)

   3 points by tylertreat 12y ago|0 comments
4. 154.▲
   by tylertreat 12y ago

   How do you maintain data consistency at scale?
5. 155.▲
   by tylertreat 12y ago

   Not yet. The blog post linked in the readme there provides some more background on the motivation behind the project. I'm hoping to do some in-depth analysis of several brokers at some point, but I want to get the benchmark instrumenta
6. 156.▲
   by tylertreat 12y ago

   Really nice write up. I'm curious if you guys have done any extensive throughput and latency benchmarking? I saw the note saying "ballpark figures." FWIW, I've been working on a framework for empirically testing queue pe
7. 157.▲
   by tylertreat 12y ago

   I think pfctl is the suggested replacement for ipfw, which was deprecated in Mavericks. I wrote the Comcast tool someone linked in this thread. Haven't had a chance to dive through the pfctl man pages to add support for Yosemite yet un
8. 158.▲
   Show HN: Flotilla – Automated broker orchestration for scaled-up benchmarking(github.com)

   1 points by tylertreat 12y ago|0 comments
9. 159.▲
   Benchmark Responsibly(bravenewgeek.com)

   1 points by tylertreat 12y ago|0 comments
10. 160.▲
    Not Invented Here(bravenewgeek.com)

    2 points by tylertreat 12y ago|0 comments
11. 161.▲
    by tylertreat 12y ago

    Yeah, for the record, the benchmarks I've run aren't at all scientific. Should also be looking at percentiles. That said, surge looks promising so nice work, Jian :) My dream would be to build a framework which orchestrates testin
12. 162.▲
    Sometimes Kill -9 Isn't Enough(bravenewgeek.com)

    119 points by tylertreat 12y ago|18 comments
13. 163.▲
    The Saddest Moment [pdf](research.microsoft.com)

    4 points by tylertreat 12y ago|0 comments
14. 164.▲
    by tylertreat 12y ago

    Thanks for sharing, that's a really interesting read. Also would have been very helpful while writing my own implementation, although maybe it's better I didn't beforehand. It's more fun to work on a problem without any
15. 165.▲
    by tylertreat 12y ago

    I believe you're confusing goroutines with channels. Goroutines are lightweight threads of execution. Channels are the pipes that connect goroutines.
16. 166.▲
    by tylertreat 12y ago

    Got it, that makes more sense.
17. 167.▲
    by tylertreat 12y ago

    Thanks, I'm not much of a C programmer, so I appreciate the feedback. I'm not sure what you're referring to with the mutexes and pcond not being on the struct because they are. Can you clarify? You are right with the disposal
18. 168.▲
    Show HN: Chan – pure C implementation of Go channels(github.com)

    150 points by tylertreat 12y ago|44 comments
19. 169.▲
    by tylertreat 12y ago

    Persistence was disabled. Nano and ZMQ are in their own group and aren't even attempted to be compared to other groups.
20. 170.▲
    by tylertreat 12y ago

    Yes, you're correct. "Benchmark" is a very unfortunate misnomer.
21. 171.▲
    by tylertreat 12y ago

    For anyone interested, I did a write up on Iris a few weeks ago, including how it stacks up to other golang messaging libraries. http://www.bravenewgeek.com/iris-decentralized-cloud-messagi...
22. 172.▲
    Dissecting Message Queues(bravenewgeek.com)

    4 points by tylertreat 12y ago|0 comments
23. 173.▲
    Distributed Messaging with ZeroMQ(bravenewgeek.com)

    1 points by tylertreat 12y ago|0 comments
24. 174.▲
    No More Ninjas(bravenewgeek.com)

    1 points by tylertreat 13y ago|0 comments