3 ms·

I am not an expert in either and have only worked with Kafka. At a past job I had to write a connector job to parse and sanitize some extremely dirty, unstructu

I am not an expert in either and have only worked with Kafka. At a past job I had to write a connector job to parse and sanitize some extremely dirty, unstructured data and pass it along somewhere else. RabbitMQ supports this? What is the one use case of kafka? I think you have it backwards.

whalesalad 3y ago
> parse and sanitize some extremely dirty, unstructured data and pass it along somewhere else can you be more specific? that to me sounds like hello world for either of these tools. "santize data" is an application level concern that neither rabbit or kafka would handle. as far as "pass along somewhere else" again both tools can do.
- JohnMakin 3y ago
  It was a Sink Connector. I don’t know what it was or wasn’t supposed to do but I was asked to do it, as is often the case in tech. I could have done any number of transformations in that process though, which I’m not sure rabbitmq supports
  - whalesalad 3y ago
    It sounds to me like you aren't really even sure what you built. I have operated both rabbit and kafka at scale I definitely do not have it backwards :)
    - JohnMakin 3y ago
      No, I’m not, because it was years ago, and I’m asking for clarification because what was said immediately sounded wrong to me (I’ve managed a lot of rabbitmq deployments) and you’ve not really given one other than an appeal to authority. guess I have my answer. Can’t find anything that suggests rabbitmq natively supports anything like sink connectors. thanks.
      - NovemberWhiskey 3y ago
        > I am not an expert in either and have only worked with Kafka. > I’ve managed a lot of rabbitmq deployments ... ?
        JohnMakin 3y ago
        You do not need to be an expert in something's internal workings to manage/monitor a deployment. Surely this does not need to be explained further.
        sgarland 3y ago
        > I think you have it backwards You do need to be an expert when you start telling other people they’re wrong, though.
        lnenad 3y ago
        A classic exchange on the internet.
      - FINDarkside 3y ago
        So let me get this straight. You've used Kafka once, RabbitMQ never. You don't really know what you did with Kafka. But you somehow know that RabbitMQ cannot do the thing which you don't really remember anymore. Doesn't make much sense to be honest. Nobody can really have any sources for RabbitMQ being able to do it if you don't know what it supposedly cannot do. The way you descibed it, is that you simply read data and then did something with the data and passed it to somewhere else. RabbitMQ obviously can do it.
        JohnMakin 3y ago
        > So let me get this straight. You've used Kafka once, RabbitMQ never Not true, and some also for the rest of your snotty comment, I'd have a response but it's best not to engage trolls. Another commenter answered the question I had. Good luck. Also, did you register solely to make this comment? Pretty sad display, really.

whalesalad 3y ago

> parse and sanitize some extremely dirty, unstructured data and pass it along somewhere else can you be more specific? that to me sounds like hello world for either of these tools. "santize data" is an application level concern that neither rabbit or kafka would handle. as far as "pass along somewhere else" again both tools can do.

JohnMakin 3y ago
It was a Sink Connector. I don’t know what it was or wasn’t supposed to do but I was asked to do it, as is often the case in tech. I could have done any number of transformations in that process though, which I’m not sure rabbitmq supports
- whalesalad 3y ago
  It sounds to me like you aren't really even sure what you built. I have operated both rabbit and kafka at scale I definitely do not have it backwards :)
  - JohnMakin 3y ago
    No, I’m not, because it was years ago, and I’m asking for clarification because what was said immediately sounded wrong to me (I’ve managed a lot of rabbitmq deployments) and you’ve not really given one other than an appeal to authority. guess I have my answer. Can’t find anything that suggests rabbitmq natively supports anything like sink connectors. thanks.
    - NovemberWhiskey 3y ago
      > I am not an expert in either and have only worked with Kafka. > I’ve managed a lot of rabbitmq deployments ... ?
      - JohnMakin 3y ago
        You do not need to be an expert in something's internal workings to manage/monitor a deployment. Surely this does not need to be explained further.
        sgarland 3y ago
        > I think you have it backwards You do need to be an expert when you start telling other people they’re wrong, though.
      - lnenad 3y ago
        A classic exchange on the internet.
    - FINDarkside 3y ago
      So let me get this straight. You've used Kafka once, RabbitMQ never. You don't really know what you did with Kafka. But you somehow know that RabbitMQ cannot do the thing which you don't really remember anymore. Doesn't make much sense to be honest. Nobody can really have any sources for RabbitMQ being able to do it if you don't know what it supposedly cannot do. The way you descibed it, is that you simply read data and then did something with the data and passed it to somewhere else. RabbitMQ obviously can do it.
      - JohnMakin 3y ago
        > So let me get this straight. You've used Kafka once, RabbitMQ never Not true, and some also for the rest of your snotty comment, I'd have a response but it's best not to engage trolls. Another commenter answered the question I had. Good luck. Also, did you register solely to make this comment? Pretty sad display, really.