5 ms·
> big data That's because it didn't get a chance to mature and to show how it could be powerful. People kept trying to force hadoop into it and call themselves
by monksy 6y ago
> big data
That's because it didn't get a chance to mature and to show how it could be powerful. People kept trying to force hadoop into it and call themselves "big data experts"
We've gotten a bit more clarity in this world with streaming technologies. However, there hasn't been a good and clear voice to say "hey .. this is how it fits in with your web app and this is what you expect of it". (I'm thinking about developing a talk on this.. how it fits in [hint.. your microservice app shouldn't do any heavy lifting of processing data])
- synthc 6y agoThese days it's people trying to force Kafka into it and call themselves "streaming experts"
- monksy 6y agoKafka is good.. but it requires a lot of good work to get it working well for a pipeline.
- lumost 6y agoMost buzzwords exist for consultants to sell their services. Successful buzzwords turn engineers into "Big Data Engineers" who only want to work on something called big data, and convince management that they need more "big data expertise". In practice most of these technologies and their peers exist to support real applications, and it would be almost immediately recognizable that they are the appropriate choice when working on a similar application. You don't need a streaming engineer/big data consultant to cram them in.