2 ms·
Ask HN: Data Engineers, what's your job description, skillset and actual role?
I've seen too many variations for this specific title. Wanted to hear from the horses' mouths.
- badpun 9y agoIn my case it's coding either some batch jobs in Scala, Spark (on a Hadoop cluster) and Oozie or some real-time pipelines with similar technologies (+Kafka, Spark streaming). The job pays well, but the tech is clunky and slow to develop in.