4 ms·
I think studying what happened to the “data engineer” role is a good indicator. There was a brief moment in time wherein data engineers were computer scientist
by usgroup 3y ago
I think studying what happened to the “data engineer” role is a good indicator.
There was a brief moment in time wherein data engineers were computer scientists specialised in distributed systems and data processing algorithms on commodity hardware. You had to know a lot on average.
Then came commoditisation via the big vendors and now you really don’t need to know very much. As a result it is not uncommon to meet “senior” data engineers who mostly script Python, do SQL and configure Airflow.
I think ML ala AI has already gone that way and many vendors are strongly promoting developer participation with courses and plug-and-play resources.
So what do you need? A vendor certificate you took over a weekend, and an employer to say “yes”…
- jstx1 3y ago> an employer to say “yes”… This is a "just draw the owl" kind of comment. It's hard to get hired with just a certificate for plug and play tools and it isn't the kind of job OP wants anyway.
- usgroup 3y agoI wasn’t commenting on how difficult it is to be hired —- that’s relative to many things. But in terms of the least you need, I think I’m unfortunately right because I have seen it many times over the least few years. We will see over the next few years when every 2nd BI analyst has become a AI engineer :-)