4 ms·
as someone who’s been in the industry for 20 years, and worked in ML data engineering at twitch, i think you’re just using new words (some are tools but so what
by mylons 4y ago
as someone who’s been in the industry for 20 years, and worked in ML data engineering at twitch, i think you’re just using new words (some are tools but so what) to describe moving data around and making it accessible to people who need it.
- eropple 4y agoYeah - I've never been a "data engineer", but I've been doing this sort of shoveling for twenty years. We called it "ETL" and felt faintly foolish blogging about it.
- mylons 4y agoi think ETL is the most timeless phrase because it's not tied to a trend. devops, data engineering, ML engineering, MLOps are all just lipstick on the pig.
- mountainriver 4y agoYes I've been an engineer for 15 years at a bunch of big companies. MLops isn't ML data engineering. I doubt data engineering has many changes outside of active learning.
- mylons 4y agoagain, i think these labels are useless. they just say you might understand the trendiest tool in the arena right now.
- mountainriver 4y agoML isn't about trendy tools, its a fundamentally different paradigm from deterministic programming that has a different skillset
- mylons 4y agomaybe if you’re writing gradient descent, but not if you’re creating ETL pipelines.