2 ms·
SEEKING WORK, Senior Data Engineer, London UK and remote Software engineer with 13 years of experience. I have been doing data engineering projects for 7 years
by illy2093 8y ago
SEEKING WORK, Senior Data Engineer, London UK and remote
Software engineer with 13 years of experience. I have been doing data engineering projects for 7 years now.
Core langages : Python / Java / Scala / Bash
Core techs : Hadoop / Spark / Hbase / Airflow / Kafka / Solr / Zookeeper
I have been using AWS & DigitalOcean for few users now and can easily adapt to use other cloud providers.
Exmaple of a recent project :
- Built and productionised a workflow management solution based on Apache Airflow for a client of mine.
- Delivered an apache airflow docker based solution running on AWS ECS cluster. I have built terraform scripts to build AWS ec2 infra and ecs services.
- Migrated various existing pipeline (doing various stuff such as spark jobs...etc.) to airflow and setup best practises for the data engineering team.
I have worked successfully in the past remotely with startups and people on different timezone (SF).
Contact : illy2kevin at hotmail.com