AWS Data Migration Engineer
About The Position
To integrate complex real-world Customer TV and Digital Ad viewing data to perform pre- campaign planning and post-campaigns performance measurements using Big Data Platform (Databricks, Glue, EMR, Step-functions, Lambda, PySpark and other AWS services to support existing workloads, Automate and monitor and based on requirement develop an elastic, scalable, high performance and cost-effective solution in collaboration with cross functional teams. Position is responsible for the support, migration, automation and monitoring of existing data pipelines and based on new requirements, design, develop, test, and deploy the Big Data Analytics solutions on cloud (AWS) and Databricks. Collaborate with key stake holders and translate business requirements to technical requirements & implement solutions. Dive into large, noisy, and complex real-world customer TV and Digital Ad viewing data to do pre-campaign planning and post campaigns performance measurement using Big data Platform (Databricks, PySpark, Glue, EMR). Responsible for support, migration, automation and monitoring of data pipelines to ingest data, integrate data from multiple data sources (On-Premise & Cloud) and create aggregated data sets for reporting needs and appropriate notifications.
Requirements
- 8+ years of overall software development
- Experience on Big Data Technologies, Hadoop Eco system and Technologies with experience programming in Scala, PySpark and Python
- Requirement gathering, design and Support, Migration, Automation
- Monitoring of data pipelines with PySpark, AWS services
Responsibilities
- Support, migration, automation and monitoring of existing data pipelines
- Design, develop, test, and deploy the Big Data Analytics solutions on cloud (AWS) and Databricks based on new requirements
- Collaborate with key stake holders and translate business requirements to technical requirements & implement solutions
- Dive into large, noisy, and complex real-world customer TV and Digital Ad viewing data to do pre-campaign planning and post campaigns performance measurement using Big data Platform (Databricks, PySpark, Glue, EMR)
- Support, migration, automation and monitoring of data pipelines to ingest data, integrate data from multiple data sources (On-Premise & Cloud) and create aggregated data sets for reporting needs and appropriate notifications
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
