Data Engineer II

Building Location: Peerless Building Department: 1007670 ANALYTICS AND ARCHITECTURE – EH SS Job Description: The Data Engineer II is responsible for designing and optimizing scalable and complex data pipelines and workflows to handle large datasets. They are expected to implement advanced data processing and scheduling techniques using frameworks like Apache spark, ADF and airflow. Ensures data quality, governance, and security through automated testing and monitoring solutions. Collaborate wit…