Data Engineer
- Location
- Newcastle upon Tyne, England, United Kingdom
ecosystem. What you'll need: Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake. Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation. Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming. Knowledge of data warehousing, lakehouse architectures … data governance, security and access controls, including Unity Catalog and Purview. Experience monitoring, optimising and troubleshooting cloud-based data platforms. Excellent problem-solving, communication and stakeholder management skills. Collaborative approach with the ability to work effectively across technical and business teams. Passion for innovation, continuous improvement and emerging data technologies. ...