2 of 2 Contract Databricks Jobs in the North of England

I'm seeking a Data Engineer with extensive hands-on experience in Databricks, Azure Data Factory, Python, and DBT. The suitable candidate will develop data models, troubleshoot pipelines, and deliver production-ready code. Effective communication skills and the ability to articulate technical decisions clearly are essential for this role. Additionally … pipelines using Azure Data Factory Automate ETL workflows to support machine learning features Apply best practices for data governance, quality, and performance Utilise Azure Databricks and adhere to code-based deployment practices Essential Skills: Over 3 years of experience with Databricks (including Lakehouse, Delta Lake, PySpark, Spark SQL) Strong proficiency … with 5+ years of experience Extensive experience with Azure Data Factory Proficiency in Python programming Excellent stakeholder/client-facing communication abilities Desirable Skills: Databricks certification Experience with Terraform for infrastructure as code Background in financial services or insurance industries Understanding of data governance frameworks Knowledge of best practices in More ❯

Job Title: Data Engineer (w. Prophecy) In this role you will: Design, develop, and optimize data pipelines using Azure Databricks, PySpark, and Prophesy. Implement and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Apache Airflow for orchestration. Develop and optimize complex SQL queries and Python-based data … role you should meet the following requirements: Must have experience with Delta Lake and Lakehouse architecture. Proven experience in data engineering, working with Azure Databricks, PySpark, and SQL. Hands-on experience with Prophesy for data pipeline development. Proficiency in Python for data processing and transformation. Experience with Apache Airflow for More ❯