8 of 8 Remote/Hybrid PySpark Jobs in the North of England

Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta ...

Experience Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. Proven experience in CI/CD practices using industry-standard tools (e.g., GitHub Actions ...

services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services … standards and best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

understanding of relational databases and data warehouse concepts (dimensions, facts, star schemas) and associated technologies (e.g., Databricks). Experience with Python (including Pandas/PySpark). Familiarity with software development and source control, in particular Git and CI/CD practices. Excellent communication and stakeholder management skills — able ...

understanding of relational databases and data warehouse concepts (dimensions, facts, star schemas) and associated technologies (e.g., Databricks). Experience with Python (including Pandas/PySpark). Familiarity with software development and source control, in particular Git and CI/CD practices. Excellent communication and stakeholder management skills — able ...

deliver scalable, high-quality data solutions. Key Responsibilities: Develop, optimise, and maintain ETL/ELT pipelines within Databricks Build reliable data ingestion frameworks using PySpark and Spark SQL Design well-structured data models across medallion/lakehouse architecture Work with DevOps teams to automate deployments using CI/… Ensure compliance with best practices around data governance, security, and quality Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse ...

that powers analytics and AI-driven solutions. What You'll Do Build and maintain scalable data pipelines in a cloud environment. Develop transformations using PySpark, Python, and SQL. Model data for analytics and reporting. Ensure data quality and performance. Opportunity to engage with stakeholders and challenge external partners. What … Looking For Solid foundations in data engineering with experience in cloud-based platforms. Hands-on experience with Databricks or Fabric. Strong SQL and PySpark skills. Understanding of ETL and dimensional modelling. Excellent communication and problem-solving mindset. Why Join? Work on modernisation projects including real-time reporting and AI. ...

development and optimisation of scalable data and pipelines in a cloud-based environment, building and managing ETL processes using tools such as Azure, Databricks, PySpark and SQL. The role would suit a strong Data Engineer with 2+ years' commercial experience working with cloud-based data tech (Azure & AWS), Python … relevant languages for ETL), relational and non-relational databases. Key skills required: Proficiency in implementing ETL pipelines Azure/AWS cloud proficiency Python/PySpark Strong SQL skills for database management SSRS/SSIS Ability to develop, optimise & maintain complex SQL queries & stored procedures (T-SQL) The role ...