1 to 25 of 118 PySpark Jobs in England

Practical Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark In addition to the above, strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics A strong background ...

Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

data warehouses or similar analytical platforms. Experience developing reliable ETL or ELT processes in the Medallion architecture. Experience with Microsoft Fabric data engineering, including Pyspark and dbt. Practical knowledge of data quality, testing, monitoring and operational support. Strong problem-solving skills and attention to detail. Clear communication ...

enterprise-scale environments. Deep expertise in Azure Databricks , Azure Data Factory , Azure Synapse , and Azure Data Lake . Hands-on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. ...

assisted software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

assisted software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

numbers just don’t look right, and work out why Engineering basics: comfortable with Git (branching, committing, reading diffs) Desirable (bonus points) Python, PySpark or Spark SQL, enough to read pipeline code and trace transformations Databricks, including Unity Catalog and medallion (bronze-silver-gold) architecture Azure or AWS data ...

scale data platforms,lakehousesand data warehouses. Data modelling and dimensional modelling techniques such as Kimball. ETL/ELT development and large-scale data integration. PySpark, Spark SQL and modern transformation techniques. Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle. Integrating structured, semi-structured and unstructured data ...

vs. centralized models, capacity (F-SKU) sizing and licensingDesign end-to-end Microsoft Fabric solutions: OneLake, Lakehouse, Warehouse, Data Factory pipelines, Dataflows Gen2, Notebooks (PySpark/Spark SQL), Real-Time Intelligence (Eventstreams, Eventhouse/KQL) and Power BI + Power BI CoPilotDesign governance, security and operating frameworks: data governance ...

Strong problem-solving and analytical skills. Desirable Experience with Microsoft Fabric. Experience with Azure Data Services. Working with multi-currency financial information Knowledge of PySpark or Spark SQL. Understanding of Microsoft Entra ID and security frameworks. Experience with DevOps and automated deployment pipelines. Knowledge of financial, legal, or professional ...

Strong problem-solving and analytical skills. Desirable Experience with Microsoft Fabric. Experience with Azure Data Services. Working with multi-currency financial information Knowledge of PySpark or Spark SQL. Understanding of Microsoft Entra ID and security frameworks. Experience with DevOps and automated deployment pipelines. Knowledge of financial, legal, or professional ...

Strong problem-solving and analytical skills. Desirable Experience with Microsoft Fabric. Experience with Azure Data Services. Working with multi-currency financial information Knowledge of PySpark or Spark SQL. Understanding of Microsoft Entra ID and security frameworks. Experience with DevOps and automated deployment pipelines. Knowledge of financial, legal, or professional ...

/CD deployment practices. Strong problem-solving and analytical skills.DesirableExperience with Microsoft Fabric. Experience with Azure Data Services.Working with multi-currency financial informationKnowledge of PySpark or Spark SQL.Understanding of Microsoft Entra ID and security frameworks.Experience with DevOps and automated deployment pipelines.Knowledge of financial, legal, or professional services data environments.Elite ...

such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security. Desirable experience Regulated environment. PySpark for large-scale data transformations. Migrating legacy data estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven systems. Data-quality ...

diversity of views and opinions. Key Skills & Experience: Proven experience in a Data Engineering role within the insurance industry Advanced SQL and PySpark skills, with hands-on experience building data transformations and data products Demonstrable data modelling experience, including practical experience with medallion architecture, and comfortable contributing technical input ...

Microsoft Azure environments Hands-on, current engineering skills: you still write the code, not just the diagrams Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake and Lakehouse architecture Strong Snowflake architecture and optimisation experience Experience with Azure Data Factory, ADLS Gen2, Synapse Analytics and/ ...

Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

following technical expertise: Platform Experience: Strong, hands-on experience with Databricks or Snowflake on AWS. Programming & Orchestration: Proven Python skills, including deep expertise in PySpark (or Spark) and Airflow. Data Modelling: Advanced SQL skills and extensive experience with end-to-end data modelling. Data Integration: Proven experience building both ...

role would require you to be onsite 4 days per week with the final day being remote. Key Responsibilities Develop Databricks solutions using SQL, PySpark and Python. Build and maintain ETL/ELT pipelines across Azure, SQL Server and Databricks. Support Lakeflow pipelines, production jobs and data quality processes. ...

accelerate development across code, infrastructure, testing and documentation while maintaining appropriate quality and security controls. Desirable experience Financial services or another regulated environment. PySpark for large-scale batch or streaming transformations. Migrating SQL Server and SSIS estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven ...

platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts, entity hierarchy, sub-ledger to ledger relationships, intercompany ...

platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts, entity hierarchy, sub-ledger to ledger relationships, intercompany ...

degree in a relevant discipline or equivalent practical experience. Desirable ExperienceStrong hands-on SQL and Python skills, with experience in distributed data processing using PySpark and/or Databricks. Experience with AWS services, APIs, event-driven integration and infrastructure as code. Exposure to AI/ML data preparation, data ...