1 to 25 of 161 Remote/Hybrid PySpark Jobs in the UK

Data Architect (Azure Databricks, Specialty Insurance)

Location
Greater London, England, United Kingdom
with Lloyd’s, bordereaux, reinsurance, or regulatory and actuarial reporting. Hands‐on experience designing solutions on Azure Databricks, including Delta Lake, Unity Catalog, Spark (PySpark and Spark SQL) and Databricks SQL. Experience with core Azure data services and their integration with Databricks, such as ADLS Gen2, Azure Data Factory ...

Senior Data Engineer

Hiring Organisation
Reed
Location
Guildford, Surrey, United Kingdom
Employment Type
Full-Time
Salary
£55,000 - £75,000 per annum, Inc benefits
Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

Senior Data Engineer

Hiring Organisation
Reed
Location
Lewes, East Sussex, United Kingdom
Employment Type
Full-Time
Salary
£55,000 - £75,000 per annum, Inc benefits
Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

Data Engineer

Location
City Of London, England, United Kingdom
data warehouses or similar analytical platforms. Experience developing reliable ETL or ELT processes in the Medallion architecture. Experience with Microsoft Fabric data engineering, including Pyspark and dbt. Practical knowledge of data quality, testing, monitoring and operational support. Strong problem-solving skills and attention to detail. Clear communication ...

Analytics Engineer

Hiring Organisation
Wesleyan
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Temporary Contract, Hybrid
Data Protection Act 2018). Preferred Experience in financial services, insurance or a similarly regulated sector. Experience with Python (or other scripting languages, e.g. PySpark) for data engineering and automation tasks. Familiarity with DevOps/CI-CD practices and version control (e.g. GitHub, Azure DevOps) for data ...

Senior Data Engineer – Azure Databricks

Location
Greater London, England, United Kingdom
Good understanding of modern software platform architecture and the role of the data platform within the broader platform ecosystem Good Scala skills (or strong PySpark plus a genuine willingness to work primarily in Scala) Strong SQL skills for transformations, data modelling, and debugging data issues Experience building and supporting ...

Data Engineer

Location
Nottingham, England, United Kingdom
with Microsoft Fabric technologies including OneLake, Lakehouse, Warehouse, Data Factory, Spark and Power BI. Strong Engineering Skills - You're proficient in SQL, Python and PySpark, with experience developing scalable and maintainable data solutions. Modern Data Platform Experience - You’ve successfully built, enhanced or operated cloud‐based data platforms, ideally ...

Senior Data Engineer

Location
City Of London, England, United Kingdom
deployment automation and infrastructure-as-code practices. What We're Looking For Essential Strong commercial experience building production-grade data pipelines using Apache Spark (PySpark preferred). Experience delivering modern data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. Good ...

Databricks Data Engineer

Hiring Organisation
EXL Service
Location
Leeds, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
ideally in enterprise-scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. ...

Data Engineer

Location
Greater London, England, United Kingdom
deployment automation and infrastructure-as-code practices. What We're Looking For Essential Strong commercial experience building production-grade data pipelines using Apache Spark (PySpark preferred). Experience delivering modern data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. Good ...

Data Engineer (Palantir Foundry Experience Required)

Location
Reading, England, United Kingdom
3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

Data Engineer - Senior Consultant

Hiring Organisation
Hackajob Ltd
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, Remote
Salary
£74,999
data platforms, lakehouses and data warehouses. Data modelling and dimensional modelling techniques such as Kimball. ETL/ELT development and large-scale data integration. PySpark, Spark SQL and modern transformation techniques. Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle. Integrating structured, semi-structured and unstructured data ...

Senior Data Engineer

Location
Bristol, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You’ve worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Senior Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Consultant

Location
Leeds, England, United Kingdom
3+ years with strong Foundry depth). Proven, hands‐on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

Senior Data Engineer

Hiring Organisation
We Are Dcoded Limited
Location
South East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£75,000
Python, plus hands-on Git Production experience with at least one of Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark Cloud-native orchestration and distributed data processing Infrastructure as code (e.g. Terraform) CI/CD and DevOps or DevSecOps practice A sound grasp of data architecture ...

Data Developer (12 month contract)

Location
Greater London, England, United Kingdom
Strong problem-solving and analytical skills. Desirable Experience with Microsoft Fabric. Experience with Azure Data Services. Working with multi-currency financial information. Knowledge of PySpark or Spark SQL. Understanding of Microsoft Entra ID and security frameworks. Experience with DevOps and automated deployment pipelines. Knowledge of financial, legal, or professional ...

Data Engineer - Senior Consultant

Location
United Kingdom
scale data platforms,lakehousesand data warehouses. Data modelling and dimensional modelling techniques such as Kimball. ETL/ELT development and large-scale data integration. PySpark, Spark SQL and modern transformation techniques. Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle. Integrating structured, semi-structured and unstructured data ...

Lead Data Engineer - AWS / AI / SQL

Hiring Organisation
Adria Solutions Ltd
Location
Manchester, United Kingdom
Employment Type
Permanent
Salary
£70000 - £90000/annum
such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security. Desirable experience Regulated environment. PySpark for large-scale data transformations. Migrating legacy data estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven systems. Data-quality ...

Lead Data Engineer - AWS / AI / SQL

Hiring Organisation
Adria Solutions
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£90,000
such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security. Desirable experience Regulated environment. PySpark for large-scale data transformations. Migrating legacy data estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven systems. Data-quality ...

Data Engineer

Hiring Organisation
Syntax Consultancy Ltd
Location
Derby, Derbyshire, United Kingdom
Employment Type
Permanent
Salary
£40000/annum 40,000 + Benefits
Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

MS Fabric Data Engineer

Hiring Organisation
Syntax Consultancy Ltd
Location
Derby, Derbyshire, United Kingdom
Employment Type
Permanent
Salary
£40000/annum 40,000 + Benefits
Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

Data Engineer

Hiring Organisation
Syntax Consultancy Limited
Location
Belper, East Midlands, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£40,000
Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

Data Engineer

Location
West of England, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An understanding of how to design and build well-structured ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
orchestrate the ingestion of data from disparate source systems into a centralised data analytics platform. Designing and implementingdata engineering solutions using T-SQL, Python, PySpark and DBT in the Azurecloud environment. Working with Data Analystsin promoting business logic into DBT data models, to support business reportsand dashboards. Maintaining ...