76 to 100 of 120 PySpark Jobs in the UK excluding London

Senior Data Engineer

Hiring Organisation
TCM Partners
Location
Manchester Area, United Kingdom
services to deliver robust cloud solutions Coaching and supporting Data Engineers and Associate Engineers Experience Required Strong hands-on experience with Azure, Databricks and PySpark, Deep Azure data engineering expertise (ADF, Databricks, ADLS Gen2, Synapse, Azure SQL, Functions, Key Vault) Experience delivering end-to-end data solutions in cloud ...

Senior Data Engineer

Hiring Organisation
Mastek
Location
Slough, Berkshire, UK
Employment Type
Full-time
performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data ...

Azure Data Engineer - £250PD Outside IR35 - Remote

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£200 - £250 per day
Responsibilities Design, develop, and optimize end-to-end data pipelines using Azure services Build and maintain scalable ETL/ELT workflows using Azure Databricks (PySpark/SQL) Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics Ingest data from multiple sources (APIs, databases, files, streaming sources … pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling ...

Azure Data Engineer - £500 - Hybrid

Hiring Organisation
Tenth Revolution Group
Location
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Employment Type
Contract
Contract Rate
£450 - £550/day
services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services … standards and best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

Python Data Engineer

Hiring Organisation
Hays Specialist Recruitment Limited
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£450 - £475 per day
Active Security Clearance (SC) Strong Python skills with modular, test-driven design Experience with Behave for unit and BDD testing (mocking, patching) Proficiency in PySpark and distributed Data processing Solid understanding of Delta Lake (design and maintenance) Hands-on with Docker for development and deployment Familiarity with Azure services ...

Data Engineer

Hiring Organisation
Hexegic
Location
Slough, Berkshire, UK
Employment Type
Full-time
outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Data Engineer - SC Cleared. Stevenage/Hybrid £80k

Hiring Organisation
Akkodis
Location
Stevenage, Hertfordshire, United Kingdom
Employment Type
Permanent
Salary
£70000 - £80000/annum
databases and AWS cloud environments. Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Solid understanding of data warehousing and modelling techniques (Star Schema, Snowflake Schema). Familiarity with security frameworks such as GDPR, HIPAA ...

AWS Data Engineer

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£300 - £350 per day
governance , schema validation, and master data management. Strong grasp of real-time vs batch processing trade-offs . Beneficial Experience CockroachDB deployment and management. PySpark or similar for large-scale processing. SAP data structures and PIM systems. E-commerce and B2B data integration patterns. Why Apply? Fully remote contract ...

Senior Data Engineer | Commodities & Energy Trading | Greenfield Next-Gen Lakehouse | Up to £110K + Bonus + Benefits

Hiring Organisation
VirtueTech Recruitment Group
Location
Slough, Berkshire, UK
Employment Type
Full-time
this Senior Data Engineering role, you'll design, develop, and maintain data platforms using technologies such as Snowflake, Databricks, Synapse/Fabric, and PySpark, ensuring the scalability, security, and performance of all data systems. As the Senior Data Engineer your role will be to include establishing and championing best ...

Lead Data Engineer

Hiring Organisation
Big Red Recruitment Midlands Limited
Location
Atherstone, Whittington, Warwickshire, United Kingdom
Employment Type
Permanent
Salary
£60000 - £80000/annum £60 000 - £80 000
Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team in Databricks best practices, including modern architecture patterns Location: Atherstone (Hybrid – 3 days ...

Data Migration Engineer

Hiring Organisation
Kinetech Recruitment
Location
Milton Keynes, Buckinghamshire, South East, United Kingdom
Employment Type
Permanent, Work From Home
ground running Comfortable operating in high-pressure, delivery-focused environments Able to explain how you moved data, not just which tools you used Python (PySpark/Pandas/NumPy) and SQL using practically for data transformation Desirable Experience migrating data into Dynamics (or similar ERP platforms) Experience working with ...

Data Engineering Consultant

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£65,000 - £75,000 per annum
complex operational challenges. You'll design and implement scalable generative AI workflows, often using technologies like Palantir AIP, while building robust data pipelines with PySpark, Python, and SQL. A key responsibility is executing sophisticated data integrations across distributed systems and enterprise environments, including ERPs and CRMs. You'll collaborate ...

Data Scientist - Contract - 12 months

Hiring Organisation
Randstad Technologies
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£500 - £700 per day
Dependent on experience. Required experience will include: Strong Python Programming skills. Strong design and development skills using Python. Python's libraries for machine learning: PySpark, Pytorch, scikit-learn and pandas. Technical experience using Databricks and MLFlow (Other Platforms can be considered). Good understanding of software code review standards ...

Machine Learning Engineer

Hiring Organisation
DXC Technology
Location
Bishopton, Renfrewshire, Scotland, United Kingdom
Employment Type
Permanent
TensorFlow Serving, TorchServe, ONNX, and TensorRT. Build and manage ML pipelines using MLflow, Kubeflow, and Azure ML Pipelines. Work with large-scale data using PySpark and integrate models into production environments. Monitor model performance and retrain as needed to ensure accuracy and efficiency. Collaborate with cross-functional teams ...

Lead Analytics Engineer

Hiring Organisation
Datatech Analytics
Location
South West London, London, United Kingdom
Employment Type
Permanent
quality and structure of data Translate business needs into clear technical plans Experience required: Strong skills in data modelling SQL with either Python or PySpark Databricks or similar cloud data platform Experience communicating with both technical and non-technical users Leadership or mentoring experience Insurance or regulated sector experience ...

Cloud Data Engineer

Hiring Organisation
Accenture
Location
Leeds, West Yorkshire, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

Palantir Data Technical Lead / Practice Lead

Hiring Organisation
Opus Recruitment Solutions Ltd
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£600 - £700 per day
engineers and influence data architecture across high-consequence programmes Build and optimise ontologies, pipelines, and semantic models Apply strong data engineering skills (Python, SQL, PySpark) Bring cloud expertise (AWS, Azure, or GCP) and proven team leadership If you have Palantir Foundry experience and want to take ownership of delivery ...

Data Engineer

Hiring Organisation
Hyperloop Recruitment
Location
Liverpool, Merseyside, United Kingdom
Employment Type
Permanent
Salary
GBP 55,000 Annual
development and optimisation of scalable data and pipelines in a cloud-based environment, building and managing ETL processes using tools such as Azure, Databricks, PySpark and SQL click apply for full job details ...

Data engineer

Hiring Organisation
Sanderson
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£500 - £525 per day, Negotiable, Inc benefits
/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven ...

Data Engineer

Hiring Organisation
Head Resourcing
Location
Glasgow, City of Glasgow, United Kingdom
Employment Type
Permanent
Salary
£45000 - £55000/annum
Sales, Customer Care and Logistics. What You'll Do Lakehouse Engineering (Azure + Databricks) Build and maintain scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark and Spark SQL. Work within a Medallion architecture (Bronze ? Silver ? Gold) to deliver reliable, high-quality datasets. Ingest data from multiple sources including ChargeBee … Databricks: Lakeflow Declarative Pipelines, Lakeflow Workflows, Unity Catalog, Delta Lake Azure: ADLS Gen2, Data Factory, Event Hubs (optional), Key Vault, private endpoints Languages: PySpark, Spark SQL, Python, Git DevOps: Azure DevOps Repos & Pipelines, CI/CD Analytics: Power BI, Fabric What We're Looking For Experience Commercial and proven ...

Data Engineer

Hiring Organisation
Head Resourcing
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Full-Time
Salary
£45,000 - £55,000 per annum
Sales, Customer Care and Logistics. What You'll Do Lakehouse Engineering (Azure + Databricks) Build and maintain scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark and Spark SQL. Work within a Medallion architecture (Bronze Silver Gold) to deliver reliable, high-quality datasets. Ingest data from multiple sources including ChargeBee … Databricks: Lakeflow Declarative Pipelines, Lakeflow Workflows, Unity Catalog, Delta Lake Azure: ADLS Gen2, Data Factory, Event Hubs (optional), Key Vault, private endpoints Languages: PySpark, Spark SQL, Python, Git DevOps: Azure DevOps Repos & Pipelines, CI/CD Analytics: Power BI, Fabric What We're Looking For Experience Commercial and proven ...

Azure Databricks Data Engineer

Hiring Organisation
ValueMomentum
Location
Slough, Berkshire, UK
Employment Type
Full-time
Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer … ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet them. • Develop mapping documents and transformation ...

Managing Principal Consultant

Hiring Organisation
Coeo
Location
Slough, Berkshire, UK
Employment Type
Full-time
able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. Designing and implementing Lakehouse architectures in Databricks to unify … Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark for advanced data engineering, machine learning, and large-scale distributed processing within Databricks. Hands-on experience with Spark optimizations (Adaptive Query Execution, caching, partitioning ...

Managing Principal Consultant

Hiring Organisation
Coeo
Location
Reading, England, United Kingdom
able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. Designing and implementing Lakehouse architectures in Databricks to unify … Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark for advanced data engineering, machine learning, and large-scale distributed processing within Databricks. Hands-on experience with Spark optimizations (Adaptive Query Execution, caching, partitioning ...

Senior Database Engineer

Hiring Organisation
Conferma Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
Salary
£70,000
. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...