1 to 25 of 28 Contract PySpark Jobs in the UK

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. * Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. * Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure ...

experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks . Good proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory ...

automation for data workflows. Required Skills & Experience Active SC Clearance (mandatory). Strong hands on experience with Azure Databricks and Spark. Proficiency in PySpark, SQL, and Python (Scala desirable). Experience with Azure services: Data Lake, Synapse, Key Vault. Proven track record in ETL pipeline development and data migration. ...

forward. The Role Lead the migration of existing data pipelines and workloads into Microsoft Fabric. Build and optimise ETL pipelines using Python, SQL, and PySpark within the Fabric environment. Work across OneLake, Data Factory, and Power BI to ensure seamless integration and end-to-end functionality. Redesign data models ...

Responsibilities Design, develop, and optimize end-to-end data pipelines using Azure services Build and maintain scalable ETL/ELT workflows using Azure Databricks (PySpark/SQL) Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics Ingest data from multiple sources (APIs, databases, files, streaming sources … pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling ...

Responsibilities Design, develop, and optimize end-to-end data pipelines using Azure services Build and maintain scalable ETL/ELT workflows using Azure Databricks (PySpark/SQL) Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics Ingest data from multiple sources (APIs, databases, files, streaming sources … pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling ...

services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services … standards and best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

governance , schema validation, and master data management. Strong grasp of real-time vs batch processing trade-offs . Beneficial Experience CockroachDB deployment and management. PySpark or similar for large-scale processing. SAP data structures and PIM systems. E-commerce and B2B data integration patterns. Why Apply? Fully remote contract ...

governance , schema validation, and master data management. Strong grasp of real-time vs batch processing trade-offs . Beneficial Experience CockroachDB deployment and management. PySpark or similar for large-scale processing. SAP data structures and PIM systems. E-commerce and B2B data integration patterns. Why Apply? Fully remote contract ...

Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Worki click apply for full job details ...

Dependent on experience. Required experience will include: Strong Python Programming skills. Strong design and development skills using Python. Python's libraries for machine learning: PySpark, Pytorch, scikit-learn and pandas. Technical experience using Databricks and MLFlow (Other Platforms can be considered). Good understanding of software code review standards ...

Dependent on experience. Required experience will include: Strong Python Programming skills. Strong design and development skills using Python. Python's libraries for machine learning: PySpark, Pytorch, scikit-learn and pandas. Technical experience using Databricks and MLFlow (Other Platforms can be considered). Good understanding of software code review standards ...

engineers and influence data architecture across high-consequence programmes Build and optimise ontologies, pipelines, and semantic models Apply strong data engineering skills (Python, SQL, PySpark) Bring cloud expertise (AWS, Azure, or GCP) and proven team leadership If you have Palantir Foundry experience and want to take ownership of delivery ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines click apply for full job details ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven ...

/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven ...

Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric Spark jobs Java programming language, OOP knowledge Database knowledge, including Relational Database ...

Strong communication skills with a collaborative mindset to work with and manage stakeholders Experience of programming under Microsoft Fabric Platform Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric Spark jobs Java programming language, OOP knowledge Database knowledge, including Relational Database ...

experienced in building high-quality data pipelines and optimizing large-scale workloads on the Databricks Data Intelligence Platform. The ideal candidate is strong in PySpark, Delta Lake, Azure services, workflow automation, and performance tuning. Key Responsibilities Build and maintain scalable batch and streaming pipelines using Databricks notebooks, Jobs … ensure workloads are cost-efficient and reliable. Apply data quality, lineage, and access controls using Unity Catalog and governance best practices. Develop reusable PySpark ETL and data transformation code. Manage Delta Lake tables with ACID transactions, schema evolution, and time-travel capabilities. Integrate Databricks with Azure ADLS, Key Vault ...

Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format … Ideal Candidate Profile 310+ years of experience in AWS Data Engineering/Support Engineering. Strong telecom domain understanding. Hands-on with Iceberg, Athena, Glue (PySpark), Python, Redshift, S3, ETL frameworks. Strong troubleshooting mindset and ability to work in 247 or rotational support environments (if required). ...

Cleared Python Data Engineer Azure & PySpark Contract | £400£458 per day (Inside IR35) SC Clearance is essential We are looking for an experienced Data Engineer with strong Python skills to join a delivery-focused team working on complex data platforms in Azure. Although this is a data engineering role … work involves developing and maintaining complex, test-driven data flows. You will be responsible for building scalable data pipelines using Python and PySpark, optimizing Delta Lake storage, and deploying solutions in a containerised Azure environment. Quality, maintainability, and automated testing are key to this role. What youll be doing ...