76 to 100 of 279 PySpark Jobs in the UK

London area will be required, with a flexible hybrid approach that supports remote work. Candidates should have hands-on experience with Python, Spark, SQL, PySpark, and PowerBI, and be comfortable working across AWS/Azure/GCP and Snowflake/Data Bricks. SC clearance eligibility is required. #J ...

Engineer Associate (DP-600), Power BI Data Analyst Associate (PL-300), or Azure Data Fundamentals (DP-900). Proficiency in Python and SQL, including PySpark and Spark SQL, used across our Microsoft Fabric data platform. Experience with ERP/finance systems data (NetSuite, SAP, Dynamics, etc.) Experience picking ...

years of experience in data engineering, including 3+ years in a tech lead capacityStrong hands-on expertise in Databricks for enterprise-scale workloadsProficiency in PySpark, Spark Structured Streaming, and Delta LakeSolid programming skills in Python and demonstrated SQL performance optimization experienceDeep understanding of Azure Data Platform services and cloud ...

compliance, controls, remediation, or automation programs (preferably in financial services). Strong proficiency in Python for data engineering and automation. Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases. Experience designing ...

Databricks Serverless configuration and workload optimisation* Databricks SQL and Delta Lake development* Cluster management, compute policies, autoscaling, and workload monitoring**Data Engineering*** Strong Python, PySpark, and SQL development skills* Design and build ingestion and transformation pipelines* Full and incremental data loading* CDC (Change Data Capture) implementation* Data quality controls ...

Databricks Serverless configuration and workload optimisation* Databricks SQL and Delta Lake development* Cluster management, compute policies, autoscaling, and workload monitoring**Data Engineering*** Strong Python, PySpark, and SQL development skills* Design and build ingestion and transformation pipelines* Full and incremental data loading* CDC (Change Data Capture) implementation* Data quality controls ...

security, and governance to support AI agent-driven data products. The ideal candidate has deep SQL skills (SQL Server/Azure SQL), strong Python (PySpark), and experience with Databricks, Synapse or Fabric, plus Power BI semantic modelling. A background in data security and Agile delivery is preferred. #J ...

agents that underpin our data-driven decisions. The role requires deep SQL/T-SQL on SQL Server/Azure SQL, strong Python (PySpark) capabilities, and experience with Databricks, Synapse or Microsoft Fabric, plus Power BI semantic modelling. #J-18808-Ljbffr ...

Data Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

skills and ensure high-quality deliverables. Data Engineering: Strong proficiency in Python and at least one key programming language commonly used in data engineering (PySpark/SQL strongly preferred, Java/Scala beneficial). Data Modelling: Solid understanding and practical experience in designing and implementing effective data models (e.g. ...

knowledge of Matillion’s Data Productivity Cloud/Matillion ETL, or primary competitive data integration platforms. Big Data & Analytics Ecosystems: Experience with Spark/PySpark, modern Data Lakes/Lakehouses, and MPP database architectures (Teradata, Vertica, Netezza). Education: Bachelor’s or Master’s degree in Computer Science, Data ...

Experience designing data architectures that scale, and a good handle on integration patterns like ETL/ELT and batch or streaming. Desirable Technical Skills PySpark or a similar distributed data processing framework. CI/CD pipelines, observability tooling (logging, alerting, monitoring), and infrastructure‐as‐code. Experience working with cloud ...

responsibilities. Ensure solutions are secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines … duties as required. Skills and Experience Strong understanding of data engineering principles, data architecture, and cloud-based data platforms. Proficient in Python (PySpark) and SQL for building and optimising data transformations at scale. Strong hands-on Databricks experience. Experience with Azure data storage technologies (Azure SQL, Data Lakes, Blob ...

grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build … ongoing evolution of Envitia’s data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ ...

standards and documentation What we’re looking for 3–5 years of data engineering experience Strong Python & SQL skills Experience with Apache Spark/PySpark Ability to monitor, troubleshoot, and resolve pipeline failures Familiarity with lakehouse concepts Experience with Git, Databricks, streaming/CDC, AWS, Great Expectations Nice ...

Implement automated testing, CI/CD patterns + deployment best practices for Foundry-based data assets. Technical Environment: Data Engineering, Palantir Foundry, Python, SQL, PySpark, Spark SQL + Cloud (AWS, Azure, GCP), CI/CD, Git based workflows. Benefits: £75,000 - £80,000 (DOE) + Remote/Hybrid Working ...

years of relevant in data governance, compliance, or automation programs. Strong proficiency in Python for data engineering and automation. Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing ...

/reporting outputs such as Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Experience with tools such as PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Hands-on exposure to DCRM tooling and operational exception management processes. Experience with governance/ ...

ingest, cleanse and model data for BI reporting, ML and AI, ensuring quality and governance. The role emphasizes strong Azure skills (ADF, ADLS, Databricks), PySpark, Python and SQL, with a DevOps and CI/CD mindset. Hybrid work with three days in the office weekly is offered. #J ...

pipeline development, data modelling, semantic layers and Power BI delivery. This role focuses on building a modern data platform using Azure Databricks, Python, PySpark and SQL, tying together marketing, sales and operations data to drive commercial performance. #J-18808-Ljbffr ...

services, and scripting and automation using common libraries and frameworks relevant to the role Experience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration tools Experience with relational databases and SQL; familiarity with NoSQL databases and data modeling concepts Knowledge across the data lifecycle ...

APIs and services, and scripting and automation using common libraries and frameworks relevant to the roleExperience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration toolsExperience with relational databases and SQL; familiarity with NoSQL databases and data modeling conceptsKnowledge across the data lifecycle including ...

that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don't meet every requirement below, feel free to still apply ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don't meet every requirement below, feel free to still apply ...