26 to 50 of 101 PySpark Jobs in the UK

Analysis Services) Microsoft Fabric & Power BI On-prem equivalents (SSIS, SSAS, SSRS) welcome Highly proficient in T-SQL; experience with M, DAX, Python or PySpark beneficial Demonstrable background in client-facing consultancy roles Excellent communication skills and the ability to lead technical and business discussions SC Clearance ...

demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational ...

Designing and building cloud based data and machine learning pipelines that prepare data for analytics, AI, and product use ·Writing clear, well-structured Python, PySpark, and SQL to transform and validate data from multiple upstream sources ·Taking ownership of data quality, consistency, and reliability across the pipeline lifecycle ·Shaping ...

with various databases e.g. MS SQL, Azure Cosmos DB. Skilled at optimizing large and more complicated SQL statements. Proficiency in Python and experience with PySpark Experience of REST API standards. Proficiency in writing clean, readable, and secure code for Azure backend services, i.e. functions, utility functions etc. Experience ...

reviews via Tabular Editor. Excellent design intuition-clean layouts, drill paths, and KPI logic. Nice to Have Python for automation or ad-hoc prep; PySpark familiarity. Understanding of Lakehouse patterns, Delta Lake, metadata-driven pipelines. Unity Catalog/Purview experience for lineage and governance. RLS/OLS implementation experience. ...

reviews via Tabular Editor. Excellent design intuition-clean layouts, drill paths, and KPI logic. Nice to Have Python for automation or ad-hoc prep; PySpark familiarity. Understanding of Lakehouse patterns, Delta Lake, metadata-driven pipelines. Unity Catalog/Purview experience for lineage and governance. RLS/OLS implementation experience. ...

enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power BI, and managing relational data with SQL. Collaboration ...

office each week. The Role Key responsibilities: Design, build and maintain data pipelines using Azure Data Factory and Azure Databricks Develop and optimise PySpark and SQL transformations Model data using dimensional modelling principles Support ingestion of data from various data sources and formats Collaborate with BI developers, analysts ...

optimize Lakehouse architectures using Delta Lake principles Ingest, transform, and curate data from multiple sources (APIs, databases, files, streaming) Develop scalable data transformations using PySpark and Spark SQL Implement data models optimized for analytics and reporting (e.g. star schemas) Monitor, troubleshoot, and optimize performance and cost of data workloads … practices Required Skills & Experience Strong experience with Microsoft Fabric (Lakehouse, Pipelines, Notebooks, Dataflows, OneLake) Hands-on experience with Databricks in production environments Proficiency in PySpark and SQL Solid understanding of data engineering concepts (ETL/ELT, orchestration, partitioning) Experience working with Delta Lake Familiarity with cloud platforms (Azure preferred ...

Required Medical industry experience (essential) Strong knowledge of Azure Databricks, Palantir Foundry, and Azure DevOps Proficiency in Terraform, Git, and automation tools Experience with PySpark, Python, and SQL Familiarity with PowerBI, Azure Functions, and data streaming Understanding of cloud infrastructure and public cloud operations Excellent problem-solving and analytical ...

5+ years of data engineering experience Strong Python and SQL skills —essential for pipeline development and data transformation. Experience with Databricks/Snowflake, and PySpark ideally A track record of taking ownership —whether it’s revamping a data warehouse, improving a data lake, or delivering visible business impact. ...

understanding of relational databases and data warehouse concepts (dimensions, facts, star schemas) and associated technologies (e.g., Databricks). Experience with Python (including Pandas/PySpark). Familiarity with software development and source control, in particular Git and CI/CD practices. Excellent communication and stakeholder management skills — able ...

understanding of relational databases and data warehouse concepts (dimensions, facts, star schemas) and associated technologies (e.g., Databricks). Experience with Python (including Pandas/PySpark). Familiarity with software development and source control, in particular Git and CI/CD practices. Excellent communication and stakeholder management skills — able ...

understanding of relational databases and data warehouse concepts (dimensions, facts, star schemas) and associated technologies (e.g., Databricks). Experience with Python (including Pandas/PySpark). Familiarity with software development and source control, in particular Git and CI/CD practices. Excellent communication and stakeholder management skills — able ...

Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or scripting languages (Python, PySpark, SQL). Understanding of data warehousing and data modelling techniques (Star Schema, Snowflake Schema). Familiarity with security frameworks (GDPR, HIPAA, ISO 27001, NIST ...

/Data Engineering role Large and complex datasets Azure, Azure Databricks Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory Desirable: Exposure ML/Machine Learning/AI/Artificial Intelligence ...

fast-paced startup environment Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest in B2B SaaS, data platforms, or AI-enabled products What ...

organisation ahead of the curve. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Hands-on experience with Databricks and PySpark/Spark SQL. Strong expertise with the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture and performance optimisation. What ...

data pipelines and ETL processes. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Strong hands-on expertise with Databricks and PySpark/Spark SQL. Deep knowledge of the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture principles and performance optimisation. ...

Salary range: £75,000-£85,000 + 10% bonus + benefits Purpose: Build and maintain large, scalable Data Lakes, processes and pipelines Tech: Python, PySpark, AWS, Iceberg/Kafka, Spark/Glue, CI/CD Industry: Financial services/securities trading Immersum continue to support a leading SaaS securities ...

reservations, Event Hub TUs, serverless compute clusters, and Terraform deployments Required Skills * Azure Databricks* Git/GitHub* DevOps & Cloud Operations* Azure Functions* Data Streaming* PySpark, Python, SQL* Automation & Public Cloud* Cloud Infrastructure* Terraform* Palantir Foundry* PowerBI* Software Lifecycle Management If you meet the requirements please send me a copy ...

experience 2+ years hands-on Microsoft Fabric (Data Factory pipelines, Lakehouse) or Azure Synapse Proven experience extracting and consolidating master data from multiple ERPs PySpark and/or T-SQL Understanding of Delta Lake, medallion architecture and lakehouse patterns Understanding of data quality, data governance, and best practices Ability ...