25 of 25 PySpark Jobs in the South East

transformation and orchestration pipelines, integrating data from cloud, on-premises and third-party business systems. Strong hands-on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

Senior Data Engineer (Azure | Databricks | Fabric | PySpark | SQL) Permanent | Hybrid | UK Public Sector Project Overview We are seeking a hands-on Senior Data Engineer to join a growing Data & Analytics practice. This role focuses on designing, building, optimising, and maintaining enterprise-level data solutions. You will work across ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

quality practices - Promote and champion the exceptional work being accomplished. Essential Skills & Experience: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

control and documentationAct as a technical leader and mentor, raising standards across the data engineering communityWhat you’ll bringEssentialDeep expertise in Databricks (Spark/PySpark, Delta Lake, Unity Catalog, Workflows)Strong experience building ETL/ELT pipelines, both batch and streamingAdvanced Python and SQL skillsHands-on experience with cloud ...

Analytics capabilities. What you'll do Data Engineering Delivery: Design, build andoptimisescalable data pipelines, ETL/ELT workflows and data transformation solutions using Databricks,PySpark, SQL anddbtCloud, delivering trusted, high-quality data products that support reporting, analytics, AI and data science. Data Architecture & Modelling: Develop and maintain robustlakehousearchitectures ...

stakeholders to translate business challenges into analytical solutions. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python and SQL skills, with strong PySpark experience Hands-on expertise with Microsoft Fabric and Databricks. Experience building production-grade data pipelines, reusable data assets and machine learning solutions. Experience communicating ...

arePrevious experience assessing and improving data quality using SQL and/or Python. Ability to develop scalable data pipelines using technologies such as Spark, PySpark, Hive, and BigQuery. Vast experience working with large and complex codebases, using tools such as GitHub, GitLab, Gitflow, EnvFlow, or Fork/Pull workflows. ...

agents that underpin our data-driven decisions. The role requires deep SQL/T-SQL on SQL Server/Azure SQL, strong Python (PySpark) capabilities, and experience with Databricks, Synapse or Microsoft Fabric, plus Power BI semantic modelling. #J-18808-Ljbffr ...

grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build … ongoing evolution of Envitia’s data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ ...

Experience Strong experience across both Data Science and Data Engineering Hands-on expertise with Microsoft Fabric and Databricks Advanced Python and SQL skills, with PySpark desirable Experience building data pipelines and machine learning models Knowledge of NLP, entity resolution, or document processing is advantageous Strong communication skills and commercial ...

ability to work independently, challenge assumptions constructively and influence decision-making through evidence It would be beneficial if you also have: Experience with Databricks, PySpark, Azure or similar cloud-based data environments Experience within operational, retail, logistics or customer-focused businesses Exposure to AI solutions or emerging machine learning ...

Terraform or BicepCI/CD – GitHub Actions and/or Azure DevOpsDatabricks workspace administration, Unity Catalog & governanceMonitoring & observability – Azure Monitor, Log Analytics & KQLPython/PySpark and scalable data pipelinesSecurity, access management, automation and platform operationsWe’re particularly interested in engineers with experience across the broader data platform, rather than ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a ...

GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software Proficient at communicating results ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

learning techniques within a general insurance pricing environment. Pricing Technology & Data Platforms: Proficiency in pricing and data tools such as WTW Radar, Databricks, Python, PySpark, SQL or similar platforms. Leadership & People Management: Proven ability to lead technical delivery through others, balancing hands‐on review with effective delegation, coaching … investigation. You’ll promote continuous improvement across technical pricing processes, tools, reporting and ways of working, including the appropriate use of Databricks, Python/PySpark, Radar and other relevant platforms. You’ll comply with the requirements, and act in accordance with the Group Code of Conduct and Fitness ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

Ceox in the United Kingdom is seeking a hands-on Senior Data Engineer to join a growing Data & Analytics practice. You will design, build, optimise and maintain enterprise-scale data solutions across the full data ...