13 of 13 Permanent PySpark Jobs in Central London

influencing skills. Ability to think creatively and propose innovative solutions. To qualify for this role, you must have: Proven experience and knowledge with PySpark and Apache Spark including the fundamentals of how it works. Core experience with AWS, with substantial and mature Azure platform offering. Experience with other cloud ...

Analytics capabilities. What you'll do Data Engineering Delivery: Design, build andoptimisescalable data pipelines, ETL/ELT workflows and data transformation solutions using Databricks,PySpark, SQL anddbtCloud, delivering trusted, high-quality data products that support reporting, analytics, AI and data science. Data Architecture & Modelling: Develop and maintain robustlakehousearchitectures ...

Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL Confident communicator who is able to explain technical terms to non‐technical audiences and mentor junior colleagues Leads ...

truth. You will design homogeneous data repositories and oversee pipelines, working within a hybrid office setup at One New Change, London. You will apply PySpark, Python, SQL, and Kimball modelling to support BI, ML, and analytics while following DevOps practices and data governance standards. Strong collaboration and communication ...

engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache Airflow … transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform ...

seeking a skilled data engineer to enhance data processing frameworks and support Azure Databricks solutions. The ideal candidate will have extensive experience with PySpark, AWS, and strong programming skills in Python and SQL. Responsibilities include collaborating with architecture teams and delivering high-quality solutions while managing stakeholder expectations. This ...

data platform while delivering scalable, secure, and high-quality data solutions. What You'll Do Design, develop, and optimise Azure Databricks solutions using PySpark, Python, SQL, and Azure-native technologies. Build and maintain enterprise-grade ETL/ELT pipelines supporting ingestion, transformation, CDC, validation, and data delivery across multiple … that support organisational growth and strategic decision-making. What You'll Bring Proven experience designing and delivering solutions within Azure Databricks environments. Strong Python, PySpark, SQL, and T-SQL development skills. Expertise building and supporting large-scale ETL/ELT pipelines and cloud-based data platforms. Strong understanding ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands‐on experience with Databricks, PySpark, Python and SQL? The role 7Dxperts is looking for a Senior Data Engineer to join our UK team. Key Responsibilities Build scalable pipelines using Databricks, Spark … processes and create reusable engineering solutions. Support and mentor junior Data Engineers. Requirements/Qualifications 5+ years’ Data Engineering experience. Strong hands‐on Databricks, PySpark, Python and SQL skills. Experience building and optimising ETL/ELT data pipelines. Knowledge of Delta Lake and data warehousing. Experience with at least ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software Proficient at communicating results ...

7Dxperts in the UK is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Databricks, PySpark, Python and SQL, gaining hands-on experience with Delta Lake and lakehouse architectures. You will build ETL/ELT workflows, monitor performance, mentor juniors and contribute to cloud data ...

deployment Productionise models developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready code Develop scalable ML solutions using Python, PySpark, Databricks and MLflow Deploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelines Manage model versioning, promotion … commercial experience as an ML Engineer, with a clear focus on engineering and productionising machine learning models Strong hands-on development skills across Python, PySpark and SQL Commercial experience working with Databricks, MLflow and Delta Lake Proven experience building and operating distributed data and machine learning pipelines Experience taking ...