251 to 275 of 327 PySpark Jobs in the UK

high-performing engineering squad, owning technical challenges and driving best practices across the team. You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions. #J-18808-Ljbffr ...

Northampton, UK. This hybrid role involves working 2 days a week in the office. The ideal candidate will have expertise in Bigdata technologies, including PySpark and AWS services, as well as strong communication and problem-solving skills. You will be expected to collaborate effectively within a diverse team while ...

scale a global organization through resourcing/location strategy. Qualifications Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing teams ...

location strategy."I am the person Capital Group is looking for." Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise in Snowflake and hands‐on experience with Python, PySpark, AWS, and Airflow for building scalable, high-performance data platforms. The role demands strong technical leadership, problem‐solving capabilities, and the ability to collaborate effectively … transformationsto support large‐scale data processing Build and optimize enterprise data warehouse solutions on Snowflake. Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow. Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake. Implement scalable cloud‐based data solutions leveraging ...

high-performing engineering team. The role is both hands-on and leadership-focused, with Databricks at the centre of the technology stack alongside Python, PySpark and SQL. You will take ownership of the Databricks platform and architecture while working closely with senior stakeholders across Risk, Quantitative Finance, Compliance … 3+ years' hands-on experience delivering large-scale Databricks implementations within financial services. Strong experience within Insurance, Banking, Asset Management or FinTech. Advanced Python, PySpark and SQL skills. Deep knowledge of Databricks Lakehouse architecture and Delta Lake. Experience with at least one major cloud platform: AWS, Azure or GCP. ...

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

Senior Data Engineer (Data and AI Operations) “It feels good to have a career with real purpose.” Job Description Senior Data Engineer (Data and AI Operations) Hours Per Week: 35 Contract Type: Full Time Contract ...

Senior Data Engineer - Databricks - Pyspark - Dimensional Models - Unity Catalog - Kimball - Perm We're looking for a Senior Analytics Engineer to lead the design and delivery of curated, analytics-ready data within our Lakehouse environment. You'll translate complex business requirements into robust SQL and PySpark pipelines … deliver dimensional and semantic data models for analytics. Define and maintain KPIs, conformed dimensions and consistent data definitions. Develop and optimise SQL and PySpark pipelines using Databricks. Ensure high standards of data quality, testing, performance and observability. Lead modelling reviews and contribute to technical and architectural decisions. Work closely ...

with analytics colleagues to turn insights into actionable production workflows. Candidates should be strong in Python, ML techniques, and data visualization, with experience in PySpark and SQL. Location is Glasgow (Edinburgh considered) and the role is onsite 2-3 days per week for a #J-18808-Ljbffr ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

onsite capacity in Sheffield. You will focus on robust data pipelines and back-end data plumbing. You will work with Databricks and PySpark to ingest, transform and structure raw data into high-quality Delta tables for enterprise use, delivering scalable data infrastructure to support business decisions. Candidates must ...

Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC. You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join ...

Engineer to build and scale modern data platforms, focusing on robust data pipelines and Back End data plumbing. You'll work with Databricks and PySpark to ingest, transform, and structure raw data into high-quality Delta tables for enterprise use. We endeavour to process your personal data ...

existing pipelines. Working within a growing data team, you'll design scalable data models, build robust ELT pipelines in Databricks using SQL, Python and PySpark, and integrate data from multiple internal and third-party systems. You'll collaborate closely with Analytics Engineers to ensure data is reliable, well-governed … architecture and help define long-term data standards, rather than simply delivering against predefined requirements. You’ll need experience with: Databricks, SQL, Python and PySpark Building and optimising ELT/data pipelines Data modelling, lakehouse architecture and modern data platforms Azure data services API and third-party system integration ...

At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

engineering, or a related field Experience analysing gambling marketing activities The ability to write clear, well-structured code Hands‐on experience with Python, SQL, PySpark, or similar tools A flair for problem‐solving and storytelling with data — and the confidence to present findings to clients Sound like ...

facing team in London. You will mentor data scientists, oversee complex data products, and ensure analytical excellence. The ideal candidate has strong SQL and PySpark experience, excellent communication skills, and a Bachelor’s degree in a related field. This position offers a collaborative environment, competitive benefits, and a chance ...

Engineer role. They aren't looking for someone who wants to move away from development into pure management. You'll work across: Python/PySpark Microsoft Fabric Spark and notebook engineering Lakehouse/Medallion architecture Delta SQL Azure Git/CI/CD Automated testing Data quality and observability … Reusable engineering patterns They're particularly interested in people coming from Databricks/PySpark environments, so extensive Fabric experience isn't essential. At Senior level, you'll also have the opportunity to influence architecture, technical design, coding standards, CI/CD, testing and engineering best practice, while supporting other ...

Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform. Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Mentor and guide junior data engineers, promoting best practices in code quality, CI/CD, and performance tuning. Collaborate with … Requirements & Skills Databricks Expertise: Extensive hands-on experience with Databricks, Delta Lake, Unity Catalog, and Spark optimization. Programming Languages: Advanced proficiency in Python/PySpark and SQL. Cloud & Infrastructure: Strong background in cloud data platforms (Azure, AWS, or GCP) and cloud-native architectures. Engineering Best Practices: Experience with ...

data exploration skills Experience of working in Agile methodology Good knowledge and hands-on experience of developing Stored Procedures Experience of working with PySpark Notebooks for data ingestion and provision Practical experience of improving data quality and efficiency in data pipelines Solid understanding of DevOps and CI/… Understanding of compliance and lifecycle of data management Desirable Skills: Coding experience in any relevant language (Python, Pyspark etc.) Experience working with other Azure technologies such as Fabric, Power Automate Experience of working with non-relational databases (CosmosDB, MongoDB, etc.) and handling unstructured data in ETL pipelines Our values ...

maintainable solutions. What you'll be doing: Take ownership of designing, building, and maintaining scalable, production-ready data pipelines using Microsoft Fabric, Python, and PySpark, with minimal supervision Make sound technical decisions on pipeline architecture, data modelling, and tooling, weighing up trade-offs in performance, cost, and maintainability Mentor … domain-driven modelling) - this is the load‐bearing, provider‐agnostic skill underneath almost all of our pipeline work Have strong proficiency in Python and PySpark for batch data processing, with a track record of writing production‐grade, well‐tested code (this role is focused on batch/ELT pipeline ...