for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands … on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). Familiarity with machine learning (ML) development and tools such as MLflow or equivalent. More ❯
for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands … on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). Familiarity with machine learning (ML) development and tools such as MLflow or equivalent. More ❯
architectures supporting analytics and digital initiatives Develop and maintain logical and physical data models to support business needs. Define and govern data architecture standards across Azure Data Factory and Databricks Oversee data integration frameworks and manage the Information Management architecture Shape strategic data roadmaps aligned with the company’s long-term goals Review and ensure consistency of high-level designs … Strong hands-on experience in data modelling, with tools such as Erwin Strong background in London Market/Specialty Insurance data domains – essential Proficient in Azure Data Factory and Databricks, including pipeline design and orchestration Solid understanding of data warehousing, ETL/ELT pipelines, and integration practices Knowledge of SDLC methodologies (Agile, DevOps, etc.) Confident communicator with the ability to … engage technical and business stakeholders Relevant certifications in Azure, Databricks, or Data Architecture a strong plus Must live within daily access of Central London for 2/3 hybrid days Must be available within 6 weeks More ❯
architectures supporting analytics and digital initiatives Develop and maintain logical and physical data models to support business needs. Define and govern data architecture standards across Azure Data Factory and Databricks Oversee data integration frameworks and manage the Information Management architecture Shape strategic data roadmaps aligned with the company’s long-term goals Review and ensure consistency of high-level designs … Strong hands-on experience in data modelling, with tools such as Erwin Strong background in London Market/Specialty Insurance data domains – essential Proficient in Azure Data Factory and Databricks, including pipeline design and orchestration Solid understanding of data warehousing, ETL/ELT pipelines, and integration practices Knowledge of SDLC methodologies (Agile, DevOps, etc.) Confident communicator with the ability to … engage technical and business stakeholders Relevant certifications in Azure, Databricks, or Data Architecture a strong plus Must live within daily access of Central London for 2/3 hybrid days Must be available within 6 weeks More ❯
data engineering, a thorough understanding of AEP s data architecture, and hands-on experience with Data Distiller. This role also requires proficiency in modern data platforms and technologies including Databricks, GraphQL, Snowflake, and Enterprise Data Warehousing (EDW Key Responsibilities Design, develop, and maintain scalable data pipelines within A e Experience Platform. Write and optimize complex queries using AEP Data Distiller … using batch and streaming ingestion methods. Collaborate with cross-functional teams to ensure data quality, accessibility, and usability. Implement data governance, performance tuning, and monitoring for AEP workflows. Leverage Databricks for advanced data processing and transformation tasks. Utilize GraphQL to query and interact with APIs and data services. Work with Snowflake and EDW systems to support data integration and analytics. … years working directly with A e Experience Platform. Strong proficiency in SQL, with the ability to write and optimize complex queries in AEP Data Distiller. Hands-on experience with Databricks, GraphQL, Snowflake, and Enterprise Data Warehousing. Deep understanding of XDM schemas, datasets, and identity stitching in AEP. Experience with data ingestion, transformation, and activation workflows in AEP. Familiarity with A More ❯
City of London, London, United Kingdom Hybrid/Remote Options
McCabe & Barton
foundation in Data Engineering and experience managing a squad of 47 Data Engineers. Youll bring solid SQL skills, cloud expertise (preferably Azure), and familiarity with tools such as Snowflake, Databricks, ADF, Python, and GenAI. Youll manage a squad of engineers and play a key role in delivering scalable, modern data solutions as part of a group-wide transformation. Requirements: Proven … data architectures and tooling; Financial Services experience is a plus. Experience managing Data Engineering teams Strong SQL and cloud skills (Azure preferred) Familiar with modern data tools (e.g. Snowflake, Databricks, ADF, Python) Track record of building/maintaining robust data pipelines Agile experience Financial Services experience is a bonus If you are an experienced Data Engineering Manager with the required More ❯
Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy, leveraging Azure and Databricks to deliver scalable, high … Enforce strong data governance, quality standards, and security protocols across the data estate. What We’re Looking For Proven leadership in data engineering and analytics , ideally within Azure and Databricks ecosystems . Expertise in ETL orchestration , Azure Data Factory , and medallion architecture . Strong experience with Power BI , DAX , and KPI-driven dashboarding. Ability to translate complex technical concepts into More ❯
Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy, leveraging Azure and Databricks to deliver scalable, high … Enforce strong data governance, quality standards, and security protocols across the data estate. What We’re Looking For Proven leadership in data engineering and analytics , ideally within Azure and Databricks ecosystems . Expertise in ETL orchestration , Azure Data Factory , and medallion architecture . Strong experience with Power BI , DAX , and KPI-driven dashboarding. Ability to translate complex technical concepts into More ❯
a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4-5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE … of rapid growth and increasing data complexity. DATA SOFTWARE ENGINEER - ESSENTIAL SKILLS: Strong foundation in Python and at least one other programming language. Hands-on experience with Spark or Databricks for distributed data processing. Proven experience developing custom components and tools for data pipelines. Deep understanding of data engineering architectures and best practices. Solid experience with cloud-based platforms (AWS … role, you are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | Cloud Architecture | Data Infrastructure | AI | Automation More ❯
a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan … of rapid growth and increasing data complexity. DATA SOFTWARE ENGINEER – ESSENTIAL SKILLS: Strong foundation in Python and at least one other programming language. Hands-on experience with Spark or Databricks for distributed data processing. Proven experience developing custom components and tools for data pipelines. Deep understanding of data engineering architectures and best practices. Solid experience with cloud-based platforms (AWS … role, you are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | Cloud Architecture | Data Infrastructure | AI | Automation More ❯
a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan … of rapid growth and increasing data complexity. DATA SOFTWARE ENGINEER – ESSENTIAL SKILLS: Strong foundation in Python and at least one other programming language. Hands-on experience with Spark or Databricks for distributed data processing. Proven experience developing custom components and tools for data pipelines. Deep understanding of data engineering architectures and best practices. Solid experience with cloud-based platforms (AWS … role, you are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | Cloud Architecture | Data Infrastructure | AI | Automation More ❯
Specialists to build the data foundations that power insight, automation, and innovation across the organisation. Key Responsibilities: Design and maintain scalable data platforms using cloud-native technologies such as Databricks and AWS across development, staging, and production environments Build and govern dimensional data models and semantic layers to power consistent and trusted analytics Integrate data from diverse sources including cloud … SQL, and Delta Live Tables Experience building and maintaining data pipelines across batch and streaming environments Strong understanding of governance frameworks, access controls, and data protection policies Familiarity with Databricks, Snowflake, AWS, and modern data infrastructure patterns Excellent SQL skills and a focus on performance tuning, data integrity, and reusable design patterns This is an opportunity to shape the blueprint More ❯
Specialists to build the data foundations that power insight, automation, and innovation across the organisation. Key Responsibilities: Design and maintain scalable data platforms using cloud-native technologies such as Databricks and AWS across development, staging, and production environments Build and govern dimensional data models and semantic layers to power consistent and trusted analytics Integrate data from diverse sources including cloud … SQL, and Delta Live Tables Experience building and maintaining data pipelines across batch and streaming environments Strong understanding of governance frameworks, access controls, and data protection policies Familiarity with Databricks, Snowflake, AWS, and modern data infrastructure patterns Excellent SQL skills and a focus on performance tuning, data integrity, and reusable design patterns This is an opportunity to shape the blueprint More ❯
Preston, Lancashire, England, United Kingdom Hybrid/Remote Options
Circle Recruitment
integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is … + Flexible working (2 - 3 days per week in the office). To apply, press apply now or send your CV to Keywords: Lead Data Engineer/Azure Databricks/AWS/ETL/Python/data modelling Flexible working - Preston - Blackpool - Manchester - Warrington - Liverpool - Bolton - Blackburn Circle Recruitment is acting as an Employment Agency in relation to this vacancy. More ❯
Greater London, England, United Kingdom Hybrid/Remote Options
Primis
data modelling practices (conceptual, logical, physical) and enterprise data management principles Hands-on experience with data modelling tools (e.g., Erwin, Sparx, PowerDesigner) and big data/cloud ecosystems (e.g., Databricks, Snowflake, Redshift, Spark) Solid grasp of data governance, metadata, and data quality frameworks Excellent stakeholder engagement skills — able to communicate complex data concepts to both technical and business audiences Bonus … Points For Certifications in data or cloud architecture (e.g., AWS, Azure, GCP, Databricks) Experience with data lake design, large-scale data migrations , or regulatory data initiatives Familiarity with semantic modelling, ontologies, or graph data concepts (RDF, OWL, TTL) Exposure to Python or SQL for model design and validation Background in financial services, energy, or large-scale enterprise transformation Why Join More ❯
collaborate the Data & Ops team, to stay on top of key changes that may impact the ML frameworks and to own the release of ML products. We use Azure Databricks as our platform. To be successful in the role, you will need to be experienced in cross-team collaboration to deliver data science projects, whilst promoting best practices. You be … knowledge, and strong knowledge of ML packages and frameworks Skilful in writing well-engineered code using Spark, and advanced SQL and Python coding skills Experienced in working with Azure Databricks Proven experience working with Data Scientists to deliver best in-class solutions for model deployment and monitoring Great technical and communication skills, with a high degree of proactivity Passion for More ❯
Job Title: Expert Cloud Infrastructure Engineer (Azure) Job Location: Washington District Of Columbia 20001 Onsite Requirements: Hybrid Demonstrate strong knowledge of Azure Databricks, Azure Domain Transfer (ADT), and use of Kubernetes Use Infrastructure as Code (Terraform or Azure Resource Manager/Bicep templates) to provision and manage cloud resources Enable consistent environmental builds across development, staging, and production in compliance … robust Azure Government cloud infrastructures, including virtual networks, subnets, firewall rules, and VM configurations, to meet project requirements for scalability, high availability, and security Demonstrate strong knowledge of Azure Databricks, Azure Domain Transfer (ADT), and use of Kubernetes Use Infrastructure as Code (Terraform or Azure Resource Manager/Bicep templates) to provision and manage cloud resources Enable consistent environmental builds More ❯
the skills below, we'd love to hear from you. Experience working with data: wrangling, cleaning, and transforming datasets for analysis. Familiarity with tools such as Alteryx, DataRobot, SAS, Databricks, SPSS, R, Python, Scala, Java, or Spark. Exposure to data visualisation platforms like Tableau or Power BI. Understanding of machine learning concepts and algorithms (e.g. classification, clustering, regression). Interest … Language Generation (NLG), or Computer Vision. Awareness of enterprise graph technologies or network analysis techniques. Experience with cloud platforms like Microsoft Azure or Google Cloud Platform (GCP); familiarity with Databricks is a plus. Comfort working in cloud-based or secure environments, with an interest in MLOps or model deployment. Awareness and practice of responsible AI, data ethics, and governance frameworks. More ❯
Villa Park, Illinois, United States Hybrid/Remote Options
AETG Services PVT LTD
Position title : BI Developer Location : Oak Brook IL (Hybrid) Duration : 6 Months Visas : GC, USC Knowledge, Skills, and Abilities Required: 1. 5+ years of experience in building relational Dimensional Data models using the Kimball methodology. Experience in building heirarchys.2. Knowledge More ❯
Senior Palantir Engineer page is loaded Senior Palantir Engineerlocations: Homeworker - UK: London: Belfast: Birminghamposted on: Posted Todayjob requisition id: JR\_16664# Join Kainos and Shape the FutureAt Kainos, we're problem solvers, innovators, and collaborators - driven by a shared mission More ❯
We exist to create positive change for people and the planet. Join us and make a difference too Data Scientist (Innovation) Cambridge, United Kingdom – Hybrid 2 days/week in office. About The Role As a Data Scientist within the More ❯
Data Engineering Director, Practice Lead, London, £160k-£200k base dependant on experience, Consulting experience is needed, Snowflake, Databricks, GCP Lead the next generation of data innovation. We are exclusively seeking a Data Engineering Director to build and lead a high-performing data practice in London. This is a unique opportunity to shape a growing team, define strategy, and drive transformative … What You Bring 10+ years of experience in data and technology consulting 8+ years leading technical teams in data engineering or analytics Expertise in modern data platforms such as Databricks, Snowflake, GCP, AWS, or Azure Strong understanding of tools like Apache Spark, Kafka, and Kubernetes Deep knowledge of data governance, strategy, and privacy regulations (GDPR, etc.) Strategic mindset with the … ability to balance technical depth and business insight Passion for developing people, processes, and scalable solutions Preferred Qualifications Certifications in AWS, Databricks, or Snowflake Additional language skills (French, German, or Spanish) Experience shaping or scaling high-growth teams Why Join You’ll be part of a dynamic environment that values innovation, collaboration, and impact. Here, you’ll have the freedom More ❯
Data Engineering Director, Practice Lead, London, £160k-£200k base dependant on experience, Consulting experience is needed, Snowflake, Databricks, GCP Lead the next generation of data innovation. We are exclusively seeking a Data Engineering Director to build and lead a high-performing data practice in London. This is a unique opportunity to shape a growing team, define strategy, and drive transformative … What You Bring 10+ years of experience in data and technology consulting 8+ years leading technical teams in data engineering or analytics Expertise in modern data platforms such as Databricks, Snowflake, GCP, AWS, or Azure Strong understanding of tools like Apache Spark, Kafka, and Kubernetes Deep knowledge of data governance, strategy, and privacy regulations (GDPR, etc.) Strategic mindset with the … ability to balance technical depth and business insight Passion for developing people, processes, and scalable solutions Preferred Qualifications Certifications in AWS, Databricks, or Snowflake Additional language skills (French, German, or Spanish) Experience shaping or scaling high-growth teams Why Join You’ll be part of a dynamic environment that values innovation, collaboration, and impact. Here, you’ll have the freedom More ❯
Duration: 31/12/2026 Days on site: 2-3 Rate: £402/day on Umbrella Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions … using the Databricks platform. Key Responsibilities: Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for … Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). Proven track record of building and optimizing More ❯
to make the whole process more sustainable going forward, including the businesses Consolidated Data Store (using SQL server database) in the short term and Common Data Platforms (using Azure DataBricks) or Azure (again using DataBricks) team’s infrastructure platform in the medium/longer term. Experience Needed CSV Data Analytics Platform (AWS workspace) Python or R SQL Azure DataBricks The More ❯