451 to 475 of 663 Permanent Databricks Jobs

release, monitoring, and support. Operationalize models with CI/CD pipelines, automated testing, and monitoring, applying MLOps practices such as versioning, retraining, and drift detection (tools: MLflow, Azure ML, Databricks) Leverage both open-source frameworks (LangChain, Hugging Face, etc.) and enterprise platforms (Azure OpenAI, Databricks, etc.) to deliver production ready, scalable AI solutions Implement generative AI and advanced analytics features More ❯

security and privacy regulations. Contribute to Communities of Practice and support their cloud-first strategy. What you'll need to succeed Extensive experience in cloud-based data engineering (preferably Databricks), with a strong background in modernisation and large-scale migration. Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks. Proven track record … . Ability to translate strategic goals into technical delivery plans and roadmaps. Desirable Criteria Experience designing and implementing AI/ML-driven solutions within data platforms. Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect). Advanced academic qualifications or industry recognition in data engineering and cloud technologies. Experience in DevOps practices using GitHub Actions and More ❯

Data Engineer Location: London (Hybrid - 3-4 days/month in office, remote flexible) Type: Permanent MANDATORY TECHNICAL SKILLS: Core Requirements: Databricks - Hands-on experience Snowflake - Practical knowledge Microsoft Fabric - Data Engineering & Data Visualization (includes Power BI under MS Fabric license) Python, PySpark & SQL - Strong expertise mandatory Note: MS Fabric includes Data Engineering and Power BI capabilities (sold under MS … solid hands-on experience Hybrid working with only 3-4 days per month in London office (very flexible remote) Looking for candidates with proven experience across all three platforms: Databricks, Snowflake, and Microsoft Fabric CANDIDATE REQUIREMENTS: Proven Data Engineering experience Hands-on with cloud data platforms (Azure/AWS) ETL/ELT pipeline development Strong problem-solving and communication skills More ❯

Hybrid – Surrey (1 day in office every fortnight) This is a high-impact Lead Data Engineer role, where you’ll work across a cutting-edge data stack (AWS, Databricks, Spark, dbt) to design scalable platforms and products that enable self-service analytics, advanced modelling, and AI-driven decision-making. You’ll report into the Head of Data Engineering, supporting a … driving best practices, and acting as a foundational support. Key responsibilities include: Leading data engineering projects and managing sub-teams Designing, optimising, and scaling data platforms in AWS/Databricks Driving coding standards, frameworks, and best practices Building and supporting modern data pipelines and products Coaching and mentoring engineers to raise technical excellence Partnering with product managers, data & AI engineers … major business problems, including Generative AI applications What we’re looking for: Hands-on expertise in Python, SQL, Spark, Airflow, Terraform Proven experience with cloud-native data platforms (AWS, Databricks, Snowflake) Strong track record of mentoring or coaching other engineers Knowledge of CI/CD tooling (Git, Jenkins or similar) Experience in batch and real-time data processing Exposure to More ❯

global logistics business, based in central London, is undergoing an exciting data transformation programme as it invests in a new team charged with building and implementing a new Azure Databricks platform. Working five days a week in the central London office, you'll join this growing team and play a key role in building and deploying robust data infrastructure and … have the opportunity build your skills in analytics engineering, responding to business and project needs rather than operating as a narrow silo. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to create scalable data models, automated pipelines, and self-service analytics capabilities. This is a fantastic opportunity to join a newly created … a new data strategy. The Position Key responsibilities and primary deliverables: Collaborate with Data Engineer in the design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks to automate data ingestion, transformation, and processing workflows. DCreate and maintain dimensional data models and semantic layers that support business intelligence and analytics use cases. Build and optimise data transformation More ❯

global logistics business, based in central London, is undergoing an exciting data transformation programme as it invests in a new team charged with building and implementing a new Azure Databricks platform. Working five days a week in the central London office, you'll join this growing team and play a key role in building and deploying robust data infrastructure and … have the opportunity build your skills in analytics engineering, responding to business and project needs rather than operating as a narrow silo. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to create scalable data models, automated pipelines, and self-service analytics capabilities. This is a fantastic opportunity to join a newly created … a new data strategy. The Position Key responsibilities and primary deliverables: Collaborate with Data Engineer in the design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks to automate data ingestion, transformation, and processing workflows. DCreate and maintain dimensional data models and semantic layers that support business intelligence and analytics use cases. Build and optimise data transformation More ❯

cutting-edge tech and make a real impact? We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You … ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience More ❯

cutting-edge tech and make a real impact? We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You … ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience More ❯

cutting-edge tech and make a real impact We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients.What You’ll … Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience in More ❯

a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access … improvements to ensure reliable and accurate data availability. Mentoring junior engineers and sharing knowledge through documentation, workshops, and code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing More ❯

ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and on-prem environments. Implement and optimise data solutions in Azure Synapse, Data Lake, Databricks , and Snowflake . Write efficient SQL and Python scripts for data manipulation, validation, and automation. Collaborate with data architects and analysts to ensure data consistency and quality across systems. Troubleshoot … data ingestion and transformation workflows. Ensure compliance with data security and governance standards. Key Skills: Strong experience with Azure Data Factory (ADF) – expert level. Hands-on skills in Azure Databricks , Snowflake , and SQL . Proficiency in Python for automation and data transformation. Good debugging and problem-solving skills. Excellent communication and collaboration abilities. 6–8 years of overall data engineering More ❯

What do we do: Our mission is to combine premium consulting with deep technology and data knowledge to add value to our clients. The opportunity: Valcon is growing its Databricks community and we're looking for a Databricks Architect to help clients turn data into measurable business results. As a Databricks Elite Partner, we work on some of the most … advanced data and AI projects in Europe. You'll own the design and governance of the Databricks Lakehouse platform. You'll set technical standards, shape data architecture, and guide engineers to build secure, cost-efficient, and scalable solutions for analytics, AI, and applications. Overview of Data Capability: Every company has data challenges, easy or complex, big or small. This asks … made of 4 competence teams: Data Governance Data Management Data Platforms Data Science and Artificial Intelligence What you'll do: You'll work on projects with leading organisations using Databricks to advance their AI and data strategies. Partner with data leaders and solution architects to align Databricks design with strategy Lead, advise on and review the design of platforms, pipelines More ❯

is for you. The successful AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge … and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data engineering, including data More ❯

is for you. The successful AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge … and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data engineering, including data More ❯

direction while staying close to the code. Perfect if you want scope for growth without going “post-technical.” What you’ll do Design and build modern data platforms using Databricks, Apache Spark, Snowflake, and cloud-native services (AWS, Azure, or GCP). Develop robust pipelines for real-time and batch data ingestion from diverse and complex sources. Model and optimise … looking for Solid experience as a Senior/Lead Data Engineer in complex enterprise environments. Strong coding skills in Python (Scala or functional languages a plus). Expertise with Databricks, Apache Spark, and Snowflake (HDFS/HBase also useful). Experience integrating large, messy datasets into reliable, scalable data products. Strong understanding of data modelling, orchestration, and automation. Hands-on More ❯

direction while staying close to the code. Perfect if you want scope for growth without going “post-technical.” What you’ll do Design and build modern data platforms using Databricks, Apache Spark, Snowflake, and cloud-native services (AWS, Azure, or GCP). Develop robust pipelines for real-time and batch data ingestion from diverse and complex sources. Model and optimise … looking for Solid experience as a Senior/Lead Data Engineer in complex enterprise environments. Strong coding skills in Python (Scala or functional languages a plus). Expertise with Databricks, Apache Spark, and Snowflake (HDFS/HBase also useful). Experience integrating large, messy datasets into reliable, scalable data products. Strong understanding of data modelling, orchestration, and automation. Hands-on More ❯

processing frameworks (e.g., Spark, Flink). Strong experience with cloud platforms (AWS, Azure, GCP) and related data services. Hands-on experience with data warehousing tools (e.g., Snowflake, Redshift, BigQuery), Databricks running on multiple cloud platforms (AWS, Azure and GCP) and data lake technologies (e.g., S3, ADLS, HDFS). Expertise in containerization and orchestration tools like Docker and Kubernetes. Knowledge of … e.g., GDPR, CCPA) and compliance requirements. Experience in implementing and managing business glossaries, data governance rules, metadata lineage, and ensuring data quality. Highly experienced with AWS cloud platform and Databricks Lakehouse. More ❯

About The Role Ecotricity, the UK’s first true green energy provider, has a strong internal team supporting and developing solutions across multiple mission critical platforms including Databricks on AWS, SQL, Power BI and other cloud centric data solutions. This technical hands-on role, of Data Engineer, will contribute to our delivery of projects, BAU, and helping Ecotricity become more … the group/project. We have a training programme in place to further advance your skills. Dedicated time for training is planned in our workloads. Training and certifications in Databricks are paid for by the company. We’re proud to be an ethical company, and this naturally attracts ethical people, making for a good safe working environment and a team … should strive for best practice and technical excellence and be a person that actively looks for continual improvement opportunities. Knowledge and skills Experience as a Data Engineer or Analyst Databricks/Apache Spark SQL/Python BitBucket/GitHub. Advantageous dbt AWS Azure Devops Terraform Atlassian (Jira, Confluence) About Us What's in it for you... Healthcare plan, life assurance More ❯

have the freedom to establish technical frameworks Reporting to : Ben Sutton, Head of Reporting & Analytics (DataIQ Future Leaders 2025 recipient) Technology stack : Azure (Data Factory, Data Lake, DevOps) + Databricks Key Selling Points ✅ Own the entire data platform - not just maintaining someone else's work ✅ Define technical standards from the ground up ✅ Small but mighty team - high impact, collaborative environment … Ideal Candidate Profile Must-haves: Hands-on coding appetite - this isn't a pure management role Team leadership experience - comfortable managing and mentoring engineers Advanced skills : SQL, Python, PySpark, Databricks, Azure stack Enjoys building from scratch - thrives in low-maturity, high-potential environments Deal-breakers: ❌ Candidates who've "moved away" from hands-on engineering ❌ Those uncomfortable with people management responsibilities More ❯

have the freedom to establish technical frameworks Reporting to : Ben Sutton, Head of Reporting & Analytics (DataIQ Future Leaders 2025 recipient) Technology stack : Azure (Data Factory, Data Lake, DevOps) + Databricks Key Selling Points ✅ Own the entire data platform - not just maintaining someone else's work ✅ Define technical standards from the ground up ✅ Small but mighty team - high impact, collaborative environment … Ideal Candidate Profile Must-haves: Hands-on coding appetite - this isn't a pure management role Team leadership experience - comfortable managing and mentoring engineers Advanced skills : SQL, Python, PySpark, Databricks, Azure stack Enjoys building from scratch - thrives in low-maturity, high-potential environments Deal-breakers: ❌ Candidates who've "moved away" from hands-on engineering ❌ Those uncomfortable with people management responsibilities More ❯

build, and maintain scalable data solutions. Owning the end-to-end data lifecycle — from ingestion and transformation through to analytics and data product delivery. Architecting and operating pipelines using Databricks, Spark, and Delta Lake, ensuring performance, reliability, and cost-efficiency. Working closely with BI developers and analysts to deliver dashboards, extracts, datasets, and APIs that power customer insights. Shaping platform … Mentoring team members and supporting their development. Skills & Experience Required Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred, but any major cloud is fine More ❯

solutions. This role requires deep expertise in enterprise architecture, AI systems design, and cloud-native platforms (specifically Microsoft Azure, leveraging services like Azure AI Studio/Foundry, Azure OpenAI, Databricks). Collaborate with C-suite executives, Directors, Business & technology stakeholders, data scientists, and engineering teams to ensure that AI initiatives are scalable, secure, ethically sound, and aligned with Ecolab's … methodologies to ensure smooth delivery and production deployment. Data and Integration: Ensure data readiness for AI initiatives, collaborating with data engineers to design robust data pipelines (leveraging tools like Databricks) that provide timely, accurate, and contextual data to AI agents. Security, Ethics, and Compliance: Embed robust security measures, data privacy, and ethical AI principles into every architectural layer. Ensure solutions More ❯

Senior Data Architect/Engineer Location : Glasgow, UK Experience : Minimum of 5 - 7 years of experience Snowflake and/or databricks is must - hands on experience This role will be key to helping our divisional leadership to making informed, data-driven decisions by developing a sophisticated, scalable and explainable decision model to aid workforce planning. The ideal candidate will have … identification of remediation issues involving data. Qualifications: Experience: Minimum of 5 - 7 years of experience in data science, analytics, operational research or a related field. Snowflake and/or databricks is must - hands on experience Advanced degree in a quantitative field (e.g. Data Science, Engineering, Mathematics, etc. More ❯

for you. The successful Senior AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge … and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data engineering, including data More ❯

for you. The successful Senior AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge … and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data engineering, including data More ❯