126 to 150 of 1,792 Permanent Databricks Jobs

team based in Leeds, working mostly remotely with just one day on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re … passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver … as code Mentor and support your team, taking ownership of technical delivery and decisions Drive continuous improvements in platform performance, cost, and reliability Key Requirements Hands-on experience with Databricks or similar data engineering platforms Strong Python and SQL skills in data engineering contexts Expertise in data modelling and building analytics-ready datasets Experience with AWS or Azure cloud data More ❯

that support decision-making across business units. • Optimize R scripts and packages for large-scale data processing and analysis. • Lead the design and implementation of data pipelines using Azure Databricks, ensuring efficient and scalable data processing workflows. • Optimize data engineering tasks within Databricks, including data extraction, transformation, and loading (ETL) processes. • Develop and manage interactive reports and dashboards using Power … and migrations. • Hands-on experience with Apache Tomcat for web application and service management. • Proficiency with R Studio for data analysis, modeling, and statistical computations. • Experience working with Azure Databricks for data engineering and big data processing. • Advanced knowledge of Power BI for report creation, data visualization, and dashboard management. • Proven ability to lead technical teams, mentor staff, and communicate … with Azure DevOps for continuous integration and deployment of data management solutions. • Familiarity with scripting and automation using PowerShell, Python, or Azure CLI. • Certifications in Microsoft Azure, SQL Server, Databricks, or Power BI are a plus. • Experience with Machine Learning or AI applications in data management (e.g., using R or Databricks). Clearance: Applicants selected will be subject to a More ❯

ll sit at the heart of a high-performing Data & AI team. Your mission: transform raw data into actionable insight through robust pipelines, a modern data lakehouse (Azure + Databricks), and rock-solid governance. You'll work hands-on with ETL/ELT processes, medallion architecture, and CI/CD tooling-while collaborating with data scientists, IT teams, and business … leaders across Europe. What We Need From You 5+ years in Azure Data Engineering Deep knowledge of Azure Data Factory, Databricks, Python, SQL, Delta Lake Skilled in data modeling, medallion architecture, and integration via APIs, Event Hubs, ODBC, and sFTP Azure certification? Big plus. Power BI and ML experience? Even better. Fluent in Dutch & English (French is a plus) Why More ❯

more than 90 million passengers this year, we employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use … more than 90 million passengers this year, we employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use … and release engineering practices (, CI/CD). ·Experience with Apache Spark or any other distributed data programming frameworks. ·Comfortable writing efficient SQL and debugging on cloud warehouses like Databricks SQL or Snowflake. ·Experience with cloud infrastructure like AWS or Azure. ·Experience with Linux and containerisation (e.g Docker, shell scripting). ·Understanding Data modelling and Data Cataloguing principles. ·Understanding of More ❯

architectures in a modern cloud environment. You will play a key role in building and optimizing our Medallion architecture (Bronze, Silver, Gold layers), working with modern tools such as Databricks , dbt , Azure Data Factory , and Python/SQL to support critical business analytics and AI/ML initiatives. Key Responsibilities ETL Development : Design and build robust and reusable ETL/… ELT pipelines through the Medallion architecture in Databricks . Data Transformation : Create and manage data models and transformations using dbt , ensuring clear lineage, version control, and modularity. Pipeline Orchestration : Develop and manage workflow orchestration using Azure Data Factory , including setting up triggers, pipelines, and integration runtimes. System Maintenance : Monitor, maintain, and optimize existing data pipelines, including cron job scheduling and … Ensure compliance with data security policies, data retention rules, and privacy regulations. Required Skills and Experience 5+ years of experience in data engineering or similar roles. Strong experience with Databricks , including notebooks, cluster configuration, and Delta Lake. Proficiency in dbt for transformation logic and version-controlled data modeling. Deep knowledge of Azure Data Factory , including pipeline orchestration and integration with More ❯

and translating these into technical deliverables. Motivated to expand technical skills. Experience with Microsoft BI Tools such as Power BI, SSRS & SQL Server. Experience with Azure Data Factory and Databricks (Python). Experience working with DevOps, IaC & CI/CD pipelines (e.g. Terraform and Databricks Asset Bundles). More ❯

forward-thinking organization using data to drive innovation and business performance. They’re expanding their team and are looking for a talented Data Engineer with experience in Azure and Databricks to join the team. Salary and Benefits £55,000 – £65,000 salary depending on experience 10% performance-related bonus Hybrid working model – 2 days in the Greater Manchester office Supportive … do I need to apply for the role: Solid hands-on experience with Azure data tools, including Data Factory, Data Lake, Synapse Analytics, and Azure SQL. Strong proficiency with Databricks, including Spark, Delta Lake, and notebooks. Skilled in Python and SQL for data transformation and processing. Experience with Git and modern CI/CD workflows. Strong analytical mindset and effective More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I'm working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data Engineer .This is a fantastic opportunity to join a forward-thinking company where you'll play … working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but not essential. Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

more than 90 million passengers this year, we employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use … engineering practices (e.g. TDD, CI/CD). Experience with Apache Spark or any other distributed data programming frameworks. Comfortable writing efficient SQL and debugging on cloud warehouses like Databricks SQL or Snowflake. Experience with cloud infrastructure like AWS or Azure. Experience with Linux and containerisation (e.g Docker, shell scripting). Understanding Data modelling and Data Cataloguing principles. Understanding of … end monitoring, quality checks, lineage tracking and automated alerts to ensure reliable and trustworthy data across the platform. Experience of building a data transformation framework with dbt. Familiarity with Databricks as a data and AI platform or the Lakehouse Architecture. What you’ll get in return Competitive base salary Up to 20% bonus 25 days holiday BAYE, SAYE & Performance share More ❯

insights that drive transformation? We’re looking for Data Engineers who have a broad range of data engineering skills, with a focus on Snowflake , along with experience with either Databricks or Microsoft Fabric . ABOUT THE ROLE As a Data Engineer, you will play a key role in delivering high-quality data solutions for our clients. This role offers the … expertise across the data engineering and analytics landscape. Key technical skills include: Snowflake expertise : Proven experience designing and delivering data solutions in Snowflake, plus proficiency in platforms such as Databricks (Azure or AWS), Microsoft Fabric, Azure Data Factory, or Azure Synapse. Python programming : Ability to write clean, efficient Python code for data manipulation and analysis. Data pipeline development : Experience building More ❯

Job Reference: NC/RG/DE_1745802035 Job Views: 50 Posted: 28.04.2025 Expiry Date: 12.06.2025 col-wide Job Description: Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I’m working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to … working with data and delivering value to stakeholders. * Strong proficiency in SQL, Python, and Apache Spark, with hands-on experience using these technologies in a production environment. * Experience with Databricks and Microsoft Azure is highly desirable. * Financial Services experience is a plus but not essential. * Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

with the ability to engage technical and non-technical stakeholders alike. The Head of BI will work within a modern, cloud-based BI ecosystem, including: Data Integration: Fivetran, HVR, Databricks, Apache Kafka, Google BigQuery, Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST … API Advanced Analytics: Databricks (AI & Machine Learning) Governance & Infrastructure: Centralised Data Catalogue & Access Control (Okta) Job Scheduling & Monitoring (AWS, Splunk) Agile Data Engineering with centralised code repositories BI Data Portal: Power BI However this coexists with a legacy tech stack, which the head of BI will support the transition to the new architecture already in place. Qualifications/Education: Degree More ❯

ability to engage technical and non-technical stakeholders alike. The Head of Data Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST … API Advanced Analytics: Databricks (AI & Machine Learning) Governance & Infrastructure: Centralised Data Catalogue & Access Control (Okta) Job Scheduling & Monitoring (AWS, Splunk) Agile Data Engineering with centralised code repositories BI Data Portal: Power BI However this coexists with a legacy tech stack , which theHead of Data Engineering & Insight will support the transition to the new architecture already in place. Qualifications/Education More ❯

translating these into technical deliverables. Motivated to expand technical skills. Desirable Experience with Microsoft BI Tools such as Power BI, SSRS & SQL Server. Experience with Azure Data Factory and Databricks (Python). Experience working with DevOps, IaC & CI/CD pipelines (e.g. Terraform and Databricks Asset Bundles). More ❯

translating these into technical deliverables. Motivated to expand technical skills. Desirable Experience with Microsoft BI Tools such as Power BI, SSRS & SQL Server. Experience with Azure Data Factory and Databricks (Python). Experience working with DevOps, IaC & CI/CD pipelines (e.g. Terraform and Databricks Asset Bundles). More ❯

ability to engage technical and non-technical stakeholders alike. The Head of Data Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST … API Advanced Analytics: Databricks (AI & Machine Learning) Governance & Infrastructure: Centralised Data Catalogue & Access Control (Okta) Job Scheduling & Monitoring (AWS, Splunk) Agile Data Engineering with centralised code repositories BI Data Portal: Power BI However this coexists with a legacy tech stack , which theHead of Data Engineering & Insight will support the transition to the new architecture already in place. Qualifications/Education More ❯

IAT Level II Certification may be required (GSEC, GICSP, CND, CySA+, Security+ CE, SSCP or CCNA-Security). Advanced proficiency in Python, SQL, PySpark, MLOps, computer vision, and NLP, Databricks, AWS, Data Connections Cluster Training and tools such as GitLab, with proven success in architecting complex AI/ML pipelines. Demonstrated ability to write clean, efficient code in Python and … technical teams, providing guidance on project direction, technical challenges, and professional development. One or more of the following certifications are desired: AWS Certified Solutions Architect or Machine Learning Specialty. Databricks Certified Machine Learning Professional. Agile/Scrum Master Certification. Specialized certifications in AI/ML tools or methodologies. Preferred Qualifications: Familiarity with Apache Spark or comparable distributed data processing frameworks … preferably for large-scale data transformations and analytics. Working knowledge of data governance platforms (e.g., Collibra) and cloud-based analytics solutions (e.g., Databricks). Hands-on experience with modern BI tools (e.g., Qlik, Power BI, Tableau) for data visualization and insight generation. Awareness of data access control best practices (e.g., Immuta) and familiarity with role or attribute-based access control More ❯

reliable data movement and transformation. • Data Modelling using Kimball, 3NF or Dimensional methodologies • Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server. • Design and implement metadata driven pipelines to automate data processing tasks. • Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions. … are some obvious required Skills and Experience we are going to be seeking out. For this role we'd be expecting to see: • Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server. • Proficiency in SQL and Python languages. • Hands-on experience in designing and building data pipelines using Azure Data Factory (ADF). • Familiarity with building More ❯

to detail with a willingness to document processes and changes. Effective communication skills and a collaborative mindset. One or more of the following certifications are desired: AWS Certified Developer, Databricks, Agile/Scrum, Python Programmer Preferred Qualifications: Familiarity with Apache Spark or comparable distributed data processing frameworks, preferably for large-scale data transformations and analytics. Working knowledge of data governance … platforms (e.g., Collibra) and cloud-based analytics solutions (e.g., Databricks). Hands-on experience with modern BI tools (e.g., Qlik, Power BI, Tableau) for data visualization and insight generation. Awareness of data access control best practices (e.g., Immuta) and familiarity with role or attribute-based access control frameworks. Other: Must hold an Active DOD Secret, Top Secret or TS/ More ❯

abilities, and the capacity to work productively in cross-functional teams while maintaining a continuous improvement mindset. One or more of the following certifications are desired: AWS Certified Developer, Databricks, Agile/Scrum, Python Programmer Preferred Qualifications: Familiarity with Apache Spark or comparable distributed data processing frameworks, preferably for large-scale data transformations and analytics. Working knowledge of data governance … platforms (e.g., Collibra) and cloud-based analytics solutions (e.g., Databricks). Hands-on experience with modern BI tools (e.g., Qlik, Power BI, Tableau) for data visualization and insight generation. Awareness of data access control best practices (e.g., Immuta) and familiarity with role or attribute-based access control frameworks. Other: Must hold an Active DOD Secret, Top Secret or TS/ More ❯

Strong analytical skills and attention to detail./Bonus Skills: Experience with Microsoft Fabric (OneLake, DirectLake, Data Warehouse, Data Activator) is a significant plus. Knowledge of Azure Synapse Analytics , Databricks , or Power BI . Experience with automated data validation or scripting (e.g., Python, PowerShell). Familiarity with CI/CD processes in data environments. Relevant certifications (e.g., Microsoft Certified: Azure More ❯

for Azure services. Skills, Experience & Competencies Required Skills: Extensive experience in data engineering with Microsoft Azure. Proficiency in Azure services such as Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database. Strong experience with ETL/ELT pipelines, data modelling, and data integration. Proficiency in SQL and programming languages like Python, Scala, or PowerShell. More ❯

practices. Collaborating with leadership and stakeholders to align data priorities. Qualifications and Experience: Expertise in Commercial/Procurement Analytics and SAP (S/4 Hana). Experience with Spark, Databricks, or similar tools. Strong proficiency in data modeling, SQL, NoSQL, and data warehousing. Hands-on experience with data pipelines, ETL, and big data technologies. Proficiency in cloud platforms like AWS More ❯

using both on-premises and cloud-based technologies (Azure, AWS, or GCP). You'll design scalable data architectures, including data lakes, lakehouses, and warehouses, leveraging tools such as Databricks, Snowflake, and Azure Synapse. The ideal candidate will have a deep technical background in data engineering and a passion for leading the development of best-in-class data solutions. You More ❯

/ELT, Data Lakes, Warehousing, MDM, and BI. Engineering delivery practices : Knowledge of Agile, DevOps, Git, APIs, Containers, Microservices, and Data Pipeline orchestration. Broader platform experience (desirable): Familiarity with Databricks, Snowflake, Azure Data Factory, Azure Synapse, Microsoft SQL/SSIS. Certifications that are a plus: Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) Microsoft Certified: Fabric Data Engineer Associate (DP More ❯