351 to 375 of 681 Permanent Databricks Jobs

Position: Databricks Engineer (Onsite)Location: Wilmington, DE Need locals Duration: 6-12 Months Job Description Looking for a skilled Databricks Engineer to build and optimize data pipelines on AWS using Databricks, EMR/EKS, and Terraform. The role involves developing scalable data solutions in Scala, Python, and Java, integrating with cloud infrastructure and ensuring performance, automation, and reliability. Key Responsibilities … Design and manage Databricks-based data pipelines on AWS. Automate infrastructure with Terraform. Deploy and optimize clusters using EMR/EKS. Develop ETL workflows using Scala, Python, and Java. Implement CI/CD with DBX and follow best practices in cloud data engineering. Requirements 5+ years of experience in data engineering or Databricks development. Strong skills in AWS (EMR, EKS … Terraform, Databricks, and Spark. Proficiency in Scala, Python, and Java. Experience building automated, scalable data pipelines in cloud environments. More ❯

Data Engineer - Azure Databricks , Apache Kafka Permanent Basingstoke (Hybrid - x2 PW) Circa £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern tools such as Azure … Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make a meaningful impact in a collaborative … fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality data products Supporting the deployment and productionisation of machine learning pipelines Contributing More ❯

real-time streaming architectures, to support advanced analytics, AI, and business intelligence use cases. Proven experience in designing architectures for structured, semi-structured, and unstructured data , leveraging technologies like Databricks, Snowflake, Apache Kafka , and Delta Lake to enable seamless data processing and analytics. Hands-on experience in data integration , including designing and optimising data pipelines (batch and streaming) and integrating … in data and AI, such as data fabric, automated machine learning (AutoML) , and low-code/no-code analytics platforms , with familiarity in vendor ecosystems (e.g., Microsoft, AWS, Google, Databricks ). Exceptional stakeholder management and presentation skills , with the ability to translate complex data and AI concepts into actionable insights for non-technical audiences, including C-suite executives. Experience leading … AI projects, ensuring timely and budget-conscious execution, while mentoring junior team members. Relevant certifications , such as AWS Certified Solutions Architect, Azure Data Engineer Associate, Google Professional Data Engineer, Databricks Certified Data Engineer , or TOGAF , with additional certifications in AI or MLOps being a plus. Your Responsibilities Your responsibilities and achievements will evolve as you grow with us. Initially, you More ❯

s or PhD level degree 5+ years of work experience in a data science role Proficient with cloud computing environments, Kubernetes, etc. Familiarity with Data Science software & platforms (e.g. Databricks) Software development experience Research and new algorithm development experience# Remote Type Hybrid Remote Skills to succeed in the role Active Learning, Adaptability, Bitbucket, Cloud Infrastructure (Aws), Code Reviews, Cross-Functional … Work, Curiosity, Databricks Platform, Data Science, Data Storytelling, Digital Literacy, Emotional Intelligence, Empathy, Git, Initiative, Machine Learning, Problem Solving, Python (Programming More ❯

years of experience across data engineering, cloud computing, or data warehousing Minimum 2 years in hands-on development capacity Expertise in one or more modern cloud data platforms: Snowflake, Databricks, AWS Redshift, Microsoft Fabric, or similar Understanding of data modelling principles, dimensional modelling, and database design Proficiency in SQL and query optimization Comprehensive knowledge of ETL/ELT processes and … experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data quality frameworks, and metadata management More ❯

years of experience across data engineering, cloud computing, or data warehousing Minimum 2 years in hands-on development capacity Expertise in one or more modern cloud data platforms: Snowflake, Databricks, AWS Redshift, Microsoft Fabric, or similar Understanding of data modelling principles, dimensional modelling, and database design Proficiency in SQL and query optimization Comprehensive knowledge of ETL/ELT processes and … experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data quality frameworks, and metadata management More ❯

Key Responsibilities Architect and design end-to-end Azure data platforms , including ingestion, storage, transformation, analytics, and visualization layers. Build solutions leveraging Azure Data Lake, Synapse Analytics, Data Factory, Databricks, Event Hubs, Stream Analytics, Power BI , and related services. Translate complex business requirements into scalable, cost-efficient, and maintainable Azure data architectures. Create and present high-level and low-level … as a Data Solution Architect or Data Platform Architect with a primary focus on Azure . Hands-on expertise with Azure Data Factory, Synapse Analytics, Data Lake Storage (Gen2), Databricks, Power BI, Event Hubs, and Functions . Strong background in data modeling, data warehousing, and real-time/batch data processing . Experience implementing data integration pipelines, ETL/ELT More ❯

Key Responsibilities Architect and design end-to-end Azure data platforms , including ingestion, storage, transformation, analytics, and visualization layers. Build solutions leveraging Azure Data Lake, Synapse Analytics, Data Factory, Databricks, Event Hubs, Stream Analytics, Power BI , and related services. Translate complex business requirements into scalable, cost-efficient, and maintainable Azure data architectures. Create and present high-level and low-level … as a Data Solution Architect or Data Platform Architect with a primary focus on Azure . Hands-on expertise with Azure Data Factory, Synapse Analytics, Data Lake Storage (Gen2), Databricks, Power BI, Event Hubs, and Functions . Strong background in data modeling, data warehousing, and real-time/batch data processing . Experience implementing data integration pipelines, ETL/ELT More ❯

industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are … and cost efficiency across Snowflake accounts Act as a subject matter expert during consulting engagements, providing advice on best practices for data sharing, and integration with other technology (e.g. Databricks, Starburst, Tableau, Power BI) Ensure solutions meet both functional and non-functional requirements such as scalability, security, reliability and cost optimisation Key Requirements & Technical Experience At least 3 years of More ❯

industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are … and cost efficiency across Snowflake accounts Act as a subject matter expert during consulting engagements, providing advice on best practices for data sharing, and integration with other technology (e.g. Databricks, Starburst, Tableau, Power BI) Ensure solutions meet both functional and non-functional requirements such as scalability, security, reliability and cost optimisation Key Requirements & Technical Experience At least 3 years of More ❯

Role Title: Senior Databricks Engineer Duration: contract to run until 31/12/2026 Location: Glasgow, hybrid 2/3 days per week onsite Rate: up to £414 p/d Umbrella inside IR35 Role purpose/summary We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and … contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions using the Databricks platform. Key Skills/requirements Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements … and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. More ❯

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation who operate on a global scale. They are headquartered in Oxfordshire, UK … and also have offices throughout the UK, Europe and the US. The Role: We are looking for a driven and experienced Senior Data Engineer with extensive Databricks experience to join a rapidly growing in house Data team during an exciting period of change. This is a role where you can really make your mark and impact change very quickly . … with the Data Architect to interpret data architecture designs into actionable build plans and lead the development of data processing workflows. From a technical standpoint you must possess: Extensive Databricks experience including Unity Catolog and Spark SQL Strong programming skills, preferably in Python and SQL Strong knowledge and experience in Azure, including working with Azure Data Factory and Azure Storage More ❯

JOB TITLE: Hybrid Advisor Cloud Engineer (Databricks) JOB LOCATION: Onsite 2 days a week in Dublin OH WAGE RANGE : $65HR TO $68HR JOB NUMBER: 25-03732 REQUIRED EXPERIENCE: What we're looking for Analytical and data analysis skills using Microsoft SQL. Excellent team, verbal and written communication skills Experienced SQL Server/MS-SQL scripting and Databricks expertise. Experience with … within healthcare for functional, business leaders, and team members. Under general direction, the Advisor Cloud Engineer will be responsible for designing and/or creating, maintaining, deploying, and managing Databricks and SQL applications for internal business teams and our customers. Candidates will work collaboratively with IT staff, and business stakeholders to create, maintain, and support ETL packages in a compliant … understand the business requirements and present detailed systems design documentation for reports, data interface files, data conversion and any other method of data exchange. Develop, test, manage and implement Databricks/SQL Packages from development server to production server using package configuration. Work on maintenance and Administration of Databricks by creating Jobs, Alerts, SQL Mail Agent, and schedules. Develop with More ❯

Solutions Architect - Databricks Join to apply for the Solutions Architect - Databricks role at Lumenalta . We partner with global enterprises to launch digital products that interact with millions of users and massive data volumes. Our work requires scalable architecture, creative problem solving, and seamless platform integration. What You'll Do Design scalable, secure, and high performance data architectures Translate business … requirements into robust technical solutions Guide teams on best practices for building with PySpark, AWS, and Databricks Collaborate with cross functional teams to align architecture with product goals Own architectural decisions across cloud infrastructure and data pipelines What We're Looking For 8+ years of experience in data engineering, architecture, or related roles Deep expertise with AWS, Databricks, and PySpark More ❯

Title: Senior Data Engineer (Databricks) Salary: Up to £60,000 Location: Birmingham (Hybrid) Are you a Data Engineer looking to work on large-scale, global data solutions that actually make an impact? This is a fantastic opportunity to join a market-leading automotive technology company that's shaping the future of connected data and intelligent platforms worldwide. You'll be … thousands of dealerships across the globe. What you'll be doing: Building and maintaining a unified data platform for global data processing. Developing reusable and scalable data solutions using Databricks, Python/PySpark, and Azure. Working closely with the data visualisation team to align back-end and front-end needs. Designing secure data access models and integrating external data sources … keep things running smoothly. What we're looking for: Strong understanding of data engineering principles, Lakehouse architecture, ETL/ELT, warehousing, and stream processing. Hands-on experience with Azure Databricks, Python/PySpark, SQL Server, and Azure Blob Storage. A track record of building secure, scalable data pipelines and solving complex problems. Great communication and documentation skills with a proactive More ❯

Job Title: Artificial Intelligence Engineer (Databricks) Rate: DOE (outside IR35) Location: Remote Contract Length: 6 months A consultancy client of ours have secured a project requiring a Databricks focused Artificial Intelligence Engineer. This is an exciting opportunity to work on cutting-edge machine learning projects, building scalable ML pipelines and cloud-based systems that deliver real-world impact. Key Responsibilities … Lead the design, development, and optimisation of scalable machine learning workflows using Azure Databricks Build and deploy robust ML pipelines leveraging Delta Lake, MLflow, notebooks, and Databricks Jobs Apply advanced knowledge of Databricks architecture and performance tuning to support production-grade ML solutions Collaborate with data scientists, data engineers, and analysts to operationalise machine learning models at scale Champion the … use of Databricks-native features (e.g., Unity Catalog, MLflow Model Registry, AutoML) to improve model lifecycle management Migrate legacy model training and scoring workflows into unified Databricks-based pipelines Ensure best practices in model reproducibility, governance, monitoring, and security within the Databricks environment Act as a subject matter expert on Databricks ML capabilities, advising on architecture, tools, and integrations Mentor More ❯

Job Title: Senior Data Engineer (Azure/Databricks) Location : UK (Flexible Hybrid) Salary: Up to £75,000 + Benefits Are you an engineer who loves working with Databricks? Do you get excited by writing production-grade code to build, scale, and solve complex data platform challenges? I'm hiring for a global leader in the digital communications space. Their high … insights. What You'll Actually Do: Design & Build Data Pipelines: Take full ownership of designing, building, and managing the full lifecycle of complex data pipelines using Azure Data Factory, Databricks (Python/PySpark), and advanced SQL. Productionise Databricks: Lead the development of robust, scalable solutions on Databricks. This is role focused on production code, Delta Lake, Structured Streaming, and Spark … support analytical workloads, ensuring data is optimised for BI and reporting. Manage Data Infrastructure: Configure and optimize the underlying data infrastructure from a data engineering lens. This includes managing Databricks clusters, Spark configurations, and ADLS Gen2 storage to ensure high performance and cost-efficiency. Partner Across the Business: Partner with Data Analysts, Product Managers, and business leaders to translate requirements More ❯

To be considered for this role you must have experience in: Domain knowledge – understanding of the insurance sector Data literate - experience with SQL is a must and AD or Databricks exposure would be desirable. BI experience – familiarity with tools such as Qlik, Power BI, Tableau, Looker, etc. Role is paying £40-55,000 + benefits and will require 3 days More ❯

To be considered for this role you must have experience in: Domain knowledge – understanding of the insurance sector Data literate - experience with SQL is a must and AD or Databricks exposure would be desirable. BI experience – familiarity with tools such as Qlik, Power BI, Tableau, Looker, etc. Role is paying £40-55,000 + benefits and will require 3 days More ❯

of a new General Ledger system to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role, on a greenfield programme. A brilliant opportunity! The following More ❯

of a new General Ledger system to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role, on a greenfield programme. A brilliant opportunity! The following More ❯

the delivery of strategic IT solutions to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role. A brilliant opportunity! The following skills/experience is More ❯

the delivery of strategic IT solutions to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role. A brilliant opportunity! The following skills/experience is More ❯

as ongoing troubleshooting issues Technically the focus is SQL Server, TSQL, SSIS SSAS And for the Future, they are creating a new roadmap with new technologies including python and databricks in 2027 This is a new opportunity and will be shortlisting over the next week For more information and the chance to be considered, please do send through a CV More ❯

as ongoing troubleshooting issues Technically the focus is SQL Server, TSQL, SSIS SSAS And for the Future, they are creating a new roadmap with new technologies including python and databricks in 2027 This is a new opportunity and will be shortlisting over the next week For more information and the chance to be considered, please do send through a CV More ❯