251 to 275 of 328 Permanent Databricks Jobs

distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. Secondary Skillset: Experience … Core Java ( Collections, Objects) -Expert Spring -Expert Kafka- Intermediate or above SQL and No SQL DB – Intermediate or above Hands-on with Flink, Spark, Databricks for data processing. ...

distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. Secondary Skillset: Experience … Spring -Expert 4)Kafka- Intermediate or above 5)SQL and No SQL DB – Intermediate or above 6)Hands-on with Flink, Spark, or Databricks for data processing. ...

lead cutting-edge projects, mentor talented engineers and shape the future data strategy. You will play a pivotal role in migrating legacy systems to Databricks, designing scalable architectures and embedding best practices across the team. Longer term, you will help integrate AI and advanced analytics into the organisation's data … keep the organisation ahead of the curve. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Hands-on experience with Databricks and PySpark/Spark SQL. Strong expertise with the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture and performance optimisation. What ...

that is transforming its data landscape. You will be the technical lead on the migration of the company's existing Azure Data Platform to Databricks where you will be responsible for the build of the new platform before overseeing the decommissioning of legacy systems. This is a hands-on engineering … high-performance data pipelines and ETL processes. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Strong hands-on expertise with Databricks and PySpark/Spark SQL. Deep knowledge of the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture principles and performance ...

consistently high standard and can evolve to meet future needs. The environment The Enterprise Data Platform is built on Microsoft Azure, using Databricks, Microsoft Fabric, and Power BI to deliver trusted, governed data and analytics. What you will be doing ·Setting data engineering standards, patterns, and best practices ·Acting … growth and high quality delivery What we are looking for ·Strong experience designing and building data platforms on Microsoft Azure ·Hands on experience with Databricks and Microsoft Fabric ·Experience working with analytics and reporting tools such as Power BI ·Experience managing and mentoring data engineers ·Excellent communication skills ...

impact change very quickly. The Data Engineering Team Lead/Lead Data Engineer will remain hands-on and will ideally have experience with Databricks and Azure however the leadership experience and behaviours are the priority for this role. The Person: The successful candidate must have proven experience operating … lead the development of data processing workflows. From a technical standpoint you will ideally possess/or aspire to learn: Knowledge or experience of Databricks including Unity Catolog and Spark SQL. Programming skills, preferably in Python and SQL. Knowledge and experience in Azure, including working with Azure Data Factory ...

Lead Data Engineer - Hybrid - London - Azure - Databricks - £85k + Bonus I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … volunteering day, extra leave with tenure A high-performance, high-trust environment with global exposure and flexibility Key experience Hands-on experience with Azure & Databricks Strong data engineering and modelling skills Proficiency in Power BI, T-SQL, DAX Provide technical leadership in Agile delivery teams, mentoring engineers and influencing architectural ...

innovative data platform. You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions are scalable … Collaborate with data engineers, architects, and business stakeholders Mentor and coach engineers, fostering a culture of learning and excellence Essential Skills: Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture Strong solution architecture and data platform engineering skills DevOps and automation expertise, including CI/CD, monitoring, and code ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data Modelling. Should also have ...

+ BENEFITS PRIMARILY REMOTE This is a standout opportunity to take ownership of a modern data platform and drive the evolution of a Databricks-centric environment at scale. THE COMPANY: This client are a well-established organisation with a strong engineering culture and a growing Data and Machine Learning function. … make a visible impact while continuing to grow your expertise THE ROLE: You will focus on the design, build and optimisation of the Azure Databricks Lakehouse platform, ensuring it is scalable, secure and reliable. You will work closely with engineers and stakeholders across the business, providing technical leadership and taking ...

clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically, you can expect to be involved in the following: Designing … developing end-to-end data platform solutions in Azure using Databricks Building and maintaining automation for cluster management, monitoring, tagging, and platform optimisation. Implementing CI/CD and DevOps best practices across data pipelines and platform components. Taking ownership of design decisions and long-term architectural direction. SKILLS AND EXPERIENCE ...

clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically, you can expect to be involved in the following: Designing … developing end-to-end data platform solutions in Azure using Databricks Building and maintaining automation for cluster management, monitoring, tagging, and platform optimisation. Implementing CI/CD and DevOps best practices across data pipelines and platform components. Taking ownership of design decisions and long-term architectural direction. SKILLS AND EXPERIENCE ...

clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically, you can expect to be involved in the following: Designing … developing end-to-end data platform solutions in Azure using Databricks Building and maintaining automation for cluster management, monitoring, tagging, and platform optimisation. Implementing CI/CD and DevOps best practices across data pipelines and platform components. Taking ownership of design decisions and long-term architectural direction. SKILLS AND EXPERIENCE ...

optimise distributed Spark/PySpark batch pipelines for large-scale data processing Write production-grade Python workflows implementing complex, explainable business logic Work with Databricks for job execution, orchestration and optimisation Improve pipeline performance, reliability and cost efficiency across high-volume workloads Collaborate with engineers and domain specialists to translate … stack exposure (SQL, Pandas/NumPy + PySpark; Dask/Polars/DuckDB a bonus) build, schedule and optimise Spark/PySpark pipelines in Databricks (Jobs/workflows, performance tuning, production delivery) Hands-on experience with distributed systems and scalable data processing (Spark essential) Experience working with large-scale/ ...

data and analytics strategy , aligned to business goals Leading the design and evolution of a Microsoft Azure data platform Providing architectural oversight across Databricks, Fabric, data pipelines, and warehousing Taking full ownership of Power BI and the semantic layer (models, DAX, performance, governance) Defining standards for data modelling, quality, security … Analytics Lead , with strong experience in Microsoft's data ecosystem. You'll bring: Hands-on experience with Azure data services Strong knowledge of Databricks (ingestion, transformation, optimisation) Experience with Microsoft Fabric (or a strong interest in leading its adoption) Advanced SQL and data modelling skills (dimensional/star schemas) Deep ...

learning models in a live environment. What you'll be doing as the Machine Learning Engineer: Developing and maintaining API services using Azure and Databricks Managing caching layers with Azure Cache (Redis) Using Delta Live Tables for data processing and analytics Integrating with cloud-based data storage solutions like Snowflake … deployments via Azure DevOps (GitHub) What we're looking for from the Machine Learning Engineer: Solid experience in ML Ops, particularly with Azure and Databricks Familiarity with Postgres, Redis, and Snowflake Understanding of Delta Lake Architecture, Docker, and container services Experience building and orchestrating APIs Strong problem-solving and communication ...

Data Engineer in Dublin for a 6-month contract. In this role, you will be responsible for building innovative cloud-native solutions using Azure, Databricks, and PowerBI. The position requires 8 to 12 years of experience in data engineering and strong skills in Databricks and Azure. This is a senior ...

Lead Data Engineer/Solution Architect, Contract, Databricks, Azure, Data Engineering We’re hiring a Lead Data Engineer/Solution Architect on a contract basis. Primus Core is a delivery-led Data & AI consultancy, built around the Databricks ecosystem. We work with organisations that actually want their data platforms … senior, with Solutions Architecture skills but still hands-on. What you’ll be doing; Leading the design and build of modern data platforms, largely Databricks-based Acting as the technical lead on client work — setting direction, standards, and approach Staying close to the code: pipelines, optimisation, reviews, design decisions Working ...

technically advanced multi-award-winning company going through an extended period of growth. Key responsibilities: Design, develop, and maintain data architectures using Azure Databricks and Synapse. Collaborate with cross-functional teams to understand data requirements and translate them into robust architectural solutions. Optimize data workflows and ensure seamless integration with … development team. Conduct performance tuning and optimization of data processes. Skills required: Proven experience as a Data Architect working within Azure. Expertise in Azure Databricks and Azure Synapse. Strong understanding of Datamodelling, ETL processes, and data warehousing concepts. Proficiency in SQL, Python, and other relevant programming languages. Experience with data ...

Data Engineer - Hybrid (Oxfordshire) - Databricks, Python, Spark, SQL - up to £70k + Benefits Why this company? You'll be joining a growing organisation where data is at the heart of every strategic decision. This isn't a place where you're just maintaining pipelines, you'll help shape their entire … chance to build things properly, you'll feel at home here. You'll work with: Designing and delivering scalable data solutions on Databricks Building and maintaining robust data pipelines and ETL workflows Working closely with senior data leaders on architecture and strategy Translating architectural designs into high-quality build plans ...

cloud-native environment. This is an opportunity to lead by example - balancing strategic direction with technical delivery - while working with an advanced Azure and Databricks ecosystem. You'll play a key role in building scalable, reliable, and high-value data solutions that support analytics, reporting, and data-driven decision-making … Lead and mentor a team of data engineers, driving best practices and technical excellence. Remain hands-on in solution design, development, and optimisation using Databricks and Azure data services. Oversee the build and maintenance of data pipelines, ingestion frameworks, and transformation workflows. Collaborate with architecture, analytics, and product teams ...

technically advanced multi-award-winning company going through an extended period of growth. Key responsibilities: Design, develop, and maintain data architectures using Azure Databricks and Synapse. Collaborate with cross-functional teams to understand data requirements and translate them into robust architectural solutions. Optimize data workflows and ensure seamless integration with … development team. Conduct performance tuning and optimization of data processes. Skills required: Proven experience as a Data Architect working within Azure. Expertise in Azure Databricks and Azure Synapse. Strong understanding of Datamodelling, ETL processes, and data warehousing concepts. Proficiency in SQL, Python, and other relevant programming languages. Experience with data ...

central role in building a robust and scalable data warehouse and data platform as the business evolves. The environment spans Azure and AWS, with Databricks at the core of the data stack. You will work closely with senior engineering, product, and business stakeholders to design future proof data architectures that … doing • Defining and owning the technical strategy for the data platform across ingestion, processing, and analytics • Designing scalable, secure, and high performance architectures using Databricks and distributed data systems • Building and overseeing robust data ingestion pipelines using PySpark, with a strong focus on reliability and accuracy • Ensuring ...

champion best practices across projects. Architect, implement, and optimize Azure-based solutions, with strong focus on Containers and App Services/Functions. Use Databricks for data modelling, transformation, and advanced analytics. Build and maintain CI/CD pipelines using Azure DevOps for seamless, reliable deployments. Apply cloud security best practices … software development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...