276 to 300 of 388 Databricks Jobs

Role: Lead Data Engineer - Azure/Databricks Location: Sheffield Working Model: Hybrid - 2 days per week in person Salary: Up to £85k depending on experience Own the data platform. Shape the future architecture. This role is for a hands-on data engineering leader who wants to build something properly … others while staying deeply technical, this role is built for you. What youll be working on Architecting and rebuilding the data transformation layer in Databricks Designing robust data flows that support both real-time operational views and deep historical analysis Moving pipelines from ad-hoc scripts to software-engineering standards ...

significant scaling challenges and modernise a mission-critical platform using: Core stack : .NET, C#, SQL Server, REST APIs Data engineering tools: Azure Data Factory, DataBricks Cloud : Microsoft Azure (Functions, Logic Apps, Service Bus Serverless) If you love hands-on coding, owning delivery, and mentoring others, this could be the role … data models Design and build scalable, secure applications using C# and .NET Build and enhance data pipelines and integrations using Azure Data Factory/DataBricks Implement clean, maintainable code using SOLID principles and design patterns Collaborate with architecture and product teams to deliver high-quality software at pace Refactor ...

processes to improve performance, scalability, and efficiency. Contribute to migrations and modernisation projects across cloud and data platforms (e.g. AWS, Azure, GCP, Snowflake, Databricks). Create and maintain documentation aligned with internal processes and change management controls. Experience & Technical Skills Proven hands-on experience as a Data Engineer … modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect ...

advice on expected interview topics/questions. Main Duties and Responsibilities Analyse complex datasets to expose insights using a skillset composed of SQL, Python, Databricks and visualisation tools (Power BI, Tableau). Investigate and reconcile data across operational databases, the data lake, and the lakehouse to support business and data … analysts, data governance and subject matter experts to resolve issues and produce clean documentation to foster knowledge transfer. Skills and Experience SQL (advanced), Azure Databricks (advanced), Excel (advanced), Python (intermediate) Extensive experience using visualisation tools (Power BI, Tableau) with qualifications preferable Bachelor’s or master’s degree in a STEM ...

have time to learn. Required Experience Experience working in a Managed Service team supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions … C#), SQL (including SSAS, SSIS & SSRS) Azure infrastructure (VMs, VNETs, certificates etc...,) ITIL v3/v4 Foundation Microsoft certifications (DP-203, DP-600 etc.), Databricks certifications Development of enhancements to data pipelines/notebooks & Power BI reports/models Benefits We have a lovely office in Thames Valley Park Company ...

Data Engineer/Data Engineering/Data Consultant/Lakehouse/Delta Lake/Data Warehousing/ETL/Azure/Azure Databricks/Python/SQL/Based in the West Midlands/Solihull/Birmingham area, Permanent role, £50,000 - 70,000 + car/allowance … + 15% bonus. One of our leading clients is looking to recruit a Data Engineer Azure/Databricks click apply for full job details ...

Your responsibilities: Define target-state Azure AI reference architectures leveraging Azure AI Foundry , Azure OpenAI , and Azure AI Document Intelligence for enterprise use cases (IDP, GenAI copilots, knowledge retrieval). Establish standards for RAG architectures ...

Data Architect Azure, Databricks, Permanent, Hybrid West Midlands Data Architect- Azure, Databricks, Azure Data Lake, Azure Data Factory, Spark, Agile. Due to continued growth across the business, this leading edge digital organisation based in the West Midlands is looking to the market for a Data Architect. My client is fully ...

Data Architect – Azure, Databricks, Permanent, Hybrid – West Midlands Data Architect, Azure, Databricks, Azure Data Lake, Azure Data Factory, Spark, Agile. Due to continued growth across the business, this leading edge digital organisation based in the West Midlands are looking to the market for a Data Architect. My client is fully ...

while investing heavily in data-driven transformation. In this role, you'll take ownership of core architecture and engineering practices across a modern Azure-Databricks ecosystem, shaping best practices and governance across the data landscape. You'll collaborate with senior stakeholders to translate strategic goals into scalable solutions and mentor … governance across the organisation. You'll design and develop scalable data pipelines within a modern Azure ecosystem, working with technologies such as Azure Synapse, Databricks, Delta Lake, Unity Catalog, and Databricks SQL. Responsibilities include overseeing pipeline orchestration, implementing data quality controls, monitoring and alerting, and managing data lineage, glossaries ...

This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function. … join a collaborative team that values engineering excellence, autonomy and continuous improvement. The Role As Lead Data Platform Engineer, you will: * Develop and deploy Databricks Lakehouse platform solutions within Azure. * Build and maintain automation for clusters, tagging, monitoring and platform operations. * Architect and design end-to-end data platform solutions ...

This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function. … join a collaborative team that values engineering excellence, autonomy and continuous improvement. The Role As Lead Data Platform Engineer, you will: * Develop and deploy Databricks Lakehouse platform solutions within Azure. * Build and maintain automation for clusters, tagging, monitoring and platform operations. * Architect and design end-to-end data platform solutions ...

modern cloud data platforms, looking to shape and deliver a scalable, secure, and innovative data platform. **You need to have strong experience working with Databricks** You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark … Collaborate with data engineers, architects, and business stakeholders Mentor and coach engineers, fostering a culture of learning and excellence Essential Skills: Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture Strong solution architecture and data platform engineering skills DevOps and automation expertise, including CI/CD, monitoring, and code ...

Data Engineer Hybrid (London) Azure Data Platform - Databricks/Fabric/Synapse - £50,000 - £90,000 Why Join This Company? This is a business that genuinely invests in data, as a core part of how decisions are made. You will be joining a growing data engineering function where modern tooling … supporting data pipelines using Azure Data Factory Developing high-quality, performant SQL for data transformation and modelling Working with modern analytics platforms such as Databricks, Microsoft Fabric, or Azure Synapse Ingesting data from multiple source systems into cloud-based data platforms Collaborating with BI, analytics, and data science teams ...

distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. Secondary Skillset: Experience … Core Java ( Collections, Objects) -Expert Spring -Expert Kafka- Intermediate or above SQL and No SQL DB – Intermediate or above Hands-on with Flink, Spark, Databricks for data processing. ...

distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. Secondary Skillset: Experience … Spring -Expert 4)Kafka- Intermediate or above 5)SQL and No SQL DB – Intermediate or above 6)Hands-on with Flink, Spark, or Databricks for data processing. ...

lead cutting-edge projects, mentor talented engineers and shape the future data strategy. You will play a pivotal role in migrating legacy systems to Databricks, designing scalable architectures and embedding best practices across the team. Longer term, you will help integrate AI and advanced analytics into the organisation's data … keep the organisation ahead of the curve. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Hands-on experience with Databricks and PySpark/Spark SQL. Strong expertise with the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture and performance optimisation. What ...

that is transforming its data landscape. You will be the technical lead on the migration of the company's existing Azure Data Platform to Databricks where you will be responsible for the build of the new platform before overseeing the decommissioning of legacy systems. This is a hands-on engineering … high-performance data pipelines and ETL processes. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Strong hands-on expertise with Databricks and PySpark/Spark SQL. Deep knowledge of the Azure data platform (Data Factory, Synapse, etc.). Solid understanding of data architecture principles and performance ...

consistently high standard and can evolve to meet future needs. The environment The Enterprise Data Platform is built on Microsoft Azure, using Databricks, Microsoft Fabric, and Power BI to deliver trusted, governed data and analytics. What you will be doing ·Setting data engineering standards, patterns, and best practices ·Acting … growth and high quality delivery What we are looking for ·Strong experience designing and building data platforms on Microsoft Azure ·Hands on experience with Databricks and Microsoft Fabric ·Experience working with analytics and reporting tools such as Power BI ·Experience managing and mentoring data engineers ·Excellent communication skills ...

Lead Data Engineer - Hybrid - London - Azure - Databricks - £85k + Bonus I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … volunteering day, extra leave with tenure A high-performance, high-trust environment with global exposure and flexibility Key experience Hands-on experience with Azure & Databricks Strong data engineering and modelling skills Proficiency in Power BI, T-SQL, DAX Provide technical leadership in Agile delivery teams, mentoring engineers and influencing architectural ...

innovative data platform. You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions are scalable … Collaborate with data engineers, architects, and business stakeholders Mentor and coach engineers, fostering a culture of learning and excellence Essential Skills: Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture Strong solution architecture and data platform engineering skills DevOps and automation expertise, including CI/CD, monitoring, and code ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data Modelling. Should also have ...

Role summary This role focuses on designing and delivering a cloud-based data platform using Databricks on AWS , as part of a wider transformation programme spanning systems, processes, and ways of working. You’ll be responsible for shaping the platform architecture, migrating legacy data into the new environment, and ensuring … programme-led environment and combines hands-on engineering with architectural ownership. Key responsibilities Design and architect a secure, scalable AWS-based data platform using Databricks Build and operate pipelines using Databricks, PySpark, Delta Lake, and CI/CD Assess the existing data landscape and define migration approaches Lead early data ...

+ BENEFITS PRIMARILY REMOTE This is a standout opportunity to take ownership of a modern data platform and drive the evolution of a Databricks-centric environment at scale. THE COMPANY: This client are a well-established organisation with a strong engineering culture and a growing Data and Machine Learning function. … make a visible impact while continuing to grow your expertise THE ROLE: You will focus on the design, build and optimisation of the Azure Databricks Lakehouse platform, ensuring it is scalable, secure and reliable. You will work closely with engineers and stakeholders across the business, providing technical leadership and taking ...