176 to 200 of 307 Databricks Jobs

parties and navigate typical NHS governance and assurance processes There’s also an element of working within a broader data ecosystem, including a Databricks platform managed by the team. Tech Environment Frontend: React, TypeScript Backend: Node.js (TypeScript) Cloud: AWS (serverless) Lambda, Step Functions, API Gateway S3, DynamoDB Cognito, CloudFront Infrastructure ...

platform and will be working across different client setups. Typically, that includes: AWS, Azure and GCP depending on the project Tools like Databricks, Snowflake and Synapse Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or Kinesis You will use your expertise to choose ...

environments Hands‐on background with: Microsoft Power Platform/Dynamics, REST, SOAP, and Web API integrations, Azure Integration Services, Azure DevOps, Azure Service Bus, Databricks, Jitterbit, SQL Server, C#, ASP.NET, JavaScript, XML Experience delivering engineering work within large IT change portfolios Strong understanding of SDLC, automation, DevOps, pipelines, and engineering ...

environments Hands-on background with: Microsoft Power Platform/Dynamics, REST, SOAP, and Web API integrations, Azure Integration Services, Azure DevOps, Azure Service Bus, Databricks, Jitterbit, SQL Server, C#, ASP.NET, JavaScript, XML Experience delivering engineering work within large IT change portfolios Strong understanding of SDLC, automation, DevOps, pipelines, and engineering ...

systems analysis and solution design Proven experience designing and supporting Microsoft Azure based platforms Hands-on exposure to Data & AI technologies, such as: Azure Databricks/Microsoft Fabric Enterprise AI tooling (e.g. Copilot, Foundry, Bedrock or equivalent) Databases (SQL Server and/or Oracle) Experience with identity, security and risk ...

experimentation through to production deployment, enabling AI-powered features at scale. Design, build, and maintain the core infrastructure that powers our ML services (e.g., Databricks, AWS, Ray, Kubernetes). Develop robust observability and experimentation frameworks to ensure reliable model deployment, monitoring, and continuous iteration. Partner closely with Data Science teams ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

teams, and external partners (Microsoft) to ensure high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 … OneLake governance •Ability to translate business requirements into technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with ...

client is looking for an Enterprise Cloud Platform Architect with strong experience across major cloud data platforms (e.g., Databricks, Snowflake, BigQuery). This role will support the Discovery, Design & Implementation phase(s) by assessing current platforms and designing integration and migration patterns for a future connected data platform, with … platform roles, with at least 35 years in architecture-focused positions. Strong hands-on experience with at least two major cloud data platforms (e.g., Databricks, Snowflake, BigQuery) in production environments. Solid understanding of cross-cloud integration patterns (networking, identity, data movement, catalog/governance integration). Experience designing or supporting ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

owner for our Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/FCA, DAMA). Data Governance & Compliance … Essential Proven experience leading data functions in financial services or other regulated environments. Deep technical expertise across the Microsoft Azure data ecosystem, including ADF, Databricks, Synapse, SQL, ADLS, and DevOps CI/CD. Understanding of Microsoft Purview governance, lineage, classification and policy controls. Hands-on leadership across Microsoft Fabric-lakehouse ...

optimal AI application performance. Advise peers and senior management on business and customer impact. Write production-grade Python code, leveraging CI/CD, Databricks, and ensuring appropriate test coverage; proficiency in SQL. Liaise with third-party partners and stay updated on field advancements and regulations. Collaborate with data governance … offerings by 3rd party vendors. Knowledge of OO programming and software design, i.e., SOLID principles. Knowledge and working experience of AGILE methodologies. Familiarity with Databricks, and RAG application architecture a plus Experience with latency optimisation and quantisation preferred Additional Information What’s in it for you?: Competitive salary that reflects ...

AWS Data Engineer (Innovation Group) Location: London (Hybrid – 3 days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our ...

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Experience Level: 3+ years Please Note: Due to the nature of client work you will be undertaking, you will need to be willing ...

seeking a highly skilled and versatile Senior Developer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data click apply for full job details ...

Modeller Analytical Solutions to lead the design of enterprise-scale analytical data models for our new data platform built on Azure Data Stack (Azure Databricks & Microsoft Fabric). While our current ecosystem is a Microsoft-centric environment, we are looking for a candidate whose expertise is rooted in foundational data ...

networking, and security Experience with Microsoft Entra ID and Infrastructure as Code (Terraform, Bicep, or ARM) Knowledge of modern data platforms (Microsoft Fabric, Azure Databricks, Data Lake) Exposure to Azure AI/OpenAI solutions Experience in a client-facing consulting role AZ-305 certification preferred Security Clearance Candidates must hold ...

able to explain how insights should be used-Competent user of NEC Housing Management System-Solid working knowledge of Power BI and Azure Databricks (not necessarily advanced, but well above basic level)-Strong stakeholder management skills-Based near Waterloo office-Hybrid working: only 2 days per week required ...

strong statistical/ML background Integrate external forecasting methods into IBP Support promotions planning , ensuring data and forecasts are correctly incorporated Collaborate with offshore Databricks consultants to deliver production-ready solutions Occasional visits to Walton-on-Thames client site Requirements Experience with SAP IBP Demand and demand planning processes Familiarity ...

engagement capability across all levels Proactive, hands-on mindset with willingness to get involved in both business and technical detail Interest in tools like Databricks, Informatica, and Excel-based governance templates Curiosity, initiative and a desire to grow alongside a maturing data governance function Click"APPLY" OR Email ...

applications from DV Cleared candidates with experience of one or more of the major cloud platforms. AWS, Azure and GCP depending on the project Databricks, Snowflake and Synapse Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or Kinesis You're expected to pick ...

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K North Lincolnshire/Hybrid (2 days onsite) Major performance, optimisation & AI-driven projects Are you a Data Engineer who loves solving performance challenges, optimising compute, and getting stuck into large-scale data environments? This one is very much for the techies … make smart architectural decisions that genuinely impact runtime and cost. Tech-wise, you'll have hands-on experience with a modern cloud ecosystem. ideally Databricks (but AWS, Azure or GCP equivalents are absolutely fine). You'll understand how to optimise Spark, improve compute efficiency, and ensure pipelines are robust ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data Engineer … high-performance data platform. WHAT WILL YOU BE DOING? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka ...

Fabric Develop and optimize ETL/ELT processes for large-scale datasets Work with Lakehouse architectures (Medallion - Bronze, Silver, Gold) using Fabric or Azure Databricks Integrate data from multiple sources using Azure Data Factory/Fabric Data Pipelines Build and maintain data models and Lakehouse structures in OneLake Ensure data … with Delta Lake/Lakehouse architectures Experience with CI/CD and DataOps practices (Azure DevOps or GitHub) Nice to have Experience with Azure Databricks Knowledge of Terraform or Bicep Experience with Microsoft Purview or data governance tools Azure Data certifications (DP-203, DP-600, DP-700) Additional Information ...