151 to 175 of 245 Permanent Databricks Jobs

environments Hands‐on background with: Microsoft Power Platform/Dynamics, REST, SOAP, and Web API integrations, Azure Integration Services, Azure DevOps, Azure Service Bus, Databricks, Jitterbit, SQL Server, C#, ASP.NET, JavaScript, XML Experience delivering engineering work within large IT change portfolios Strong understanding of SDLC, automation, DevOps, pipelines, and engineering ...

environments Hands-on background with: Microsoft Power Platform/Dynamics, REST, SOAP, and Web API integrations, Azure Integration Services, Azure DevOps, Azure Service Bus, Databricks, Jitterbit, SQL Server, C#, ASP.NET, JavaScript, XML Experience delivering engineering work within large IT change portfolios Strong understanding of SDLC, automation, DevOps, pipelines, and engineering ...

systems analysis and solution design Proven experience designing and supporting Microsoft Azure based platforms Hands-on exposure to Data & AI technologies, such as: Azure Databricks/Microsoft Fabric Enterprise AI tooling (e.g. Copilot, Foundry, Bedrock or equivalent) Databases (SQL Server and/or Oracle) Experience with identity, security and risk ...

experimentation through to production deployment, enabling AI-powered features at scale. Design, build, and maintain the core infrastructure that powers our ML services (e.g., Databricks, AWS, Ray, Kubernetes). Develop robust observability and experimentation frameworks to ensure reliable model deployment, monitoring, and continuous iteration. Partner closely with Data Science teams ...

teams, and external partners (Microsoft) to ensure high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 … OneLake governance •Ability to translate business requirements into technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

owner for our Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/FCA, DAMA). Data Governance & Compliance … Essential Proven experience leading data functions in financial services or other regulated environments. Deep technical expertise across the Microsoft Azure data ecosystem, including ADF, Databricks, Synapse, SQL, ADLS, and DevOps CI/CD. Understanding of Microsoft Purview governance, lineage, classification and policy controls. Hands-on leadership across Microsoft Fabric-lakehouse ...

optimal AI application performance. Advise peers and senior management on business and customer impact. Write production-grade Python code, leveraging CI/CD, Databricks, and ensuring appropriate test coverage; proficiency in SQL. Liaise with third-party partners and stay updated on field advancements and regulations. Collaborate with data governance … offerings by 3rd party vendors. Knowledge of OO programming and software design, i.e., SOLID principles. Knowledge and working experience of AGILE methodologies. Familiarity with Databricks, and RAG application architecture a plus Experience with latency optimisation and quantisation preferred Additional Information What’s in it for you?: Competitive salary that reflects ...

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Experience Level: 3+ years Please Note: Due to the nature of client work you will be undertaking, you will need to be willing ...

AWS Data Engineer (Innovation Group) Location: London (Hybrid – 3 days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our ...

Modeller Analytical Solutions to lead the design of enterprise-scale analytical data models for our new data platform built on Azure Data Stack (Azure Databricks & Microsoft Fabric). While our current ecosystem is a Microsoft-centric environment, we are looking for a candidate whose expertise is rooted in foundational data ...

networking, and security Experience with Microsoft Entra ID and Infrastructure as Code (Terraform, Bicep, or ARM) Knowledge of modern data platforms (Microsoft Fabric, Azure Databricks, Data Lake) Exposure to Azure AI/OpenAI solutions Experience in a client-facing consulting role AZ-305 certification preferred Security Clearance Candidates must hold ...

engagement capability across all levels Proactive, hands-on mindset with willingness to get involved in both business and technical detail Interest in tools like Databricks, Informatica, and Excel-based governance templates Curiosity, initiative and a desire to grow alongside a maturing data governance function Click"APPLY" OR Email ...

applications from DV Cleared candidates with experience of one or more of the major cloud platforms. AWS, Azure and GCP depending on the project Databricks, Snowflake and Synapse Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or Kinesis You're expected to pick ...

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K North Lincolnshire/Hybrid (2 days onsite) Major performance, optimisation & AI-driven projects Are you a Data Engineer who loves solving performance challenges, optimising compute, and getting stuck into large-scale data environments? This one is very much for the techies … make smart architectural decisions that genuinely impact runtime and cost. Tech-wise, you'll have hands-on experience with a modern cloud ecosystem. ideally Databricks (but AWS, Azure or GCP equivalents are absolutely fine). You'll understand how to optimise Spark, improve compute efficiency, and ensure pipelines are robust ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data Engineer … high-performance data platform. WHAT WILL YOU BE DOING? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka ...

Fabric Develop and optimize ETL/ELT processes for large-scale datasets Work with Lakehouse architectures (Medallion - Bronze, Silver, Gold) using Fabric or Azure Databricks Integrate data from multiple sources using Azure Data Factory/Fabric Data Pipelines Build and maintain data models and Lakehouse structures in OneLake Ensure data … with Delta Lake/Lakehouse architectures Experience with CI/CD and DataOps practices (Azure DevOps or GitHub) Nice to have Experience with Azure Databricks Knowledge of Terraform or Bicep Experience with Microsoft Purview or data governance tools Azure Data certifications (DP-203, DP-600, DP-700) Additional Information ...

right at the start of our data journey. Not maintaining something someone else built five years ago, but designing and building a modern Databricks Lakehouse on Azure from the ground up and we need a Data Engineer who's as curious about why we're doing … better tool to solve a problem you'll fit right in. What you'll bring You'll likely have: Hands-on expertise with Databricks Confidence in Python, Spark and SQL Experience building pipelines in Azure A solid understanding of data modelling and scalable architectures But just as important ...

/LLMOps discipline to include model versioning (model registry), dataset versioning, prompt management, and experiment tracking to support a robust experimentation environment. Utilize Azure Databricks for data processing, model training, fine-tuning, and deployment, optimizing resources for efficient and cost-effective generative AI solutions. Design and maintain scalable, high-performance … techniques, and applying models for personalization, automation, and semantic understanding. Experience with pipeline automation, data flow monitoring, and hands-on use of Azure Databricks for data processing, training, and deployment of generative models. Familiarity with cloud infrastructure management, preferably within the Azure ecosystem, and strong programming experience with Python ...

Responsibilities Define and evolve the enterprise-wide data and analytics architecture, strategy, and roadmap. Lead the development of a modern data platform using Azure, Databricks, Power BI, and SAP data sources. Build robust data pipelines and integration models leveraging Azure Synapse, Data Factory, and automation tools. Ensure data governance, security … focused solutions. What Youll Bring Proven success designing and delivering modern, cloud-based data platforms (Azure/AWS/GCP). Deep knowledge of Databricks, Power BI, and enterprise integration tools. A developed understanding of TOGAF or equivalent enterprise architecture frameworks. Hands-on experience in data warehousing, data lakes, data ...

Data Engineer to drive the delivery of key data initiatives across their Azure data platform. This role will play a pivotal part in advancing Databricks development, supporting AI-focused projects, and maintaining Legacy SQL Server data warehouse environments. Key Responsibilities Lead and contribute to data engineering initiatives across the Azure … ecosystem Build, optimise, and maintain Databricks workflows and Python-based data solutions Enhance existing SQL Server data warehouses and support strategic migrations Collaborate with cross-functional teams to enable AI and analytics-driven outcomes What We're Looking For Proven experience as a Data Engineer Strong hands-on expertise ...

rating on Glassdoor Strong focus on culture & organisational health Leadership: Co-Founders have scaled from $0 - $350 million acquisition (2 exits) Same VC as Databricks/AppDynamics/Coinbase VP Sales has previously scaled through 3 exits The Role Enterprise Account Executive London based – Hybrid (2-3 days p/ ...

architectural oversight and design input across several delivery teams. Review, write, and work with Python used throughout platform components and frameworks. Develop patterns for Databricks Workflows , supporting their implementation, execution, and platform‐level troubleshooting. If this is a role that suits your skillset, can work onsite 2 days per month ...

ambitious (agentic AI capabilities, multi‐agent orchestration, voice interfaces), and the next wave of capabilities depends on a strong data engineering foundation. A Databricks lakehouse POC is being evaluated (Unity Catalog, Delta Sharing, PrivateLink to RDS), and the team is assessing the right long‐term analytics platform strategy. This role … estate with per‐client schemas (local, global, corporate). The new platform targets Aurora PostgreSQL, with several modules already migrated. Pipelines must bridge both. • Databricks/Apache Spark — a lakehouse POC is being evaluated with Unity Catalog and Delta Sharing via AWS PrivateLink. Experience with Databricks or equivalent analytics platforms ...