351 to 375 of 393 Databricks Jobs

related resources within the Azure Portal, with a strong focus on Azure Storage and data retention across multiple storage tiers; exposure to ADLS, Azure Databricks, and/or Elastic is advantageous. Oversee disk allocation, I/O performance, and storage scaling, identifying and implementing opportunities to improve efficiency and performance. … Practical experience working within the Azure Portal, including managing Azure Storage (Blob, Files, Disks, ADLS Gen2) and supporting broader cloud infrastructure; familiarity with Azure Databricks and Elastic is a plus. Proven experience managing virtual disks and cloud-based storage tiers, including long-term data retention strategies in ADLS. Deep understanding ...

Data Team Lead - Azure - Fabric - Databricks - £70k Lead. Inspire. Deliver. Transform data at scale. This is an exciting opportunity for someone who loves combining leadership, technical delivery, and real impact. If you're passionate about developing people, delivering modern data solutions, and working with cutting-edge Microsoft technologies, this … performance, and development plans Support certification pathways and build a high-performing team culture Get involved in designing scalable solutions using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, SQL Server and more Lead the delivery of cloud migrations, modern data lakes, and end-to-end ETL/ELT pipelines ...

DevOps, Product, and business partners to unlock the value of data through modern, secure and governed pipelines. Lead hands-on development work using Azure, Databricks, and Terraform (IaC) Support the migration from legacy platforms to a more modern cloud stack Act as a mentor and technical guide to the wider … YOUR SKILLS AND EXPERIENCE: A successful Principal Data Engineer will have the following skills and experience: Strong hands-on experience with Azure Proficient in Databricks Skilled in Terraform and Infrastructure as Code practices Exposure to containers/Kubernetes Awareness of ML Ops concepts THE BENEFITS: You will receive a salary ...

office Farringdon, paying up to £110,000 plus benefits. The Mission Own the Strategy: Design the architecture for ingestion, storage, and governance (moving to Databricks/Azure ). Build from Zero: Act as the most senior hands-on developer, writing production-grade Python/Spark code for core pipelines. Create … best practices. Your Toolkit Expertise: 7+ years in Data Engineering with experience in a Lead or Principal capacity. Tech Stack: Deep knowledge of Databricks and the Azure ecosystem (ADF, Synapse, Cosmos DB). Coding: Expert-level Python and SQL ; experience with Terraform and containerization. Complexity: Comfortable handling scientific, geospatial ...

best practices. Design and deliver cloud-native solutions on Microsoft Azure , with a strong focus on containerised services (AKS) , App Services, and Functions. Use Databricks to support data modelling, transformations, analytics, and pricing models. Build, manage, and optimise CI/CD pipelines using Azure DevOps. Apply cloud security, performance … Advanced proficiency in TypeScript/Node.js . Solid experience delivering solutions on Microsoft Azure . Experience with containerised platforms (AKS preferred) . Exposure to Databricks or modern data platforms. Proven ability to mentor engineers and lead by example. Confidence running code reviews and technical design discussions. Strong communication skills, able ...

establish best practice across the organisation's Azure data platform. Key Responsibilities: Design, build and maintain robust ETL pipelines using Azure Data Factory and Databricks Consolidate and transform data from multiple internal and external data sources Ensure data accuracy, quality and compliance with internal governance standards Work closely with business … data processes Contribute to documentation and knowledge sharing within the team Required Skills & Experience: Strong hands-on experience with Azure Data Platform technologies, including Databricks and Data Factory Proven experience working with Telematics, including the ingestion, transformation and modelling of high-volume, time-series data from vehicle, sensor ...

Build, operate, and optimise RAG and LLM-backed services, improving latency, reliability, and cost. Design and run cloud-native AI services across AWS and Databricks, including ingestion and embedding pipelines. Scale and operate vector search infrastructure (Weaviate, OpenSearch, Algolia, AWS Bedrock Knowledge Bases). Implement strong observability, CI/… Required Skills & Experience Strong experience designing and operating cloud-native platforms on AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch). Hands-on experience with Databricks and large-scale data or embedding pipelines. Proven experience building and operating production AI systems , including RAG pipelines, LLM-backed services, and vector search (Weaviate ...

leading the implementation of an Enterprise Data Catalog and managing the transition of business logic from TFS/SSIS to the Azure/Databricks environment. They act as the "Metadata Architect," ensuring that all raw MMIS schemas are translated into governed, auditable, and BI-ready assets. 2. Expanded Key Responsibilities … Medicaid data. Data Lineage Mapping: Document and verify end-to-end data lineage-from the raw MMIS source table through the transformation layer in Databricks to the final PowerBI report. Discovery & Search: Organize the catalog so that policy analysts and actuaries can easily discover Medicaid datasets, understand their sensitivity ...

team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation, and Street Pricing teams to ensure solutions … techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree in Mathematics, Statistics, Engineering, Physics, Computer Science, or Actuarial Science. ...

reliability standards to build sustained trust in analytics and reporting. Own vendor relationships and the BI budget, focusing on Total Cost of Ownership and Databricks compute efficiency. Oversee and ensure timely delivery of month-end data while implementing automation to streamline processes and improve long-term efficiency. Champion … collaboration, data literacy, and innovation. Proven track record of leading global BI functions within technology companies. Deep understanding of modern data stacks, specifically Databricks . Experience leading teams through organizational change, platform migrations, and tool deprecations. Exceptional ability to translate complex data infrastructure concepts into clear business value ...

Senior Data Engineer Contract Dublin Contract 6-24 Months. My client a leading name in their respected industry is in urgent need of a talented and experienced Senior Data Engineer to join them on a ...

Senior Data Engineer Contract Dublin Contract 6-24 Months. My client a leading name in their respected industry is in urgent need of a talented and experienced Senior Data Engineer to join them on a ...

Head of Data Salary: Up to £120,000 + Bonus I am working with a forward-thinking organisation that is modernising its data capabilities to enable scalable analytics, reporting and data-driven decision-making across ...

Lead Data Engineer - Databricks - £75-80k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer with good Databricks expeirence to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: You'll play ...

Data Engineer - Azure/Databricks £550-650/day overall assignment rate to umbrella 6-month contract London-based - flexibility on remote working Working with a market-leading client who are looking for an Azure Data Engineer contractor to work on a large-scale transformation project. Data Engineer, key skills … Good knowledge of a data scripting Language Strong understanding of ETL/ELT processes Experience of Azure MUST have Databricks experience Strong experience with relational and big data engines Knowledge of good data pipeline implementation and design (Concepts such as Kimball/Star Schema) Strong understanding Data warehousing concepts ...

Azure which is enabling the business to do Machine Learning and Analytics. Mentor and upskill junior engineers, promoting engineering standards. Work with Terraform and Databricks to deliver scalable, governed data solutions. Support the development of data pipelines. SKILLS AND EXPERIENCE The successful Principal Data Engineer will have the following skills … experience: Strong commercial experience working with Azure. Proficient in Databricks and Terraform. Confident mentoring and guiding engineers across teams. Exposure to containers and Kubernetes is advantageous. Awareness of ML Ops principles is beneficial. BENEFITS The successful Principal Data Engineer will receive the following: Salary up to £80,000 - depending ...

analytics stack. SAP remains the system of record, but the organisation is actively assessing how best to sit a cloud analytics platform on top Databricks or Microsoft Fabric, with Power BI as the reporting layer. That decision is not yet locked down, and this role will play a key part … core Defining how data is modelled, integrated and exposed from SAP into modern analytics platforms Helping shape the target-state architecture for Databricks or Fabric (rather than just implementing a pre-chosen tool) Setting data modelling standards (conceptual, logical, physical) and ensuring consistency across domains Working closely with data engineering ...

cases Build and maintain high-quality applications using TypeScript Design and manage solutions on Azure, including App Services, Functions, and containers (AKS) Use Databricks to support data modelling, analytics, and actuarial insights Set up and optimise CI/CD pipelines using Azure DevOps Mentor developers, conduct code reviews, and lead … development experience with technical leadership responsibility Advanced TypeScript skills and solid Azure expertise Experience with containers, CI/CD, and data platforms such as Databricks Ability to collaborate with both technical and non-technical stakeholders For a full consultation on this exciting new role, get in touch with ...

cases Build and maintain high-quality applications using TypeScript Design and manage solutions on Azure, including App Services, Functions, and containers (AKS) Use Databricks to support data modelling, analytics, and actuarial insights Set up and optimise CI/CD pipelines using Azure DevOps Mentor developers, conduct code reviews, and lead … development experience with technical leadership responsibility Advanced TypeScript skills and solid Azure expertise Experience with containers, CI/CD, and data platforms such as Databricks Ability to collaborate with both technical and non-technical stakeholders For a full consultation on this exciting new role, get in touch with ...

cases Build and maintain high-quality applications using TypeScript Design and manage solutions on Azure, including App Services, Functions, and containers (AKS) Use Databricks to support data modelling, analytics, and actuarial insights Set up and optimise CI/CD pipelines using Azure DevOps Mentor developers, conduct code reviews, and lead … xkybehq experience with technical leadership responsibility Advanced TypeScript skills and solid Azure expertise Experience with containers, CI/CD, and data platforms such as Databricks Ability to collaborate with both technical and non-technical stakeholders For a full consultation on this exciting new role, get in touch with ...

heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack. Key Responsibilities: Provide technical leadership to a small team focusing on data engineering and development Define and maintain scalable internal data … where required Skills & Experience Required: Strong Data Engineering experience Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks Proven ability to lead and mentor technical teams in agile environments Ability to work closely with other leaders across the business and have input into ...

global consulting firm based in Dublin is seeking a Databricks Engineer, Assistant Manager to design and deliver modern data platforms. The ideal candidate will have over 5 years of experience with Databricks and strong skills in Python or Scala, alongside a proven track record in a client-focused environment. This ...

building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities … smooth productionisation of models. Write clean, production-ready Python code. Apply software engineering best practices, CI/CD, TDD. Required Skills: Proficiency in Python, Databricks, and Azure. Experience with deployment tools (e.g., AKS, managed endpoints). Strong software engineering background (CI/CD, VCS, TDD). Ability to integrate ...

data platforms.* Provide Board-ready recommendations on cloud strategy (Azure vs GCP) and data architecture.* Design and implement a modern cloud data platform with Databricks as the core analytics and AI layer.* Build a production-ready lakehouse architecture optimised for analyst-led use.* Implement secure, scalable ingestion pipelines for structured … extend the platform. Profile * Proven hands-on experience delivering cloud-based analytics platforms end to end.* Strong expertise in Azure and GCP, including Databricks implementation.* Deep understanding of lakehouse architectures, data engineering, and analytics design.* Experience with large datasets, NLP/AI workloads, and geospatial data.* Strong security, governance ...

leading global advisory firm seeks a Databricks Engineer, Assistant Manager in Dublin. This role focuses on designing and delivering data platforms that enable smarter decision-making across industries. Candidates should have over 5 years of experience with Databricks, strong skills in Python or Scala, and familiarity with cloud platforms. ...