251 to 275 of 394 Databricks Jobs

Based We are seeking a Senior Developer to lead the construction of an orchestration layer for a project. The role involves implementing GraphQL over Databricks and utilising Generative SQL to handle complex messaging (XML to JSON and JSON to JSON) for third-party application integration click apply for full ...

technically advanced multi-award-winning company going through an extended period of growth. Key responsibilities: Design, develop, and maintain data architectures using Azure Databricks and Synapse click apply for full job details ...

BuildandenhancebackendservicesusingJavaand/orScala Developmodern,responsiveuserinterfacesusingAngularorsimilarframeworks Workwithdistributedcomputeanddataprocessingtechnologies Contributetocloud-nativesolutionshostedonAzure Collaboratewithcross-functionalteamsincludingproductowners,architects,anddataengineers Ensurehighstandardsofcodequality,performance,andsecurity RequiredSkills&Experience StrongFullStackdevelopmentexperience BackenddevelopmentwithJavaand/orScala FrontenddevelopmentusingAngularorasimilarmodernJavaScriptframework Experiencewithdistributedcomputeconceptsandtoolssuchas: ApacheSpark Databricks ApacheBeam(orsimilar) SolidexperiencewithAzurecloudtechnologies Databaseexperiencewithcloudandrelationaldatabases,e.g.Snowflake,Sybase,orsimilar GoodworkingknowledgeofUnix/Linuxenvironments NicetoHave Experienceworkingwithinfinancialservicesorregulatedenvironments FamiliaritywithCI/CDpipelinesandDevOpspractices Exposuretolarge-scaledataplatformsoranalyticssystems WhatsonOffer CompetitiveinsideIR35dayrate Hybridworkingwithastrongon-siteengineeringculture Opportunitytoworkoncomplex,enterprise-scalesystems Initial6 ...

routing, DNS, VPNs, and network security concepts is also essential. Practical experience of managing Azure Key Vault (network-restricted vaults, policies, integrations) & Azure Databricks (VNet injection, private endpoints, secure data access) is required for this role. You will ideally be a Microsoft Certified: Azure Solutions Architect. Please apply ASAP ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF ...

will initially be for 6 months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers …/CD, version control, and automated testing for data pipelines Required Qualifications • 3+ years of experience as a Data Engineer • Strong experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda ...

Lead Data Warehouse Solution Architect, you will ensure the stability of current Medicaid reporting while building the future-state Azure Synapse and Databricks Lakehouse. 2. Key Responsibilities A. Legacy Maintenance & Operational Excellence (Current State) ETL Management: Maintain, troubleshoot, and modify complex SSIS packages handling high-volume Medicaid claims, provider … state compliance reporting remains uninterrupted. B. Modernization & Migration Execution (Future State) Cloud Development: Implement "Medallion Architecture" (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL) as designed by the Lead Architect. Pipeline Refactoring: Lead the transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks notebooks. ...

DevOps, and Site Reliability Engineering within the App Reporting team. You will be responsible for maintaining, improving, and operating critical data platforms - primarily Azure Databricks and Palantir Foundry - ensuring they are reliable, scalable, secure, and fully automated. The role focuses heavily on platform reliability, infrastructure as code, and operational excellence … incident management, automation of manual processes, and continuous improvement of platform tooling and workflows. Key Responsibilities Platform Engineering & Reliability Maintain and improve the Azure Databricks and Palantir Foundry platforms to ensure reliability, performance, and scalability Act as a Site Reliability Engineer for the data platforms, ensuring systems run as intended ...

Python daily to explore data, identify trends, and deliver actionable insights that drive financial decision-making. The team is modernising their data platform with Databricks and Medallion Architecture. Key Responsibilities Build analytical solutions across 4 finance areas: Accounts Payable, Cash Accounting, Commercial Services, and Operations. Perform SQL-based data exploration … dashboards to visualise financial metrics. Support analysis by exploring trends and anomalies. Engage with stakeholders to gather requirements and deliver analytical outputs. Current Projects Databricks Modernisation: Exposure to Databricks as the team builds Gold Standard Medallion Architecture. Self-Service Analytics: Reducing queries (currently 60-70% of workload). BAU Finance ...

data pipelines that directly underpin operational decision-making and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability … operational outputs from these platforms. Technical requirements Proven experience as a Data Engineer in production environments. Strong Python and SQL skills. Hands-on Databricks experience (DLT, Delta Lake; Unity Catalog desirable). Solid understanding of data modelling, data warehousing, and distributed systems. Experience with cloud data platforms (Azure preferred ...

within a cloud-based data platform. Junior Data Engineer duties: Develop, test, and maintain scalable data pipelines using Python and PySpark within an Azure Databricks development environment Clean, aggregate, and transform complex datasets to meet business requirements. Assist with data quality checks and support data validation requests. Work alongside different … inconsistencies. 0-2 years hands on experience in a data engineering/analytics role or equivalent academic/project experience. Desired Skills: Experience with Databricks or similar cloud-based data platforms like Azure, AWS, or GCP. Exposure to Git workflows, CI/CD pipelines, or source control principles more generally. ...

heard and your career can grow. In this role, you will be responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work … successful in this role, you will have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package ...

heard and your career can grow. In this role, you will be responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work … successful in this role, you will have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package ...

heard and your career can grow. In this role, you will be responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work … successful in this role, you will have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package ...

Build, test and validate predictive, diagnostic and prescriptive models using statistical and machine learning techniques. Deploy and maintain models within a modern cloud environment (Databricks/Azure) using CI/CD best practice. Create clear, actionable insights for both technical and non-technical audiences. Integrate data science outputs into wider … experience using scikit-learn, pandas, PySpark or similar. Solid SQL skills and experience working with cloud environments (Azure advantageous). Hands-on experience with Databricks, model deployment and production workflows. Strong understanding of statistical modelling, ML methods and feature engineering. Experience working with Large Language Models, RAG, vector databases ...

significant scaling challenges and modernise a mission-critical platform using: Core stack: .NET, C#, SQL Server, REST APIs Data engineering tools: Azure Data Factory, DataBricks Cloud: Microsoft Azure (Functions, Logic Apps, Service Bus Serverless) If you love hands-on coding, owning delivery, and mentoring others, this could be the role … data models Design and build scalable, secure applications using C# and .NET Build and enhance data pipelines and integrations using Azure Data Factory/DataBricks Implement clean, maintainable code using SOLID principles and design patterns Collaborate with architecture and product teams to deliver high-quality software at pace Refactor ...

technical audiences. Willingness to travel internationally as needed. Preferred Master’s or Ph.D. in a quantitative discipline. Experience with enterprise data platforms (e.g., Snowflake, Databricks, BigQuery). Experience evaluating or integrating third-party data, research, or AI vendors. 15+ years in investment management workflows. Knowledge of advanced RAG and multi … agent systems. Relevant certifications (Databricks GenAI, SnowPro GenAI, AWS ML). CFA charterholder or active candidate. ...

Role: Data Engineer Salary: Up to £70000 Technology - Databricks, Data Factory, SQL, Python Location: Birmingham Working Pattern: Hybrid - 2 days a week in the office. The Role: In this role, you will play a critical part in designing and delivering a high-performance, scalable data platform that underpins Intelligence Platform … data presentation, supporting globalisation requirements across the platform. Explore and implement AI-driven capabilities to improve data accuracy, productivity, and insight generation. Requirements: Azure Databricks SQL/Python ELT/ELT Data Factory Benefits Bonus scheme/Share scheme 25 days holiday plus all UK bank holidays 4x life assurance ...

Python daily to explore data, identify trends, and deliver actionable insights that drive financial decision-making. The team is modernising their data platform with Databricks and Medallion Architecture , giving you exposure to cutting-edge technologies. Key Responsibilities Build analytical solutions and reporting across 4 finance areas: Accounts Payable, Cash Accounting … trends and anomalies. Engage with stakeholders to gather requirements and deliver analytical outputs. Contribute to self-service analytics and data literacy initiatives. Current Projects Databricks Modernisation: Exposure to Databricks as the team builds Gold Standard Medallion Architecture. Self-Service Analytics: Reducing ad-hoc queries (currently 60-70% of workload ...

An exciting opportunity has arisen for an experienced Data Solution Architect to become part of the National Data and Analytics (NDA) Platform & Engineering Team.The NDA Platform & Engineering Team is working on providing data to drive ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data Modelling. Should also have … understand the data needs of the business. Skills Required Include - Very strong knowledge of data modelling, data engineering and data design. Excellent knowledge of Databricks and Performant SQL. Experience analysing complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data Modelling. Should also have … understand the data needs of the business. Skills Required Include - Very strong knowledge of data modelling, data engineering and data design. Excellent knowledge of Databricks and Performant SQL. Experience analysing complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile ...

operate production-grade data products across customer, commercial, financial, sales, and broader data domains. This role is hands-on and heavily focused on Databricks-based engineering, data quality, governance, and DevOps-aligned delivery. You will work closely with the Data Engineering Manager, Product Owner, Data Product Manager, Data Scientists, Head … decision-grade datasets embedded in business processes and trusted for reporting, analytics, and advanced use cases. Key Responsibilities Design, build, and maintain pipelines in Databricks using Delta Lake and Delta Live Tables. Implement medallion architectures (Bronze/Silver/Gold) and deliver reusable, discoverable data products. Ensure pipelines meet ...

ability to work with cross-functional teams to deliver high-quality data solutions.Key Responsibilities:Design and Development: Design, develop and optimise ETL processes using Databricks Develop data pipelines to extract, transform, and load into Data lakes and other data storage solutions Implement best practices for data management, data governance … advancements in data engineering, data platforms and big data technologies Evaluate and improved existing data processes Essential Experiences: Advanced SQL skills Proficient in Databricks, including Spark, Delta Lake and MLflow Experience migrating SSIS to Databricks In depth understanding of ETL/ELT processes Knowledge of data warehousing concepts and architectures ...