326 to 350 of 1,492 Databricks Jobs

large language models Experience with experiment design and conducting A/B tests Experience building shared or platform-style ML systems Experience with Databricks and PySpark Experience working with AWS or another cloud platform (GCP/Azure) Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with ...

scaffolder templates, or plugin development* Familiarity with data platform concepts - medallion architecture, lakehouse patterns, or orchestration tools such as Airflow or dbt* Exposure managing Databricks* Practical experience with AI coding assistants (Claude Code, GitHub Copilot, Cursor, or similar) in a professional engineering context* Experience working in regulated financial services environments ...

including proficiency in Python and experience with core data science and ML libraries (e.g., scikit-learn, pandas, PyTorch or TensorFlow). Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt ...

e.g. Python, Java, C#, Typescript etc.) and understand both domain modelling and application programming. You have working knowledge of data management technologies (SQL, NoSQL, Databricks etc.). You have working knowledge of modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Infrastructure as Code ...

Data Architect/Lead Data Engineer - Databricks Worcester | Hybrid working £70,000 - £80,000 plus bonus and benefits Permanent We are recruiting for a newly created Data Architect position within an established technology-led organisation based in Worcester. This is a hands-on role for someone who can combine data … role You will work across modern cloud data platforms, helping the organisation improve how data is structured, governed, integrated and delivered. The environment includes Databricks, cloud technologies, data lakes, analytics, reporting and emerging AI and machine-learning products. Your responsibilities will include: Defining and evolving data architecture principles, standards ...

JPMorganChase in the United Kingdom is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and architectures within the Compute Infrastructure Platforms team. You will collaborate with agile teams to deliver ...

TD Securities in Belfast is hiring a Senior Data Engineer to help build and evolve the strategic Research data platform using Databricks. You will develop scalable data pipelines, governed data products, and foundational capabilities to ...

A leading asset management firm based in Sheffield is seeking a full-time Technical Lead in Data Engineering. You will architect new data flows, rebuild data pipelines, and mentor a growing team. Key responsibilities include ...

reusable data products for analytics, reporting, and machine learning pipelines Implement query tuning, indexing, partitioning, and caching strategies in platforms such as Snowflake and Databricks Collaborate with data scientists, engineers, and business teams to deliver analytics-ready datasets Establish and enforce data governance practices aligned with SOC 2 and GDPR … Implement access controls, data lineage tracking, and encryption standards Build resilient automated workflows using Step Functions and Databricks Workflows Implement monitoring, logging, and alerting systems for reliability and data quality Guide junior engineers and contribute to internal knowledge-sharing initiatives Stay current with emerging technologies and champion continuous improvement ...

. Key Responsibilities Azure Platform Support & Monitoring Support and maintain Azure-based data solutions, including Azure Data Factory pipelines, datasets, linked services, triggers; Azure Databricks (Spark jobs, notebooks, clusters); Azure Machine Learning models and endpoints; Power BI dashboards and dataset refreshes. Monitor and troubleshoot failures in pipelines, jobs … workflows using Azure Monitor, Log Analytics, and custom alerting. DevOps & Automation Maintain CI/CD pipelines using Azure DevOps, GitHub Actions, etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations ...

Experience in data engineering, data solution design, or data architecture roles, with strong expertise in Microsoft Azure data services and modern cloud platforms (e.g. Databricks) Good understanding of end-to-end data architecture, including ingestion, transformation, storage, modelling, and reporting Experience with Azure services such as Data Factory, Databricks, Synapse ...

help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit their … exciting opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

lakehouse architectures. Good understanding of data governance, data quality and data management frameworks. Strong SQL skills and experience using Python or PySpark. Experience with Databricks and Microsoft data technologies. Understanding of how modern data platforms support AI and machine learning workloads. Strong workshop facilitation, communication and stakeholder management skills. Excellent … identity and security. Experience leading customer workshops, discovery engagements and advisory sessions. Consultancy or professional services background strongly preferred. Public sector experience desirable. Certifications: Databricks certifications desirable. Microsoft certifications such as DP-203, DP-700 or related data certifications desirable. Azure AI and Machine Learning certifications advantageous. Security Clearance: Must ...

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorganChase within the Credit data ...

Regulatory Financial Control (ERFC)/Strategic Data team, you will play a crucial role in designing, developing, and maintaining scalable data processing solutions using Databricks, Python, and AWS. You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. Job responsibilities Execute creative … think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting and analytics. Write secure, high ...

Regulatory Financial Control (ERFC)/Strategic Data team, you will play a crucial role in designing, developing, and maintaining scalable data processing solutions using Databricks, Python, and AWS. You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. Job responsibilities Execute creative … think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting and analytics. Write secure, high ...

Senior Data Engineer Role (Python/Spark/Databricks) - Hybrid - Contract - Banking Role - Senior Data Engineer Rate - £850 p/d (Inside IR35) Duration - 6 months with very likely extension Location - Hybrid/Liverpool Street (London) - 3 days per week in a Liverpool Street office About the Role Global financial … delivering critical data platforms and analytics capabilities across the business. This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved in the design, development, optimisation and support of enterprise-scale data platforms, working alongside ...

Senior Staff Software Engineer - Unity Catalog Runtime Enforcement London, United Kingdom RDQ127R176 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building … lead Unity Catalog Runtime Enforcement. We build and harden the runtime enforcement layer for Unity Catalog, ensuring secure, consistent authorization and data access across Databricks compute, engines, and clouds. This reduces incidents and simplifies customer choices by unifying enforcement semantics. The impact you will have Lead and grow an engineering ...

Aubay UK is seeking an experienced Tech Lead (Azure Databricks Data Platform) to lead the design, development, and delivery of enterprise-scale data platform solutions leveraging the Azure Data Platform and Databricks ecosystem. The successful candidate will be responsible for providing end-to-end technical leadership across data engineering initiatives … requirements into scalable, high-performance data solutions that support critical business operations and analytics capabilities. This role requires deep hands-on expertise in Azure Databricks, Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL, alongside strong stakeholder management and leadership skills. The ideal candidate will have a proven track ...

données recherche un ingénieur senior. Vous serez responsable de la gestion des données et du développement de solutions sur les plateformes Azure comme Databricks, ADF, et Synapse. Vous devez posséder une solide expérience en ingénierie des données, particulièrement avec Python, SQL et Power BI. Ce poste est basé au Royaume ...

London, Sheffield and Bristol. You will translate complex technical concepts for non-technical audiences, design end-to-end data platforms using Fabric, Azure Synapse, Databricks and Power BI, and build robust ETL/ELT pipelines with strong data governance. #J-18808-Ljbffr ...

data engineer to design, build, and support scalable data pipelines powering Moody’s next-generation digital content platform. You will develop data workflows using Databricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS to turn diverse data sources into reliable analytics. You will collaborate with cross-functional teams ...

Microsoft Data & AI consultancy, seeks a Senior Consultant for client engagements across sectors. You will design modern data platforms using Microsoft Fabric, Azure Databricks and Power BI, lead workshops, and drive architecture discussions. Occasional UK and international travel may be required. Strong communication and consulting skills are essential. The role ...

with cross-functional teams to turn data into insights, build end-to-end data solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse, and Databricks, and develop Power BI dashboards for stakeholders. #J-18808-Ljbffr ...

Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Senior Manager, Databricks Architect, AI&Data, FS Location: London Other locations: Primary Location Only Date: 9 Aug 2026 Requisition ID: 1639394 At EY, we’re all in to shape your future with … take your career wherever you want it to go. Join EY and help to build a better working world. Senior Manager – Data Engineering – Databricks Architect London/Edinburgh The opportunity The EY Financial Services AI & Data team is continuing to grow and develop unique advisory propositions aligned to market needs ...