326 to 350 of 1,447 Permanent Databricks Jobs

reusable data products for analytics, reporting, and machine learning pipelines Implement query tuning, indexing, partitioning, and caching strategies in platforms such as Snowflake and Databricks Collaborate with data scientists, engineers, and business teams to deliver analytics-ready datasets Establish and enforce data governance practices aligned with SOC 2 and GDPR … Implement access controls, data lineage tracking, and encryption standards Build resilient automated workflows using Step Functions and Databricks Workflows Implement monitoring, logging, and alerting systems for reliability and data quality Guide junior engineers and contribute to internal knowledge-sharing initiatives Stay current with emerging technologies and champion continuous improvement ...

. Key Responsibilities Azure Platform Support & Monitoring Support and maintain Azure-based data solutions, including Azure Data Factory pipelines, datasets, linked services, triggers; Azure Databricks (Spark jobs, notebooks, clusters); Azure Machine Learning models and endpoints; Power BI dashboards and dataset refreshes. Monitor and troubleshoot failures in pipelines, jobs … workflows using Azure Monitor, Log Analytics, and custom alerting. DevOps & Automation Maintain CI/CD pipelines using Azure DevOps, GitHub Actions, etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations ...

Experience in data engineering, data solution design, or data architecture roles, with strong expertise in Microsoft Azure data services and modern cloud platforms (e.g. Databricks) Good understanding of end-to-end data architecture, including ingestion, transformation, storage, modelling, and reporting Experience with Azure services such as Data Factory, Databricks, Synapse ...

help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit their … exciting opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

lakehouse architectures. Good understanding of data governance, data quality and data management frameworks. Strong SQL skills and experience using Python or PySpark. Experience with Databricks and Microsoft data technologies. Understanding of how modern data platforms support AI and machine learning workloads. Strong workshop facilitation, communication and stakeholder management skills. Excellent … identity and security. Experience leading customer workshops, discovery engagements and advisory sessions. Consultancy or professional services background strongly preferred. Public sector experience desirable. Certifications: Databricks certifications desirable. Microsoft certifications such as DP-203, DP-700 or related data certifications desirable. Azure AI and Machine Learning certifications advantageous. Security Clearance: Must ...

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorganChase within the Credit data ...

Regulatory Financial Control (ERFC)/Strategic Data team, you will play a crucial role in designing, developing, and maintaining scalable data processing solutions using Databricks, Python, and AWS. You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. Job responsibilities Execute creative … think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting and analytics. Write secure, high ...

Regulatory Financial Control (ERFC)/Strategic Data team, you will play a crucial role in designing, developing, and maintaining scalable data processing solutions using Databricks, Python, and AWS. You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. Job responsibilities Execute creative … think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting and analytics. Write secure, high ...

Senior Data Engineer Role (Python/Spark/Databricks) - Hybrid - Contract - Banking Role - Senior Data Engineer Rate - £850 p/d (Inside IR35) Duration - 6 months with very likely extension Location - Hybrid/Liverpool Street (London) - 3 days per week in a Liverpool Street office About the Role Global financial … delivering critical data platforms and analytics capabilities across the business. This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved in the design, development, optimisation and support of enterprise-scale data platforms, working alongside ...

Senior Staff Software Engineer - Unity Catalog Runtime Enforcement London, United Kingdom RDQ127R176 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building … lead Unity Catalog Runtime Enforcement. We build and harden the runtime enforcement layer for Unity Catalog, ensuring secure, consistent authorization and data access across Databricks compute, engines, and clouds. This reduces incidents and simplifies customer choices by unifying enforcement semantics. The impact you will have Lead and grow an engineering ...

Aubay UK is seeking an experienced Tech Lead (Azure Databricks Data Platform) to lead the design, development, and delivery of enterprise-scale data platform solutions leveraging the Azure Data Platform and Databricks ecosystem. The successful candidate will be responsible for providing end-to-end technical leadership across data engineering initiatives … requirements into scalable, high-performance data solutions that support critical business operations and analytics capabilities. This role requires deep hands-on expertise in Azure Databricks, Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL, alongside strong stakeholder management and leadership skills. The ideal candidate will have a proven track ...

données recherche un ingénieur senior. Vous serez responsable de la gestion des données et du développement de solutions sur les plateformes Azure comme Databricks, ADF, et Synapse. Vous devez posséder une solide expérience en ingénierie des données, particulièrement avec Python, SQL et Power BI. Ce poste est basé au Royaume ...

London, Sheffield and Bristol. You will translate complex technical concepts for non-technical audiences, design end-to-end data platforms using Fabric, Azure Synapse, Databricks and Power BI, and build robust ETL/ELT pipelines with strong data governance. #J-18808-Ljbffr ...

data engineer to design, build, and support scalable data pipelines powering Moody’s next-generation digital content platform. You will develop data workflows using Databricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS to turn diverse data sources into reliable analytics. You will collaborate with cross-functional teams ...

Microsoft Data & AI consultancy, seeks a Senior Consultant for client engagements across sectors. You will design modern data platforms using Microsoft Fabric, Azure Databricks and Power BI, lead workshops, and drive architecture discussions. Occasional UK and international travel may be required. Strong communication and consulting skills are essential. The role ...

with cross-functional teams to turn data into insights, build end-to-end data solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse, and Databricks, and develop Power BI dashboards for stakeholders. #J-18808-Ljbffr ...

Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Senior Manager, Databricks Architect, AI&Data, FS Location: London Other locations: Primary Location Only Date: 9 Aug 2026 Requisition ID: 1639394 At EY, we’re all in to shape your future with … take your career wherever you want it to go. Join EY and help to build a better working world. Senior Manager – Data Engineering – Databricks Architect London/Edinburgh The opportunity The EY Financial Services AI & Data team is continuing to grow and develop unique advisory propositions aligned to market needs ...

Extensive experience as an Enterprise Data Architect within large, complex organisations Previous line management or leadership experience Strong Azure data platform expertise, including Azure Databricks Experience designing modern lakehouse and enterprise data architectures Strong understanding of data governance, metadata, MDM and enterprise data modelling Experience supporting AI/ML initiatives ...

Extensive experience as an Enterprise Data Architect within large, complex organisations Previous line management or leadership experience Strong Azure data platform expertise, including Azure Databricks Experience designing modern lakehouse and enterprise data architectures Strong understanding of data governance, metadata, MDM and enterprise data modelling Experience supporting AI/ML initiatives ...

data ingestion, transformation, orchestration and SQL based development Experience working with senior stakeholders, Enterprise Architecture and governance functions Bonus, experience with Microsoft Fabric, Databricks or Azure Synapse This is a Permanent role, with hybrid working based in London. Paying around ...

level Python skills (pandas, NumPy, scikit-learn, etc.) and strong statistical grounding. ·Experience working within cloud or modern data environments (Microsoft Fabric, Azure, or Databricks). ·Clear, impactful communication skills to bridge technical models and business outcomes. This is an exceptional opportunity for a candidate who wishes to help shape ...

genuine interest in developing into an architectural role Experience working closely with Data Engineers, Analytics teams, and business stakeholders Exposure to Microsoft Fabric, Databricks, Python, PySpark, or dbt would be beneficial Experience with data modelling tools such as Sparx EA, Sparx Enterprise Architect, Enterprise Architect, ER/Studio, ERwin, Erwin ...

integration design Using Python and SQL to build robust, scalable AI and data solutions Working with cloud platforms such as AWS, Azure, GCP or Databricks Supporting MLOps, LLMOps, CI/CD and software engineering best practice Collaborating with technical and non-technical stakeholders across complex programmes Helping identify technical, delivery ...

squads SupportML and GenAI infrastructure and workflows Skills and experience as the Senior Data Engineer: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end-to-end data modelling experience Experiencebuilding batch and real-time ...

years in Azure cloud; 5+ years in AI/ML. Hands‐on with Azure OpenAI, Azure AI Foundry, Document Intelligence, Data Factory, ML Service, Databricks, Key Vault, Blob Storage, Synapse Analytics, DevOps. Strong LLM, embeddings, RAG, prompt engineering knowledge. Expertise in secure API/event‐driven design, microservices, DDD. Experience ...