201 to 225 of 307 Databricks Jobs

right at the start of our data journey. Not maintaining something someone else built five years ago, but designing and building a modern Databricks Lakehouse on Azure from the ground up and we need a Data Engineer who's as curious about why we're doing … better tool to solve a problem you'll fit right in. What you'll bring You'll likely have: Hands-on expertise with Databricks Confidence in Python, Spark and SQL Experience building pipelines in Azure A solid understanding of data modelling and scalable architectures But just as important ...

/LLMOps discipline to include model versioning (model registry), dataset versioning, prompt management, and experiment tracking to support a robust experimentation environment. Utilize Azure Databricks for data processing, model training, fine-tuning, and deployment, optimizing resources for efficient and cost-effective generative AI solutions. Design and maintain scalable, high-performance … techniques, and applying models for personalization, automation, and semantic understanding. Experience with pipeline automation, data flow monitoring, and hands-on use of Azure Databricks for data processing, training, and deployment of generative models. Familiarity with cloud infrastructure management, preferably within the Azure ecosystem, and strong programming experience with Python ...

Responsibilities Define and evolve the enterprise-wide data and analytics architecture, strategy, and roadmap. Lead the development of a modern data platform using Azure, Databricks, Power BI, and SAP data sources. Build robust data pipelines and integration models leveraging Azure Synapse, Data Factory, and automation tools. Ensure data governance, security … focused solutions. What Youll Bring Proven success designing and delivering modern, cloud-based data platforms (Azure/AWS/GCP). Deep knowledge of Databricks, Power BI, and enterprise integration tools. A developed understanding of TOGAF or equivalent enterprise architecture frameworks. Hands-on experience in data warehousing, data lakes, data ...

Data Engineer to drive the delivery of key data initiatives across their Azure data platform. This role will play a pivotal part in advancing Databricks development, supporting AI-focused projects, and maintaining Legacy SQL Server data warehouse environments. Key Responsibilities Lead and contribute to data engineering initiatives across the Azure … ecosystem Build, optimise, and maintain Databricks workflows and Python-based data solutions Enhance existing SQL Server data warehouses and support strategic migrations Collaborate with cross-functional teams to enable AI and analytics-driven outcomes What We're Looking For Proven experience as a Data Engineer Strong hands-on expertise ...

Data Enablement Lead l Data products l Data Evangelist l Data Literacy l Databricks l Adoption Financial services l Stakeholder management l £680 PD l Outside IR35 l 6 months l Remote One of my international payments companies are rolling out a Data Mesh and need a sharp, people-focused ...

client is looking for an Enterprise Cloud Platform Architect with strong experience across major cloud data platforms (e.g., Databricks, Snowflake, BigQuery). This role will support the Discovery, Design & Implementation phase(s) by assessing current platforms and designing integration and migration patterns for a future connected data platform, with ...

rating on Glassdoor Strong focus on culture & organisational health Leadership: Co-Founders have scaled from $0 - $350 million acquisition (2 exits) Same VC as Databricks/AppDynamics/Coinbase VP Sales has previously scaled through 3 exits The Role Enterprise Account Executive London based – Hybrid (2-3 days p/ ...

architectural oversight and design input across several delivery teams. Review, write, and work with Python used throughout platform components and frameworks. Develop patterns for Databricks Workflows , supporting their implementation, execution, and platform‐level troubleshooting. If this is a role that suits your skillset, can work onsite 2 days per month ...

requires occassional/monthly travel to client site. What you'll work on Build and maintain ELT pipelines using Azure Data Factory and Azure Databricks Develop modular transformations with dbt Model data using Data Vault and Kimball techniques Design and optimise our Enterprise Data Warehouse Implement CI/CD with … Azure DevOps Monitor, troubleshoot and improve pipeline performance Ensure strong governance, security and GDPR compliance Tech stack Azure Data Lake * Databricks * ADF * dbt * SQL * Python/PySpark * Data Vault * Kimball * Git * Azure DevOps What you bring 3-5 years' experience in data engineering Strong SQL and Python/PySpark skills ...

ambitious (agentic AI capabilities, multi‐agent orchestration, voice interfaces), and the next wave of capabilities depends on a strong data engineering foundation. A Databricks lakehouse POC is being evaluated (Unity Catalog, Delta Sharing, PrivateLink to RDS), and the team is assessing the right long‐term analytics platform strategy. This role … estate with per‐client schemas (local, global, corporate). The new platform targets Aurora PostgreSQL, with several modules already migrated. Pipelines must bridge both. • Databricks/Apache Spark — a lakehouse POC is being evaluated with Unity Catalog and Delta Sharing via AWS PrivateLink. Experience with Databricks or equivalent analytics platforms ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse, and utilise data. The role ensures that data solutions are robust and reliable while meeting … platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review Boards. Build and deliver robust data solutions using Databricks, PySpark, Spark SQL, Azure Data Factory, and Azure services. Develop APIs and write efficient Python, PySpark, and SQL code to support data integration, processing ...

analytical product delivery in complex, multi-team environments.* Proven track record delivering analytical and technical outcomes on modern cloud platforms (e.g., AWS, Azure, Snowflake, Databricks).* Strong experience with data migration validation, reconciliation, data controls, and go-live readiness.* Ability to mentor analysts and collaborate effectively with engineers and architects. … agile principles. Qualifications & ToolsExperience with some of the following is beneficial:* SQL/Python, Power BI, Tableau, Qlik, Dataiku, Alteryx* AWS, Azure, GCP, Snowflake, Databricks certifications* SAFe, Scrum Master or similar agile qualifications* Modern data warehousing tools (Fabric, Lake Formation, Snowflake, Databricks)* dbt or equivalent transformation tooling* Airflow/ ...

performance measurement.This is a high-impact greenfield build. You’ll take full ownership of the platform’s design and lead the transition away from Databricks and Excel-centric processes—shaping critical infrastructure that underpins the organisation’s investment operations.What You’ll Work OnYou’ll be responsible for designing and developing … holdings dataPerformance and attribution reportingRisk and analytics outputsRegulatory and trustee disclosuresData governance and operational controlsYou’ll also oversee the migration of structured datasets from Databricks (Delta Lake/Spark) and replace manual Excel workflows with automated, well-governed pipelines to meet audit and regulatory standards.Key ResponsibilitiesBuild and maintain a secure ...

data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). Working closely with Data Science, Product, and Analytics teams, youll ensure reliable, high-performance data flows that power … near shore partners as well as contribute to architectural direction and best practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks ...

warehouses, and data marts. Develop efficient data models and schemas for optimal storage and retrieval. Build scalable ETL pipelines using Azure Data Factory, Azure Databricks, or SQL Server Integration Services (SSIS) to ingest data from various sources into Azure. Ensure data transformation and cleansing processes align with business requirements. Deploy … Azure SQL Database. Optimize data storage and retrieval performance, ensuring security and compliance. Utilize Azure Synapse Analytics (formerly Azure SQL Data Warehouse) and Azure Databricks for big data processing and analytics tasks. Perform data aggregation, enrichment, and analysis to support business intelligence and reporting needs. Monitor data pipelines and storage ...

meet all of these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex … solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

processes using Python and SQL Contribute to the development of internal tools and applications (Python-based) Work with cloud-based data platforms (e.g., Databricks, Spark, Azure) for large-scale processing Managing databases and ensuring data quality and reliability. Collaborate with cross-functional teams to understand data requirements and implement effective … them) Experience with cloud platforms such as AWS , Azure , GCP , or Snowflake . Familiarity with big data tools like Apache Spark and Databricks . Hands-on experience with APIs (e.g., RESTful APIs, GraphQL) and system integration. Knowledge of microservices architecture and containerization tools like Docker or Kubernetes . Exposure ...

Lead Data Engineer - Databricks - £75-80k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer with good Databricks expeirence to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: You'll play … compliance of the systems. You'll play a key role in the ownership of the core architecture/engineering across the new Azure Databricks ecosystem. This will include incorporating AI/ML capability. They are currently working with a 3rd Party Data Partner who have recommended a number of improvements ...

strategic design, migration, and optimization of the enterprise data ecosystem, transitioning data pipelines, ontologies, and transformation workflows from Palantir Foundry to a scalable Databricks Lakehouse architecture. The successful candidate will provide architectural leadership and technical direction, ensuring data integrity, governance, performance, and long-term platform sustainability. You will collaborate closely … best practices, and deliver a secure and high-performance migration. Responsibilities Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake ...

Data Consultant (Databricks)/Data Engineering Architect Contract Length: Initial 7 weeks (immediate start) with strong potential for extension Location: London (Victoria) Hybrid - 1-2 days per week onsite Outside IR35 We are looking for an experienced Data Engineering Architect/Consultant with strong Databricks expertise to support a private ...

Databricks Data Engineer Up to £75,000 I am currently recruiting for a Databricks Data Engineer to support the delivery of modern data platform and engineering programmes within a growing data focused consultancy. Working across a range of enterprise clients, this role focuses on designing and delivering scalable data solutions … using the Databricks Data Platform. This position sits at the intersection of data architecture, engineering delivery and client engagement. You will be responsible for building robust data pipelines, supporting cloud data platforms and ensuring high-quality, scalable data solutions are delivered across multiple projects. This role is ideal for someone ...

Senior Data Engineer/Data Platform Engineer (Databricks) Contract | Outside IR35 Remote (UK/EU) £550–£650 per day (DOE) We’re partnering with a forward-thinking Data & AI consultancy that is helping to scale a Databricks Lakehouse platform. They are looking for a Senior Data Engineer/Data Platform … Engineering. This is an end-to-end hands-on role. What You’ll Be Doing: • Designing and building end-to-end data pipelines using Databricks (PySpark/SQL/Delta Lake) • Developing and managing robust, scalable Lakehouse architectures • Implementing Delta Live Tables (DLT) for reliable, testable, production-grade pipelines • Optimising ...

Data Engineer - Databricks - Hybrid (London) - Azure/AWS - Up to £75,000 If you're a Data Engineer who enjoys working close to the business, solving real problems and seeing the impact of what you build, this is worth a look. You'll be joining a growing, specialist data consultancy … your technical skills or growing into a more client-facing consultant. You'll be working on things like: Building and delivering data solutions using Databricks Creating data pipelines and working across ETL/ELT processes Designing modern data platforms (data lakes, warehousing, etc.) Getting involved in data modelling, governance ...

Senior ML/MLOps Engineer (MLflow) | Databricks | Azure) About Optima Partners We’re an advanced data & business consultancy helping major consumer brands transform through data-driven customer strategy, design, and engineering. Our clients include leading UK and global brands across financial services, retail, and more. Join a practitioner-led, fast … built in PyTorch, TensorFlow, or Scikit‐learn Use MLflow for experiment tracking, model versioning, deployment, and release workflows Build scalable data & ML pipelines in Databricks (Delta, DLT, Jobs) Design and maintain Azure data architectures (Data Lake, Synapse, SQL DW) Create robust CI/CD pipelines for ML + data using ...

analytics, machine learning, and low‐latency consumption by AI‐driven trading systems. Build and optimise real‐time and near‐real‐time data pipelines using Databricks and streaming technologies to ingest, process, and serve high‐volume market and trading data at scale. Design and implement secure, cost-aware, scalable systems using … Architect and develop cutting-edge platform services for AI-driven trading. Tech Stack Programming: Python AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and Databricks On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. What we are looking for 5 – 10 years of experience in data engineering, ideally in platform ...