176 to 200 of 247 Permanent Databricks Jobs

architectural oversight and design input across several delivery teams. Review, write, and work with Python used throughout platform components and frameworks. Develop patterns for Databricks Workflows , supporting their implementation, execution, and platform‐level troubleshooting. If this is a role that suits your skillset, can work onsite 2 days per month ...

ambitious (agentic AI capabilities, multi‐agent orchestration, voice interfaces), and the next wave of capabilities depends on a strong data engineering foundation. A Databricks lakehouse POC is being evaluated (Unity Catalog, Delta Sharing, PrivateLink to RDS), and the team is assessing the right long‐term analytics platform strategy. This role … estate with per‐client schemas (local, global, corporate). The new platform targets Aurora PostgreSQL, with several modules already migrated. Pipelines must bridge both. • Databricks/Apache Spark — a lakehouse POC is being evaluated with Unity Catalog and Delta Sharing via AWS PrivateLink. Experience with Databricks or equivalent analytics platforms ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse, and utilise data. The role ensures that data solutions are robust and reliable while meeting … platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review Boards. Build and deliver robust data solutions using Databricks, PySpark, Spark SQL, Azure Data Factory, and Azure services. Develop APIs and write efficient Python, PySpark, and SQL code to support data integration, processing ...

analytical product delivery in complex, multi-team environments.* Proven track record delivering analytical and technical outcomes on modern cloud platforms (e.g., AWS, Azure, Snowflake, Databricks).* Strong experience with data migration validation, reconciliation, data controls, and go-live readiness.* Ability to mentor analysts and collaborate effectively with engineers and architects. … agile principles. Qualifications & ToolsExperience with some of the following is beneficial:* SQL/Python, Power BI, Tableau, Qlik, Dataiku, Alteryx* AWS, Azure, GCP, Snowflake, Databricks certifications* SAFe, Scrum Master or similar agile qualifications* Modern data warehousing tools (Fabric, Lake Formation, Snowflake, Databricks)* dbt or equivalent transformation tooling* Airflow/ ...

data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). Working closely with Data Science, Product, and Analytics teams, youll ensure reliable, high-performance data flows that power … near shore partners as well as contribute to architectural direction and best practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks ...

warehouses, and data marts. Develop efficient data models and schemas for optimal storage and retrieval. Build scalable ETL pipelines using Azure Data Factory, Azure Databricks, or SQL Server Integration Services (SSIS) to ingest data from various sources into Azure. Ensure data transformation and cleansing processes align with business requirements. Deploy … Azure SQL Database. Optimize data storage and retrieval performance, ensuring security and compliance. Utilize Azure Synapse Analytics (formerly Azure SQL Data Warehouse) and Azure Databricks for big data processing and analytics tasks. Perform data aggregation, enrichment, and analysis to support business intelligence and reporting needs. Monitor data pipelines and storage ...

meet all of these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex … solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

processes using Python and SQL Contribute to the development of internal tools and applications (Python-based) Work with cloud-based data platforms (e.g., Databricks, Spark, Azure) for large-scale processing Managing databases and ensuring data quality and reliability. Collaborate with cross-functional teams to understand data requirements and implement effective … them) Experience with cloud platforms such as AWS , Azure , GCP , or Snowflake . Familiarity with big data tools like Apache Spark and Databricks . Hands-on experience with APIs (e.g., RESTful APIs, GraphQL) and system integration. Knowledge of microservices architecture and containerization tools like Docker or Kubernetes . Exposure ...

Lead Data Engineer - Databricks - £75-80k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer with good Databricks expeirence to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: You'll play … compliance of the systems. You'll play a key role in the ownership of the core architecture/engineering across the new Azure Databricks ecosystem. This will include incorporating AI/ML capability. They are currently working with a 3rd Party Data Partner who have recommended a number of improvements ...

strategic design, migration, and optimization of the enterprise data ecosystem, transitioning data pipelines, ontologies, and transformation workflows from Palantir Foundry to a scalable Databricks Lakehouse architecture. The successful candidate will provide architectural leadership and technical direction, ensuring data integrity, governance, performance, and long-term platform sustainability. You will collaborate closely … best practices, and deliver a secure and high-performance migration. Responsibilities Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake ...

Databricks Data Engineer Up to £75,000 I am currently recruiting for a Databricks Data Engineer to support the delivery of modern data platform and engineering programmes within a growing data focused consultancy. Working across a range of enterprise clients, this role focuses on designing and delivering scalable data solutions … using the Databricks Data Platform. This position sits at the intersection of data architecture, engineering delivery and client engagement. You will be responsible for building robust data pipelines, supporting cloud data platforms and ensuring high-quality, scalable data solutions are delivered across multiple projects. This role is ideal for someone ...

Senior Data Engineer/Data Platform Engineer (Databricks) Contract | Outside IR35 Remote (UK/EU) £550–£650 per day (DOE) We’re partnering with a forward-thinking Data & AI consultancy that is helping to scale a Databricks Lakehouse platform. They are looking for a Senior Data Engineer/Data Platform … Engineering. This is an end-to-end hands-on role. What You’ll Be Doing: • Designing and building end-to-end data pipelines using Databricks (PySpark/SQL/Delta Lake) • Developing and managing robust, scalable Lakehouse architectures • Implementing Delta Live Tables (DLT) for reliable, testable, production-grade pipelines • Optimising ...

Data Engineer - Databricks - Hybrid (London) - Azure/AWS - Up to £75,000 If you're a Data Engineer who enjoys working close to the business, solving real problems and seeing the impact of what you build, this is worth a look. You'll be joining a growing, specialist data consultancy … your technical skills or growing into a more client-facing consultant. You'll be working on things like: Building and delivering data solutions using Databricks Creating data pipelines and working across ETL/ELT processes Designing modern data platforms (data lakes, warehousing, etc.) Getting involved in data modelling, governance ...

Senior ML/MLOps Engineer (MLflow) | Databricks | Azure) About Optima Partners We’re an advanced data & business consultancy helping major consumer brands transform through data-driven customer strategy, design, and engineering. Our clients include leading UK and global brands across financial services, retail, and more. Join a practitioner-led, fast … built in PyTorch, TensorFlow, or Scikit‐learn Use MLflow for experiment tracking, model versioning, deployment, and release workflows Build scalable data & ML pipelines in Databricks (Delta, DLT, Jobs) Design and maintain Azure data architectures (Data Lake, Synapse, SQL DW) Create robust CI/CD pipelines for ML + data using ...

analytics, machine learning, and low‐latency consumption by AI‐driven trading systems. Build and optimise real‐time and near‐real‐time data pipelines using Databricks and streaming technologies to ingest, process, and serve high‐volume market and trading data at scale. Design and implement secure, cost-aware, scalable systems using … Architect and develop cutting-edge platform services for AI-driven trading. Tech Stack Programming: Python AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and Databricks On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. What we are looking for 5 – 10 years of experience in data engineering, ideally in platform ...

meet all of these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex … solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

mentorship to your team, and writing clean, maintainable, and well-tested code. You will be accountable for our configuration-driven data platform in Databricks, enabling non-engineers to define regulatory logic, and our Snowflake data warehouse, ensuring scalability, auditability, and fitness for client-facing regulatory use cases. You will … execution across the team. You’ll join at a pivotal stage as we modernize our data infrastructure, migrating from Python scripts and MySQL to Databricks and Snowflake. Our systems power regulatory reporting for major financial institutions, requiring precision, traceability, and reliability. What You'll Do Own the architecture, roadmap ...

Databricks Data Engineer | Edinburgh | £60,000 - £75,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. … data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice ...

Databricks Data Engineer | Manchester | £60,000 - £75,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. … data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice ...

Databricks Data Engineer | London | £60,000 - £75,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. … data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice ...

enable our next phase of success. Job Overview As a Senior Data Engineer , you will be developing our configuration-driven data platform in Databricks, enabling non-engineers to define regulatory logic, and our Snowflake data warehouse, ensuring scalability, auditability, and fitness for client-facing regulatory use cases. … mentorship to your colleagues. You’ll join at a pivotal stage as we modernize our data infrastructure, migrating from Python scripts and MySQL to Databricks and Snowflake. Our systems power regulatory reporting for major financial institutions, requiring precision, traceability, and reliability. What You'll Do Design and evolve our configuration ...

good understanding of working with APIs: Ensure robust and efficient API integration and management. Data bricks Management: Manage permissions and access controls within Databricks to ensure data security and compliance Data Analytics and Reporting: Work with data analysts to provide clean and well-structured data for analysis. Develop and maintain … routines and data integration techniques. Familiarity with relational database design and management. Experience with API development and testing using tools like Postman. Experience of Databricks or similar data platforms desirable Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. For more information please apply using ...

building and maintaining robust data pipelines within Azure, working hands-on to deliver reliable, high-performance data solutions. This includes developing workflows in Databricks and or Synapse, and transforming data from a range of sources such as CSV and Excel into clean, usable datasets. A key part of the role … architecture that can be leveraged across multiple business units. Tech environment: You will be working across a modern Azure stack including Data Lake, Synapse, Databricks, Data Factory, and SQL, with exposure to complex enterprise data environments. What we are looking for: We are looking for someone with strong experience across ...

Digital Data Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, Manchester, Hybrid Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in Manchester on a hybrid basis. The expectation is to be in the office circa two days per week and the rest … with cloud technologies such as Microsoft Azure Good grounding in programming and data engineering languages and frameworks such as Python, SQL, Microsoft Fabric and Databricks Certifications in relevant cloud and data technologies (Azure etc.) would be beneficial Excellent communication skills and the ability to inspire confidence in both technical ...

Digital Data Director/Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, Manchester, Hybrid Digital Data Director/Consultant required to work for a highly ambitious and fast-growing Consulting function, based in Manchester on a hybrid basis. The expectation is to be in the office circa two days … with cloud technologies such as Microsoft Azure Good grounding in programming and data engineering languages and frameworks such as Python, SQL, Microsoft Fabric and Databricks Certifications in relevant cloud and data technologies (Azure etc.) would be beneficial Excellent communication skills and the ability to inspire confidence in both technical ...