1 to 25 of 36 Contract Databricks Jobs in the UK excluding London

data engineering solutions Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse More ❯

availability of data assets. Experience: 3-5 years of hands-on experience as a Data Engineer working in Azure cloud environments. Strong proficiency in Azure Data Factory, Synapse Analytics, Databricks, and Azure SQL. Solid understanding of data modeling, ETL/ELT design, and data warehousing principles. Proficiency in SQL and Python for data transformation and automation. Experience working with version More ❯

robust data platforms. Innovation Stay current with emerging Azure technologies and best practices in data architecture. Required Skills & Experience Technical Expertise Extensive experience with Azure Data Services: Data Factory, Databricks, Synapse, Data Lake, Azure SQL. Strong understanding of data modeling, data warehousing, and distributed computing. Proficiency in Python, SQL, and Spark for data engineering tasks. Financial Services Domain Proven track More ❯

sets. Troubleshoot and resolve data issues proactively. Required Qualifications: 3-5+ years of experience as a Data Engineer or similar role. Strong experience with Azure data services (ADF, Databricks, ADLS, Synapse, Event Hub, etc.). Proficiency in SQL and experience with Python/PySpark . Hands-on experience building ETL/ELT pipelines in cloud environments. Solid understanding of More ❯

people focused data engineering and analysis. You will have experience in a data engineering role, ideally with practical experience or the ability to upskill in cloud services like Azure, Databricks and ESRI, as well as excellent proven proficiency, SQL and Python. Ideally you would have a familiarity with developing pipelines which support Analysts who use RStudio Power BI and/ More ❯

The Data Engineer will demonstrated experience as a Data Engineer, with a strong track record of success. Mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving and analytical skills, with strong attention More ❯

Demonstrable experience with Infrastructure as Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business. Key Responsibilities Design … develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security, and quality across all pipelines. Collaborate with data scientists, analysts, and cross-functional … solutions using tools like Terraform, GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools Azure Key Vault More ❯

validation routines , including monitoring, alerting, and automated checks. Optimise data workflows for performance, cost-efficiency, and maintainability , using platforms such as Azure Data Factory, AWS Data Pipeline, Glue, Lambda, Databricks, and Apache Spark. Support the integration of transformed data into visualisation and analytical platforms , including Power BI, ServiceNow, and Amazon QuickSight. Ensure compliance with data governance, security, and privacy standards More ❯

routines, and monitoring processes to maintain data integrity and reliability. * Optimise data workflows for performance, cost-efficiency, and maintainability using tools such as Azure Data Factory, AWS Data Pipeline, Databricks, or Apache Spark . * Integrate and prepare data for Tableau dashboards and reports , ensuring optimal performance and alignment with business needs. * Collaborate with visualisation teams to develop, maintain, and enhance More ❯

frameworks (e.g., Pandas, NumPy, Scikit-learn, PyTorch, TensorFlow). Experience developing and fine-tuning LLMs and working with generative AI tools. Hands-on experience with Microsoft Azure (Azure ML, Databricks, or other AI services). Ability to handle, process, and analyse large, complex datasets. Strong understanding of data ethics, governance, and responsible AI principles. Must have SC Clearance and More ❯

backend components of a next-gen trading platform. Work with Java and/or Kotlin to deliver robust solutions. Deploy containerised applications using Kubernetes and Docker. Leverage MongoDB and Databricks for data processing and analytics. Integrate with relational databases and support legacy data migration. Collaborate with stakeholders and contribute to technical decision-making. Ensure code quality through testing, debugging, and More ❯

on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption Consultative behaviour - strong stakeholder engagement skills, providing true consultancy and leading the user More ❯

organisations.Strong understanding of data governance, data management, and metadata practises.Hands-on experience with data quality tooling (e.g., Microsoft Purview, Informatica, Collibra, Talend).Familiarity with cloud-based data architectures (Azure, Databricks, Power BI).Strong analytical and problem-solving skills, with experience in designing and implementing data quality KPIs and dashboards.Excellent stakeholder engagement and communication skills.Experience in regulated industries (e.g., utilities, finance More ❯

of data governance, data management, and metadata practises. Hands-on experience with data quality tooling (e.g., Microsoft Purview, Informatica, Collibra, Talend). Familiarity with cloud-based data architectures (Azure, Databricks, Power BI). Strong analytical and problem-solving skills, with experience in designing and implementing data quality KPIs and dashboards. Excellent stakeholder engagement and communication skills. Experience in regulated industries More ❯

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a eek (NON Negotiable), the rest WFHDuration … months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with … Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and communication skills. Nice to have: Financial data knowledge on funds, securities, positions, trades and background in Asset Management. This opportunity is for a More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be More ❯

and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. You will also have a number of years hands-on experience with cloud services, especially Databricks, for building and managing scalable data pipelines. ETL process expertise is essential. Proficiency in working with Snowflake or similar cloud-based data warehousing solutions is also essential. Experience in data More ❯

GDPR, BCBS 239, DORA). Oversee data lineage, cataloging, and metadata management using tools such as Collibra, Informatica, Microsoft Purview, or Alation. Support governance integration within platforms like Azure, Databricks, Microsoft Fabric, and BI tools. Promote data literacy and deliver training across the organisation. Provide audit and regulatory evidence, supporting internal/external audits and exams. Report on data governance More ❯

Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £520/day - Inside IR35 We are currently recruiting for a well experienced Data Engineer, required for a leading global transformation consultancy, based in London. The Lead Technical Developer will be responsible for … data cleaning, validation, and enrichment using Spark (PySpark/Scala) and related tools to ensure quality and consistency. Utilize Unity Catalog, Delta Lake, Spark SQL, and best practices for Databricks development, optimization, and deployment. Program in SQL, Python, R, YAML, and JavaScript. Integrate data from multiple sources and formats (CSV, JSON, Parquet, Delta) for downstream analytics, dashboards, and reporting. Apply More ❯

global initiatives, ensuring consistency with enterprise data architecture standards and integration principles. Translate business and information requirements into scalable, secure, and performant data solutions leveraging the enterprise platforms (Azure, Databricks, Power BI, SAP BTP, Salesforce, etc.). Ensure data models, pipelines, and analytics solutions are built with reuse, interoperability, and data quality in mind. Enterprise Alignment Embed the Data & AI … Key Interfaces Enterprise Architecture Domains: Integration, Cybersecurity, Application, Infrastructure Data & AI CoE and Data Governance Teams Business Domains: Commercial, Supply Chain, Enabling Functions (Finance, HR, Legal, etc.) Vendors: Microsoft, Databricks, SAP, Salesforce, Informatica, Collibra Skills and expeirence: Essential Proven experience designing enterprise-scale data and analytics solutions across hybrid cloud environments. Strong understanding of data modelling, data integration, metadata management … and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts into clear, value-focused business outcomes. Excellent stakeholder management and communication skills across technical and non-technical audiences. Desirable Experience More ❯

global initiatives, ensuring consistency with enterprise data architecture standards and integration principles. Translate business and information requirements into scalable, secure, and performant data solutions leveraging the enterprise platforms (Azure, Databricks, Power BI, SAP BTP, Salesforce, etc.). Ensure data models, pipelines, and analytics solutions are built with reuse, interoperability, and data quality in mind. Enterprise Alignment Embed the Data & AI … Key Interfaces Enterprise Architecture Domains: Integration, Cybersecurity, Application, Infrastructure Data & AI CoE and Data Governance Teams Business Domains: Commercial, Supply Chain, Enabling Functions (Finance, HR, Legal, etc.) Vendors: Microsoft, Databricks, SAP, Salesforce, Informatica, Collibra Skills and expeirence: Essential Proven experience designing enterprise-scale data and analytics solutions across hybrid cloud environments. Strong understanding of data modelling, data integration, metadata management … and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts into clear, value-focused business outcomes. Excellent stakeholder management and communication skills across technical and non-technical audiences. Desirable Experience More ❯

BI tools (Qlik, Tableau, etc.) Python preferred (R or Scala also considered) Advanced Excel capabilities Nice to Have: Knowledge of OneLake and Delta Lake Experience with Spark Familiarity with Databricks Interested? Please submit your updated CV to Olivia Yafai at Crimson for immediate consideration. Not interested? Do you know someone who might be a perfect fit for this role? Refer More ❯

data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving … protection of customer data Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing … Understanding of machine learning model enablement and operationalisation within data architectures Experience working within Agile delivery environments If you are an experienced Senior Data Engineer with strong expertise in Databricks , Azure , and data architecture design , looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance. Data Engineer, Senior More ❯

gather stakeholder requirements independently. Self-starter with the ability to work independently. Strong communication skills and confidence engaging with stakeholders. Detail-oriented with a proactive mindset. Experience working with Databricks would be a nice to have. Experience supporting data migrations or modernisation projects would be a nice to have. HOW TO APPLY: Please register your interest by sending your CV More ❯