Sr.Databricks Engineer (AWS) Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 Rate: £402/day on Umbrella Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on … designing, building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable dataengineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost … efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong hands-on experience with More ❯
Role Title: Sr.Databricks Engineer Location: Glasgow Days on site: 2-3 Pay Rate: £405 per day MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: . Lead the migration of existing AWS-based data pipelines to Databricks. . Design and implement scalable dataengineering solutions using Apache Spark on Databricks. . Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. . Optimize … performance and cost-efficiency of Databricks workloads. . Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. . Ensure data quality and reliability through robust unit testing and validation frameworks. . Implement best practices for data governance, security, and access control within Databricks. . Provide technical mentorship and guidance to junior engineers. Must More ❯
Privacy Technologist/Tech Lead Consultant, contract, outside IR35, London Hybrid You'll serve as the bridge between privacy compliance, engineering delivery and architecture governance ensuring privacy principles are implemented effectively throughout the software development lifecycle. This position requires a unique combination of technical depth, regulatory understanding, and agile delivery experience. You'll help turn high-level regulatory and … privacy SME for delivery and platform teams during privacy incidents or investigations. Provide technical insight during incident triage, root cause analysis, and remediation planning. Coach teams in privacy-preserving engineering practices, including data minimisation, anonymisation/pseudonymisation, and consent management. Cross-Functional Collaboration Collaborate with Product Owners, Architects, Security Engineers and Lega to ensure privacy compliance is aligned … with business and technical goals. Work closely with Solution Management and Architecture to embed privacy considerations early in design phases. Contribute to the continuous improvement of privacy engineering practices across the organisation. Experience Technical Expertise: Background in software or dataengineering, with hands-on familiarity across data pipelines, APIs, SDKs, client/server tracking, consent tooling More ❯
Data Engineer - ETL Developer + 515 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - at least 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our dataengineering capability to meet growing demand across … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established dataengineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one … of our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI More ❯
Telford, Shropshire, West Midlands, United Kingdom
CBSbutler Holdings Limited
Data Engineer - ETL Developer + £515 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - at least 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our dataengineering capability to meet growing demand across … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established dataengineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one … of our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to fulfil their data requirements and … support their work. Collect and process datasets from various sources, ensuring data quality and integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in dataengineering, and … continuously improve your skills and knowledge. Profile The Data Engineer will have mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving and analytical skills, with strong attention to detail. More ❯
Data Engineer £700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a DataEngineering Consultant. Looking for someone who can act independently and deliver complex data products - work with stakeholders to understand requirements, engineer and deliver products click apply for More ❯
Data Engineer - ETL Developer + £510 to £530 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - atleast 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our dataengineering capability to meet growing demand … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established dataengineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one … of our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI More ❯
Data Engineer - ETL Developer + 510 to 530 per day + Long term contract - 6-12 months + SC is required for this role. + Telford - atleast 2 days per week Key Skills: + ETL based solutions + Oracle RDS ETL Developer - Talend/Oracle RDS We're expanding our dataengineering capability to meet growing demand … programme - supporting ongoing work on the DPRS regime and taking on new challenges with the CARF regime. We're looking for an experienced ETL Developer to join our established dataengineering team. You'll help deliver high-quality data management and ETL solutions across multiple concurrent projects in a fast-paced, collaborative environment. As part of one … of our core project teams, you'll take ownership of solution delivery while also contributing to our shared Talend framework and supporting the wider data delivery function. What you'll be working on: Developing and maintaining ETL solutions using Talend within our existing framework and patterns Working with Oracle RDS databases Contributing to the continuous improvement of our CI More ❯
Morgan Hunt are working with a housing association based in Edinburgh to recruit a data analyst on an FTC (2 years). Key responsibilities: Develop data management solutions and reports using Microsoft Azure, Power BI, and Power Platform. Provide third-line support for data services. Manage incidents, requests, problems, changes, and assets in the Digital & Data team. Develop and maintain best practices for data management from source to visualisation (data prep, integration, modelling, testing, reporting, analytics). Document deployed data solutions (process flows, security, error handling, etc.) Maintain and support existing data management solutions. Deliver training to business users on published data models and reports. Experience required: Strong background in … dataengineering, warehousing, and data quality. Proficiency in Microsoft 365, Power BI, and other BI tools Familiarity with Azure Databricks and Delta Lake is desirable. Ability to work autonomously in a dynamic environment and contribute to team performance. Strong communication, influencing skills, and a positive, can-do attitude. Knowledge of the Housing sector and its regulatory environment More ❯
Role : Data Scientist Location : Remote within the UK, hybrid attendance only when required Type : Contract (6 Months, Inside IR35) My client, a global IT services provider, is seeking a Data Scientist to support a high-impact AI initiative within a commercial banking environment. This role sits within a collaborative delivery team focused on advanced analytics and machine learning … solutions that drive strategic insights and operational efficiency. Responsibilities Collect, clean, and preprocess structured and unstructured data from diverse sources Perform exploratory data analysis (EDA) to uncover trends and anomalies Design and implement data pipelines in collaboration with dataengineering teams Apply feature engineering and selection techniques to enhance model performance Build and validate … Tableau, or Python Engage with stakeholders to define use cases and success metrics Participate in Agile ceremonies and contribute to the enterprise AI roadmap Required Skills Proven experience in data science and machine learning Strong Python skills and familiarity with ML libraries (Scikit-learn, TensorFlow, PyTorch) Experience with data visualization tools (Power BI, Tableau, Matplotlib, Seaborn) Ability to More ❯
Role : Data Scientist Location : Remote within the UK, hybrid attendance only when required Type : Contract (6 Months, Inside IR35) My client, a global IT services provider, is seeking a Data Scientist to support a high-impact AI initiative within a commercial banking environment. This role sits within a collaborative delivery team focused on advanced analytics and machine learning … solutions that drive strategic insights and operational efficiency. Responsibilities Collect, clean, and preprocess structured and unstructured data from diverse sources Perform exploratory data analysis (EDA) to uncover trends and anomalies Design and implement data pipelines in collaboration with dataengineering teams Apply feature engineering and selection techniques to enhance model performance Build and validate … Tableau, or Python Engage with stakeholders to define use cases and success metrics Participate in Agile ceremonies and contribute to the enterprise AI roadmap Required Skills Proven experience in data science and machine learning Strong Python skills and familiarity with ML libraries (Scikit-learn, TensorFlow, PyTorch) Experience with data visualization tools (Power BI, Tableau, Matplotlib, Seaborn) Ability to More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
an AI Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role * The AI Engineer will design, develop, and implement AI and machine learning solutions to support data-driven decision-making and business innovation in pharmaceuticals.* Collaborate with data scientists, data engineers, and business analysts to build scalable AI models for research, development, and commercial … operations.* Develop, test, and optimise machine learning algorithms and predictive models relevant to pharmaceutical data.* Integrate AI models with existing data pipelines, laboratory systems, and business applications.* Ensure the reliability, scalability, and performance of AI systems across multiple platforms.* Maintain clear documentation and contribute to best practices in model governance, regulatory compliance, and MLOps.* Stay abreast of industry trends … Proficient in Python and familiar with key libraries such as TensorFlow, PyTorch, and scikit-learn.* Experience working with cloud platforms such as Azure, AWS, or GCP, ideally within a dataengineering or MLOps context.* Strong understanding of data processing, feature engineering, and model evaluation techniques, with experience handling complex scientific datasets.* Excellent problem-solving and analytical More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
Robert Half Technology are assisting a large, market-leading media company to recruit a Data Analyst on a contract basis. Hybrid working - London based. Role * The Data Analyst will be responsible for collecting, analysing, and interpreting complex data sets to help drive business decisions and optimise performance.* Collaborate with internal stakeholders to understand data requirements and … provide actionable insights.* Build dashboards and reports to visualise key performance indicators and trends using tools such as Power BI and Tableau.* Clean, transform, and validate data to ensure accuracy and consistency.* Identify patterns and trends in data to support strategic planning and operational improvements.* Work closely with the dataengineering team to ensure the smooth … flow of data from multiple sources.* Stay up to date with emerging analytics tools and techniques to continuously improve reporting and analysis processes. Profile * The Data Analyst will have proven experience with data analysis, reporting, and visualisation tools such as Power BI, Excel, SQL, and Tableau.* Strong proficiency in SQL for querying and manipulating large datasets.* Experience More ❯
About this Position: This role involves leading data-driven initiatives to address complex business challenges through advanced analytics and machine learning. The successful candidate will collaborate across multidisciplinary teams, providing technical leadership and ensuring the delivery of accurate, high-quality data insights. The position also offers the opportunity to engage directly with clients or stakeholders, translating technical outcomes … into actionable business solutions. Job Responsibilities: Collaborate with cross-functional teams to identify business problems and develop data-driven solutions. Provide technical mentorship and guidance to other data scientists. Design and implement algorithms, statistical models, and machine learning solutions to analyse complex data sets. Communicate analytical insights clearly to both technical and non-technical stakeholders. Engage with … clients to understand requirements and convert them into deliverable insights. Ensure the accuracy, integrity, and quality of all data outputs. Stay informed on emerging trends, technologies, and best practices in data science. Experience Required: Proven experience as a Data Scientist with proficiency in Python and libraries such as NumPy, Pandas, Scikit-learn, Matplotlib, and Plotly. Strong background More ❯
Warwick, Warwickshire, West Midlands, United Kingdom
Stackstudio Digital Ltd
Job Title: Azure Data Engineer Location: Warwick, UK (Office Based) Job Type: Contract (Inside IR35) Duration: 6 months Job Summary: Join Tata Consultancy Services (TCS) as an Azure Data Engineer and play a key role in delivering innovative data solutions for some of the largest brands in the UK and worldwide. You will leverage your expertise in … Azure, ADF, and modern data platforms to support high-impact, data-driven projects that make a meaningful difference to our clients and communities. Key Responsibilities: Apply in-depth knowledge of Azure and SQL to develop and maintain robust data solutions. Utilize strong debugging skills to resolve issues efficiently. Design, build, and manage data pipelines using Azure … Data Factory (ADF) . Collaborate effectively with stakeholders, ensuring clear communication throughout project lifecycles. Skills, Experience, and Abilities Required: Essential: Expert-level experience with Azure Data Factory (ADF) Hands-on experience with Snowflake and Databricks Proficiency in Python programming Strong Azure and SQL knowledge Excellent debugging and troubleshooting abilities Good communication skills Desirable: 6 to 8 years of More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
Robert Half Technology are assisting a market-leading pharmaceuticals organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based (one day per week on site). Role * The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance.* Collaborate with data scientists, analysts, and business … stakeholders to fulfil their data requirements and support their work.* Collect, process, and transform datasets from various sources, ensuring data quality and integrity.* Optimise and maintain the organisation's Snowflake infrastructure, providing performance tuning, enhancements, and regular "MOT" checks.* Develop and maintain DBT pipelines, mainly on Snowflake, to enable efficient transformation and modelling of data.* Implement efficient data models and schemes for storage and retrieval, optimising processes for improved performance.* Troubleshoot and resolve data pipeline and infrastructure issues swiftly and effectively.* Keep abreast of industry trends and emerging technologies in dataengineering and cloud infrastructure, continuously improving skills and knowledge. Profile * The Data Engineer will have proven experience working with Snowflake infrastructure, including More ❯
Job Title: Airflow/AWS Data Engineer Location: Manchester Area (3 days per week in the office) Rate: Up to £400 per day inside IR35 Start Date: 03/11/2025 Contract Length: Until 31st December 2025 Job Type: Contract Company Introduction: An exciting opportunity has become available with one of our sector-leading financial services clients. They … are seeking a talented AWS DevOps/Data Engineer to join their growing dataengineering function. This role will play a key part in designing, deploying, and maintaining modern cloud infrastructure and data pipelines, with a focus on Airflow, AWS, and data platform automation. Key Responsibilities: Deploy and manage cloud infrastructure across Astronomer Airflow and … AccelData environments. Facilitate integration between vendor products and core systems, including data lakes, storage, and compute services. Establish and enforce best practices for cloud security, scalability, and performance. Configure and maintain vendor product deployments, ensuring reliability and optimized performance. Ensure high availability and fault tolerance for Airflow clusters. Implement and manage monitoring, alerting, and logging solutions for Airflow and More ❯
potential extension) Start: ASAP Rate: Market rate - Inside IR35 We’re looking for experienced PySpark + Fabric Developers to join a major transformation programme with a leading global financial data and infrastructure organisation. This is an exciting opportunity to work on cutting-edge dataengineering solutions, driving innovation and performance at scale. Key Responsibilities Design, build, and … optimise data pipelines for both batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics and reporting. Implement complex data transformations, aggregations, and joins with a focus on performance and reliability. Apply robust data validation, cleansing, and profiling techniques to maintain accuracy. Enforce role-based access, data masking, and compliance standards. Tune … Strong hands-on experience with PySpark (RDDs, DataFrames, Spark SQL). Proven ability to build and optimise ETL pipelines and dataflows. Familiar with Microsoft Fabric or similar lakehouse/data platform environments. Experience with Git, CI/CD pipelines, and automated deployment. Knowledge of market data, transactional systems, or financial datasets. Excellent communication skills and collaborative mindset. Desirable More ❯
Fabric) Work Location: London (Office Based) The Role The role will be integral to realizing the customer's vision and strategy in transforming some of their critical application and dataengineering components. As a global financial markets infrastructure and data provider , the customer leverages cutting-edge technologies to support its core services and business requirements. This role … is critical in enabling the technical thought leadership and excellence required for that purpose. Your Responsibilities Design, build, and optimise scalable data pipelines for batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics-related business requirements. Implement complex transformations, aggregations, and joins ensuring performance and reliability. Apply robust data validations, cleansing, and profiling … techniques to ensure data accuracy and consistency. Implement role-based access, data masking, and compliance protocols. Performance tune and optimise jobs and workloads to reduce latency. Collaborate with analysts and business stakeholders to translate requirements into technical solutions. Create, maintain, and update documentation and internal knowledge repositories. Your Profile Essential Skills/Knowledge/Experience Ability to write More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Lorien
be responsible for designing and developing intelligent agents capable of autonomous decision-making in distributed environments. You will leverage your expertise in Python and Spark to process large-scale data and use modelling techniques to enable complex agentic behaviours. Experience working with MCP servers or similar distributed computing platforms is key. Key Responsibilities: Design and develop agentic AI systems … that operate autonomously across diverse data sources and workflows. Implement scalable data processing pipelines using Apache Spark and Python. Build, train, and fine-tune advanced AI/ML models for agent reasoning, planning, and execution. Integrate solutions with MCP (Massively Concurrent Processing) servers or equivalent architectures. Work closely with data engineers, researchers, and platform teams to ensure … robust deployment. Continuously research and integrate emerging techniques in agent-based AI, multi-agent systems, and reinforcement learning. Required Skills & Experience: 4+ years of experience in AI/ML engineering or data-intensive systems. Strong proficiency in Python for AI, ML, and dataengineering tasks. Deep experience with Apache Spark (PySpark or Scala-based implementations). More ❯
South East London, London, United Kingdom Hybrid / WFH Options
Corriculo Ltd
Lead Data Engineer, Snowflake, 4 months, Remote, CO7368 A leading software consultancy requires a Lead Data Engineer/Tech Lead with strong Snowflake skills - for the next 4 months with the likelihood of significant extension - to provide technical leadership for a prestigious client project to deliver an innovative data platform. Working remotely and outside of IR35, the … Snowflake Lead Data Engineer/Tech Lead will actively work on delivering the technical solutions whilst carrying out code reviews, setting best practices, ensuring code quality, keeping everyone aligned from a technical standpoint, and fostering good communication and collaboration. This will involve: Working with the project owner to gather ongoing requirements from the client Improving the transparency and traceability … of data through well-documented pipelines and clear data lineage. Empowering internal teams with cleaner, structured data, reducing dependence on tribal knowledge and manual interventions. Enabling future scalability by establishing robust, modular foundations Experience Required: Snowflake expertise Solid dataengineering expertise including strong SQL and Python Proficiency in DBT for transformation tasks Experience with Dagster More ❯
Role Title: ETRM Data Modeler Work mode: Hybrid, 3 days WFO Contract duration: 12 Months Location: London Key Accountabilities: Knowledge and experience in global energy markets with the ability to identify and prioritize fundamental and quantitative analysis/modelling that provides commercial insights to the trading organization. Strong communication skills with the ability to communicate analytics to necessary stakeholders … learning. Excellent problem-solving skills. Experience using a coding language to develop models and analytical tools. Experience manipulating and analyzing large, complex datasets. Desirable Experience & Skills Practical knowledge of dataengineering practices (designing and building robust data pipelines) Knowledge of python and core libraries applicable to data science (e.g., pandas, numpy, statsmodel More ❯
recruit a Quantitative Developer on a contract basis A leading hedge fund with a strong track record in systematic and quantitative trading. The firm combines advanced research, technology, and data to deliver market-leading performance across multiple asset classes. They are seeking a Quantitative Developer on a 6-month contract to support the ongoing development of research tools, trading … enhancements within their core systematic strategies team. Role The Quantitative Developer will collaborate with researchers to implement, test, and deploy quantitative trading strategies and risk models. Build and enhance data pipelines and backtesting frameworks for large-scale market data. Integrate new data sources and ensure data quality and reliability across research environments. Refactor and optimise existing code … experience as a Quantitative Developer within a hedge fund, prop trading, or systematic trading environment. Strong programming expertise in Python (C++ or Java also advantageous). Excellent understanding of data structures, algorithms, and numerical computing. Experience with time-series data, backtesting, and quantitative research workflows. Familiarity with financial markets and trading systems. Strong communication skills with the ability More ❯
/CD pipelines using GitHub Actions. You will be part of a team responsible for designing, implementing, and maintaining scalable, secure, and cost-effective cloud infrastructure to support our data and analytics platform. This role requires a strong background in cloud infrastructure automation, platform governance, and enterprise-grade security and compliance in Azure. Key Responsibilities: Design, build, and manage … controls across cloud resources. Monitor and manage cloud costs using Azure Cost Management, ensuring resources are optimized and within budget. Architect and support Databricks workspaces, focusing on Unity Catalog, data access control, workspace deployment, and platform reliability. Collaborate with dataengineering and analytics teams to ensure Databricks is performant, secure, and well-integrated with enterprise systems. Create … automation. Strong scripting skills (e.g., Python, PowerShell, Bash) and comfort working with APIs and automation tools. Excellent problem-solving and communication skills; ability to work cross-functionally with security, data, and DevOps teams. Nice to Have: Experience with multi-cloud or hybrid cloud architectures. Knowledge of Infrastructure as Code testing frameworks (e.g., Terratest, Checkov). Familiarity with Azure DevOps More ❯