676 to 700 of 890 Data Engineer Jobs

Python Data Engineer Azure & PySpark - SC Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high-quality, test-driven code in a cloud environment. … What youll do Build and maintain Python/PySpark pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. Use Docker to manage consistent development, testing, and deployment environments. Build configurable, parameter-driven code for modular data solutions. … Work with Azure Functions, Key Vault, and Blob Storage for cloud-based workflows. Collaborate with architects, data scientists, and DevOps on CI/CD and deployment. Tune and troubleshoot Spark jobs in production. Document solutions and follow cloud security and governance best practices. Skills you need Strong Python skills with a focus on clean, test-driven code. Experience writing More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: 513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop, and … deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD, automated testing, and More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: £513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop, and … deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD, automated testing, and More ❯

Data Engineer Ms Dynamics 365, Azure Data Factory, SQL, SSIS We have an exciting new permanent opportunity for a dynamic Data Engineer to join a fantastic & growing team at the best timing possible as the business has just embarked on a data transformation journey. This role will give you the chance to showcase your … expertise to help shape data integration methodologies, processes, and standards, dr click apply for full job details More ❯

I'm working with a world-class technology company in Edinburgh to help them find a Lead Data Engineer to join their team (hybrid working but there is flex on this for the right person). This is your chance to take the technical lead on complex, large-scale data projects that power real-world products used … joining a forward-thinking team that's passionate about doing things properly using a modern tech stack , cloud-first approach, and a genuine commitment to engineering excellence. As Lead Data Engineer, you'll be hands-on in designing and building scalable data platforms and pipelines that enable advanced analytics, machine learning, and business-critical insights. You'll … shape the technical vision , set best practices, and make key architectural decisions that define how data flows across the organisation. You won't be working in isolation either as collaboration is at the heart of this role. You'll work closely with engineers, product managers, and data scientists to turn ideas into high-performing, production-ready systems. You More ❯

I'm working with a world-class technology company in Edinburgh to help them find a Lead Data Engineer to join their team (hybrid working but there is flex on this for the right person). This is your chance to take the technical lead on complex, large-scale data projects that power real-world products used … joining a forward-thinking team that's passionate about doing things properly using a modern tech stack , cloud-first approach, and a genuine commitment to engineering excellence. As Lead Data Engineer, you'll be hands-on in designing and building scalable data platforms and pipelines that enable advanced analytics, machine learning, and business-critical insights. You'll … shape the technical vision , set best practices, and make key architectural decisions that define how data flows across the organisation. You won't be working in isolation either as collaboration is at the heart of this role. You'll work closely with engineers, product managers, and data scientists to turn ideas into high-performing, production-ready systems. You More ❯

Your New Role We're seeking a Senior Data Engineer to help shape and maintain a modern enterprise data platform. In this role, you'll design and optimise scalable data pipelines and models that bring data from core business systems into Snowflake, enabling analytics, reporting, and data-driven insights across the organisation.You'll translate … strategic data architecture into robust technical solutions, ensuring the platform is reliable, performant, and well-structured. You'll champion engineering best practices and contribute to standards that improve data quality, consistency, and usability.Your work will ensure the business has access to trusted, timely, and well-modelled data to support decision-making, operational reporting, and future AI/… ML capabilities. Key Responsibilities Data Engineering Delivery: Build and maintain high-quality data pipelines and models in Snowflake to support analytics and reporting needs. Architecture Implementation: Apply defined data architecture standards to ingestion, transformation, storage, and optimisation processes. Pipeline Development: Develop robust ELT/ETL workflows using dbt and orchestration tools, ensuring reliability and maintainability. Performance & Cost More ❯

We are seeking a full-time contractor or employee for a Senior Data Engineer role.Perform database programming to modernize legacy programs for various projects. Develop simple and complex Structured Query Language (SQL) scripts for data migration and validation. Perform data profiling and analysis. Develop technical documentation including source to target mapping. Develop database code (triggers and … stored procedures) for data entry and reporting. Support compliance with acceptable best practices for Data Management and Governance standards. Ensure appropriate configuration and administration of TWC technical environments. Perform unit and system testing of database code. Ensure appropriate configuration and administration of TWC technical environments. Provide troubleshooting assistance during development, test, and implementation as well as during post … up meetings, documenting notes, following up on action items) and deliverables across all areas. Perform other duties as assigned to maintain operations.Required Skills: Working knowledge of SQL scripting and data batch processing in legacy and current technology Developing data conversion maps Executing data conversions for large volumes of data Implementing database coding standards ETL Development experience More ❯

IT Data Engineer Burton upon Trent (hybrid) Full-time, Permanent £26,000-£30,000 per annum Were recruiting for an IT Data Engineer to join our client based in Burton upon Trent. Youll create insightful Power BI reports and dashboards, write efficient SQL queries, and use Python to automate and streamline processes click apply for full More ❯

Senior Data Engineer OBIEE Westlake, TX W2 Contract Only ( No Option for C2C) Direct Client Looking for a candidate with hands-on experience and expertise on Oracle Database, SQL , PL/SQL , Informatica Power Center (ETL) tools with knowledge on Azure cloud and background in reporting specifically PowerBI and OBIEE. Clients team is seeking highly motivated, passionate Lead … Software Engineer with strong understanding of programming fundamentals and software design. In this role you will be responsible for development and maintenance of applications, production support & incident management of critical platforms. As a lead, you will be part of a dynamic team with an opportunity to partner closely with the business and technology teams across the shores and will … be a key enabler in creation/adoption of the technology. As a Senior data engineer, you will be responsible for- Responsible for migrating existing reports to a new platform. Actively participate in release planning, daily stand up as well as working & helping team with tactical activities like PL/SQL, ETL Development, maintenance, code review, performance tuning More ❯

Data Engineer Permanent Hybrid (3 days in the office, 2 days WFH) London McCabe & Barton are partnering with a leading financial services client to recruit an experienced Data Platform Engineer . This is an excellent opportunity to join a forward-thinking team driving innovation with modern cloud-based data technologies click apply for full job More ❯

plans to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key to … the attainment of this. Our client is therefore seeking an individual who will play an integral role in building & maintaining the businesses core data infrastructure & to deliver on the demands as outlined below. You will work closely with the lenders Chief Mortgage Officer & Senior Data Lead within the role. This is also a role that comes with plenty … of progression potential for those that are successful in the role. About the Role As a Data Engineer, you will play a key role in building and maintaining the business’s core data infrastructure. Working closely with the Chief Mortgage Officer, Senior Data Lead and Market Analysts you will enable scalable reporting, clean data flows More ❯

Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands … on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you enjoy combining engineering rigor … with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate with cross-functional More ❯

Lead Data Engineer - £70-77k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: You'll play a proactive role in the delivery of next-generation data More ❯

We're looking for a mid-level AWS Data Engineer to help us build and run reliable, scalable data pipelines. You'll turn raw data from multiple data sources into trusted datasets for our internal users, working closely with analysts, data scientists, and the wider team. You will be responsible for developing pipelines end … working with established systems and architecture. This is a great opportunity to join a small, collaborative team where you will have the chance to work on all aspects of Data Engineering and build up new skills on the job. Key Responsibilities: • Design, build, and maintain data pipelines in AWS. • Create and maintain core datasets in both traditional databases … and data lakes. • Work with a variety of data sources managed by internal and external teams. • Write clean, well-tested Python and SQL for data extraction and transformation. • Improve performance, cost, and reliability of existing pipelines • Implement data quality checks and alerting. • Use Infrastructure as Code ( IaC) to deploy processes (we use CloudFormation). • Document datasets More ❯

Senior Data Engineer Contract Location: Glasgow (Hybrid 3 days per week on-site) Duration: 6 Months Day Rate: Competitive Sector: Financial Services Overview: Were looking for a highly skilled Senior Data Engineer to join a leading financial services organisation on a 6-month contract click apply for full job details More ❯

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven business, where you'd drive the Data function playing a key role … days holiday (raising to 32), L&D budget, Health insurance, excellent maternity/paternity/adoption leave. What you'll like: You'd scale & improve a top brand's Data function, optimising retention of millions of users & having a real life impact You'd have autonomy over Tech to pick the latest, best languages/frameworks for the job … You'll have broad career progression opportunities across Group, which includes several high profile household name What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/ More ❯

Data Operations Engineer Hybrid: 1-2 days per week in the office (North West) Paying up to £55,000 Permanent Experis are excited to be partnering with a well-established organisation to help source them a Data Support Engineer to join their evolving data team. This role offers a great balance of hands-on support … and development exposure, giving you the opportunity to ensure critical data platforms remain stable and reliable, while also contributing to automation, service improvements, and project delivery. What You'll Be Doing In this role, you'll play a key part in supporting and enhancing enterprise data platforms. Your responsibilities will include: Supporting and maintaining core data platforms … predominately Snowflake, ensuring accuracy, reliability, and availability of data. Supporting on the development of pipelines and extracting data from different sources, working closely with Data Engineers and Data Architects Managing BAU activity through ITIL processes (incident, request, problem, change). Troubleshooting and resolving issues across SQL databases, APIs, and file transfers. Identifying opportunities for automation and implementing More ❯

JOB TITLE: Data Engineer The scope of the proposed services will include the following: Assess feasibility and technical requirements for LINKS DataLake integration. Collaborate with OPH Immunization Program, OPH Bureau of Health Informatics and STChealth on data specifications and recurring ingestion pipelines. Build and optimize ETL workflows for LINKS and complementary datasets (Vital Records, labs, registries). … Design scalable data workflows to improve data quality, integrity, and identity resolution. Implement data governance, observability, and lineage tracking across all pipelines. Mentor engineers, support testing, and enforce best practices in orchestration and architecture. Document and communicate technical solutions to technical and non-technical stakeholders. Expertise and/or relevant experience in the following areas are mandatory … years of experience in data engineering and/or data architecture 2 years of experience with Python for ETL and automation (pandas, requests, API integration). 2 years hands-on experience with SQL queries, stored procedures, performance tuning (preferable Oracle, SQL Server, MySQL) 1 year experience with ETL orchestration tools (Prefect, Airflow or equivalent). 1 year experience More ❯

Fabric Data Engineer - Hybrid - 75k - Winchester Are you ready to take your data engineering career to the next level? I'm working with a leading UK consultancy that's driving digital transformation through Microsoft Fabric and the Power Platform. They're looking for a Senior Microsoft Fabric Data Engineer Consultant who's passionate about solving … days in office). Work on high-impact projects with cutting-edge Microsoft technologies. What We're Looking For Hands-on experience with Microsoft Fabric workloads: Lakehouse, Data Factory, Pipelines, Notebooks, Delta Lake, Eventstreams, Semantic Models. Advanced PySpark/Spark SQL skills and strong data engineering fundamentals. Integration experience with Dynamics 365, Dataverse, Business Central. CI/CD More ❯

Fabric Data Engineer - Hybrid - 75k - Winchester Are you ready to take your data engineering career to the next level? I'm working with a leading UK consultancy that's driving digital transformation through Microsoft Fabric and the Power Platform. They're looking for a Senior Microsoft Fabric Data Engineer Consultant who's passionate about solving … days in office). Work on high-impact projects with cutting-edge Microsoft technologies. What We're Looking For Hands-on experience with Microsoft Fabric workloads: Lakehouse, Data Factory, Pipelines, Notebooks, Delta Lake, Eventstreams, Semantic Models. Advanced PySpark/Spark SQL skills and strong data engineering fundamentals. Integration experience with Dynamics 365, Dataverse, Business Central. CI/CD More ❯

Data Engineer | Hybrid Role | £50k-£60k | London Route delivers world-class audience measurement for out-of-home advertising across Great Britain. We're building new data models and collection methods to better understand how people move and which OOH ads they see. You'll build the data pipelines and infrastructure that makes this happen. Note: Applicants … is not available. Why this role? From day one, you'll have the freedom to innovate and make decisions that directly affect the business. This isn't a traditional data engineering role; you'll wear multiple hats. You'll design and maintain local and cloud (GCP) data pipelines that power our analytics and dashboards and automate key processes. … Proxmox virtualisation hosts and network configuration, ensuring seamless integration between on-premises and cloud systems. Working closely with the team, you'll get hands-on experience with everything from data engineering to infrastructure management. What's in it for you? Immediate Impact: Your work directly supports how audience data is used to measure advertising effectiveness across GB. You More ❯

We're on the lookout for an experienced Data Engineer to join our team on a 4-6 month contract. This is a pivotal role focused on ensuring business continuity through a structured handover process, while simultaneously accelerating our data infrastructure modernisation program. You'll work closely with stakeholders across the business to capture key insights, document … technical processes, and deliver high-impact analytics solutions. If you thrive in fast-paced environments and have a passion for turning data into actionable intelligence, we'd love to hear from you. About You As a Data Engineer, you will: Collaborate with stakeholders to create comprehensive handover documentation for ongoing and legacy projects. Lead the design and … and other visualisation tools. Monitor KPIs across sales, marketing, product, and customer performance, identifying trends and anomalies. Drive automation of reporting processes to enhance efficiency, scalability, and accuracy. Ensure data integrity, quality, and security through rigorous validation, testing, and documentation. Mentor junior analysts and contribute to data governance and analytics best practices. Key Skills & Experience Proven experience designing More ❯

Job Description Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven business, where you'd drive the Data function playing a … days holiday (raising to 32), L&D budget, Health insurance, excellent maternity/paternity/adoption leave. What you'll like: You'd scale & improve a top brand's Data function, optimising retention of millions of users & having a real life impact You'd have autonomy over Tech to pick the latest, best languages/frameworks for the job … You'll have broad career progression opportunities across Group, which includes several high profile household name What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/ More ❯

Data Engineering AnalystHybrid – Ipswich (3 days onsite, Tuesday & Wednesday mandatory) Salary: £35,000–£50,000 (depending on experience) REED Technology are working with a client who have created two positions at different levels to be a key part of an exciting transition: the organisation is moving its data warehouse from Netezza to Snowflake , and building an in-house … data engineering capability for the first time. If you want to help shape a modern data platform, support critical migrations, and work closely with BI and Analytics teams to deliver high-quality data products, this role offers significant technical growth and hands-on experience. Responsibilities Supporting the migration of data pipelines from Netezza to Snowflake. Building … reliable ELT/ETL processes, API integrations, and automated workflows (Workato). Developing and maintaining data models that support BI and analytics use cases. Ensuring data quality through cleansing, validation, and testing. Troubleshooting data issues and ensuring consistency across datasets. Working closely with BI Developers, Analysts, and business teams to deliver data they can trust. Contributing More ❯