51 to 75 of 129 Data Pipeline Jobs in the North of England

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, evaluate options, research and propose suitable More ❯

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the … business. You'll play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams … to understand data needs and deliver effective solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB More ❯

I am on the look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design, develop, and implement Databricks solutions. Manage … problem-solving and communication skills. Desirable Skills & Experience: Certification in Databricks or related technologies. Familiarity with machine learning and data analytics. Previous experience in data pipeline development. Knowledge of DevOps principles. Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those already in our network, it More ❯

I am on the look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design, develop, and implement Databricks solutions. Manage … problem-solving and communication skills. Desirable Skills & Experience: Certification in Databricks or related technologies. Familiarity with machine learning and data analytics. Previous experience in data pipeline development. Knowledge of DevOps principles. Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those already in our network, it More ❯

I am on the look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design, develop, and implement Databricks solutions. Manage … problem-solving and communication skills. Desirable Skills & Experience: Certification in Databricks or related technologies. Familiarity with machine learning and data analytics. Previous experience in data pipeline development. Knowledge of DevOps principles. Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those already in our network, it More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ years UK address history at the point of application. Hybrid … you'll be working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview: As a Data & ML Engineer, you will design, build, and optimize scalable data pipelines and machine learning solutions. You’ll work with client teams to deliver intelligent data products, leveraging modern cloud and AI technologies. Key Responsibilities Design and implement robust data pipelines and ML workflows using Python, SQL, Spark, and Databricks. Develop and deploy machine learning models (including NLP, deep learning, and agentic AI) in production environments. Integrate data from diverse sources, including streaming and batch ingestion, using Azure Data More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer – Contract | Edinburgh (2 days onsite) £500/day (Likely Outside IR35) 3 months initially Bright Purple is delighted to be working with an exciting, product-focused consultancy delivering some of the UK’s most high-profile and widely used consumer applications . Their client list features some of the biggest names in tech and beyond. … We’re seeking an experienced Senior Data Engineer to join their growing Data Practice on a 3-month engagement, helping shape and deliver scalable, cloud-native data solutions for household-name clients. What you’ll be doing Designing, building and maintaining robust data pipelines Automating and orchestrating workflows (AWS Glue, Azure Data … optimising modern data architectures (e.g. Databricks, Snowflake) Collaborating with multidisciplinary teams to deliver real business value What we’re looking for Strong experience with Python, SQL , and pipeline tools such as dbt or Airflow Proven background in data modelling, warehousing, and performance optimisation Hands-on experience with cloud data services (Glue, Lambda, Synapse More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

Junior Data Scientist - Fully remote (UK based only) – TimeSeries, NLP, Computer Vision We’re partnering with a fast-growing analytics and technology business operating in the media streaming sector to recruit a Full Stack Data Scientist. They provide data analytics tools for major entertainment brands that are household names around the globe. This role … offers a chance to build models, generate insights, and work directly with real-world product and customer data across multiple data types - text, images, and time-series (tabular) data. The Role You’ll join a small, collaborative data team in a Full stack Data Science role (ETL process through to building predictive … evaluating time-series forecasts Prototyping AI/ML models (NLP and computer vision exposure) Translating findings into clear visual reports and concise business narratives Contributing to simple, reliable data pipelines and automated quality checks About You Minimum 1 year of commercial Data Science experience Strong hands-on Python (pandas, NumPy, scikit-learn) and SQL Sound understanding More ❯

+ Benefits Robert Walters are delighted to be supporting a well-known business in Manchester on an exclusive basis. We're searching for a Solutions Architect with a Data background, that wants to be part of an exciting transformation journey. Responsibilities: Gaining in-depth knowledge of existing business legacy systems and mapping migration strategies to Azure cloud-native … solutions. Designing future systems with built-in security to comply with regulatory requirements and company standards. Assessing and prioritising business needs and new requirements within the data architecture strategy to support evolving reporting and analytics. Driving innovation by leading solution development and facilitating technical workshops to align on architecture and design. Defining and managing relationships between data sources while overseeing the impact of future or proposed changes. As a Solutions Architect you will have: 7+ years of experience migrating systems and data platforms from on-premises data centres to public cloud environments (Azure preferred but not required). Deep knowledge of cloud services for data storage, data More ❯

Senior Data Engineers with a background are required by this major client, as they continue to expand their engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To 41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem More ❯

still contributing to the codebase. Key Responsibilities Lead the design, development, and testingof secure, scalable systems using Java with modern front-end frameworks (e.g., React) Architect and maintainAPIs, data pipelines, and cloud-native solutions(AWS, Azure, private cloud) Drive adoption ofDevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promotingbest practice, clean coding, and More ❯

Junior Data Engineers are required by this major client, as they continue to build the cloud engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants to hold … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Junior Data Engineer roles you must be able to demonstrate the following experience: Commercial experience gained in a Data Engineering role on any major cloud platform (Azure, AWS or … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

Azure Data Engineer Contract This contract is Hybrid and based in Hebburn North East England (Near Newcastle Upon Tyne) **Key Responsibilities:**- Design, build, and maintain robust data pipelines to support analytical needs.- Collaborate with cross-functional teams to define data requirements and solutions.- Optimize data processes for efficiency and performance using Azure … tools.- Ensure data integrity and quality throughout the data lifecycle.- Stay updated with industry trends to implement best practices in data engineering.6 month contract Outside IR35 Please send me a copy of your CV if you're interested More ❯