1 to 25 of 34 Data Pipeline Jobs in Tyne and Wear

competitive salary, and opportunities for professional development. Apply now to make a difference in our community! We are seeking a dedicated and experienced Data Engineer to join our Insights team. At North East and North Cumbria Integrated Care Board, we are committed to providing high-quality care … modifying and supporting data pipelines or data processing solutions in production or operational environments. Diagnosing and resolving data pipeline, data quality or processing issues, identifying root causes and taking corrective action within agreed parameters. Supporting the deployment of data ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models … Work within IAM policies and data governance standards appropriate to a regulated government environment. Technical skills requiredLanguages & analytics Python - primary language for pipeline development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … with delivery teams. Support the development of High-Level Designs (HLDs), Low-Level Designs (LLDs), technical documentation, and knowledge articles. Assure data pipeline integrity throughout migration, testing, validation, and dual-running activities. Mentor and guide Informatica engineers and project teams throughout the delivery lifecycle. Skills ...

organisations transform and deliver high-quality, scalable solutions that truly matter. Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft … Terraform and Infrastructure as Code (IaC). Experience using GitLab, including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability ...

Role: Data Engineer Location: Newcastle Upon Tyne Salary: TBC – Depending on experience Levels: Senior Analyst, Specialist Hybrid Working: 3 days per week in our Newcastle, Cobalt business park office Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years … data pipelines, ensure data reliability, and support cloud‐based architectures that power intelligent decision‐making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support ...

Newcastle, United Kingdom Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft Azure. You will work closely with engineering, data … Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability ...

Senior Data Engineer - Up to £85k Newcastle Upon Tyne - 3 days per week in office Our client are seeking an experienced Senior Data Engineer to play a pivotal role in designing and building the data platform that will power the organisation's next generation … analytics and AI capabilities. This is a hands-on leadership role where you will take ownership of how data is structured, governed, and leveraged across the business. You will be responsible for defining the strategic direction of the data platform while actively contributing to its design ...

extra mile We want people who are highly motivated and have a high desire to learn Responsibilities We are seeking an experienced Data Engineer for our client’s Data Analytics Team. This role involves building data pipelines to the firm’s central data … maintenance of said platform to ensure the availability, reliability, and integrity of data critical to the investment process. Data Pipeline Development: Design and develop sophisticated data pipelines to import data from external vendors, sell‐side partners, and other providers seamlessly into ...

client, a leading Technology Consulting business based in Newcastle upon Tyne, seek a Data Engineer to join their elite Tyneside team as part of rapid expansion of the business to cope with client demand and continued excellent performance. Read the overview of this opportunity to understand what skills … well as development, testing and maintenance of said platform to ensure the availability, reliability, and integrity of critical data. Key Deliverables Data Pipeline Development: Design and develop sophisticated data pipelines to import data from external vendors, sell-side partners, and other providers seamlessly ...

forward-thinking tech organisation is seeking a Principal Data Engineer to lead the evolution of its next-generation data platform. This is a senior technical leadership role, ideal for someone … enjoys working at the intersection of architecture, platform design, and long-term data strategy. This is not a pure data pipeline role. The position is best suited to individuals passionate about platform architecture, automation, and shaping scalable engineering practices. Reporting to the Head of Data ...

This is an exciting opportunity for an Data Engineer to join a company who are constanty investing in new products & using technology to increase their market share! They are looking for someone to join their team who is enthusiastic about new ideas which they can't wait … share with their team & bring to life. As a Data Engineer, you'll focus on building and maintaining robust data pipelines within the AWS ecosystem, with a primary focus on the Delta Lakehouse Platform on Databricks. Responsibilities: Data Ingestion: Build and optimize data ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial … markets. They are expanding their engineering capability in Newcastle and are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

seeking an experienced Data Engineer to join a high-performing engineering team based in Newcastle city centre. This is an opportunity to work on complex, high-impact projects within a collaborative and intellectually stimulating environment. The successful candidate will play a key role in designing, building, and maintaining … scalable data platforms and pipelines that support advanced analytics and decision-making. The Role As a Data Engineer, you will work closely with technical and non-technical stakeholders to develop reliable, scalable, and high-quality data solutions. You will contribute across the full lifecycle ...

Data Engineer Newcastle (Hybrid) Permanent Competitive salary + package Im currently working with a global consultancy to hire Data Engineers to join a growing Advanced Technology team delivering large-scale data solutions across public and private sector clients. This is a hands-on role … where youll work with modern data technologies, building scalable pipelines and real-time data platforms that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing ...

Data Engineer - Newcastle-Upon-Tyne - Up to £64,000 - Permanent Be part of a growing technology consultancy delivering complex data and cloud solutions for major organisations. This opportunity offers the chance to work on large-scale transformation programmes, helping businesses unlock value from their data through modern cloud platforms, scalable engineering practices and emerging technologies. As a Data Engineer, you'll collaborate with architects, consultants and engineering teams to design, build and support robust data solutions across cloud environments. Working with technologies such as AWS, Python and modern data ...

Data Engineer Newcastle (Hybrid) Permanent Competitive salary + package Im currently working with a global consultancy to hire Data Engineers to join a growing Advanced Technology team delivering large-scale data solutions across public and private sector clients. This is a hands-on role … where youll work with modern data technologies, building scalable pipelines and real-time data platforms that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions across Defence and financial services. Headquartered in Newcastle, the business … working on cutting-edge technology for Defence and National Security. The Role You'll play a key role in you'll building the data foundations that Defence programmes depend on, working across projects ranging from production data pipelines and applications to POCs and making sensitive ...

Scrumconnect Consulting is seeking an experienced Software Developer to join our engineering team, focusing on data engineering and platform solutions. You will design, build, and maintain data pipelines and infrastructure to support secure, reliable, and scalable public sector services. You will work with AWS, Terraform, Spark ...

Catalyst in Newcastle upon Tyne is seeking a Data Engineer to join its expanding Data Analytics Team. You will design and build data pipelines into the central data platform, and contribute to development, testing and maintenance to ensure data availability ...

Neptune North Limited is looking for an experienced Data Engineer to join their Data Analytics Team in Newcastle upon Tyne. The role involves developing and maintaining data pipelines and the central data platform, ensuring data reliability critical for investment processes. ...

environment alongside civil servants and industry experts Role Overview We are seeking an experienced Software Developer to join our engineering team, working on data engineering and platform solutions. You will design, build, and maintain data pipelines and infrastructure, working closely with wider delivery colleagues to deliver … maintain CI/CD pipelines in GitLab, supporting automated build, test, and deployment processes Integrate security scanning agents into the development and deployment pipeline to ensure code and infrastructure meet security standards Develop and maintain notebooks (Jupyter) to support data exploration, analysis, and prototyping Build and maintain ...