1 to 25 of 80 Data Pipeline Jobs in the North of England

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Overview This is an exciting opportunity for a technically minded Data Engineer to join a growing and innovative organisation working at the forefront of data-driven solutions. Youll play a key role in building, maintaining, and optimising data systems that support operational performance … reporting. This role offers exposure to modern data tools, cloud technologies, and large-scale datasets, making it ideal for someone looking to develop a career in data engineering. Data Engineer Key Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

closely with FP&A, technology teams and senior business stakeholders Collaborating with developers, infrastructure engineers and reporting specialists Troubleshooting complex data and pipeline issues Four days per week based in the Newcastle office, with one day working from home The Person: Senior-level Data Engineering … Programming knowledge using Python, Java, C# or a similar language Strong understanding of data architecture, data lakes and pipeline development Confident communicating with both technical and non-technical stakeholders Experience working with financial systems or FP&A teams would be advantageous Rise Technical Recruitment ...

data stack, connect APIs and pipelines into coherent systems, and take ownership of the full journey from initial brief through to a pipeline running reliably in production. If you are the kind of engineer who takes pride in clean pipelines, fast queries, and infrastructure that just works … it. What you will be doing Owning BI infrastructure end-to-end, from initial brief and requirement gathering through to data pipeline development across APIs, ETL, ELT and SQL Working alongside Data Analyst colleagues to help them generate impactful business insights and analysis Taking ...

About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. … hands-on technical leadership with test strategy ownership . You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience ...

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

Title: Data Engineer Location: Greater Manchester (Hybrid - 3 days per week onsite) Salary: £60,000 - £70,000 + Bonus + Excellent Benefits We're working with a well-established, market-leading organisation that is investing heavily in its data and technology capabilities. They are looking … appoint an experienced Data Engineer to lead the development of a modern cloud-based data platform that will support reporting, analytics and business decision-making across the organisation. This is an exciting opportunity to join a growing business undergoing digital transformation, where you'll have ...

fields of management consulting and investment fund management. Based in Newcastle upon Tyne at their enviable facilities, my client seek a Data Engineer for Full-Stack Data Products, to join their elite Tyneside team as part of rapid expansion of the business to cope with client … engineering best practices. Architecture : Participate in architecture and technical design discussions. Testing: Write automated unit, integration, and end-to-end tests. Data Pipeline Development : Design and develop sophisticated data pipelines to import data from internal and external sources and seamlessly integrate into data ...

Data Engineer - Newcastle upon Tyne (Hybrid- 3 days onsite) - SQL, Airflow, Python, Power BI - Future Microsoft Fabric Transformation Project - Up to £55,000 Are you a Data Engineer looking for an opportunity where you can influence the direction of a growing data platform rather … than simply maintain existing processes? We're working with a technology-driven organisation investing heavily in its data capabilities and embarking on an exciting data transformation journey. This role offers the chance to work hands-on with Azure SQL, Airflow, Python and Power BI while playing ...

Senior Quantexa Data Engineer - Manchester/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

Senior Quantexa Data Engineer - Leeds/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

client, a leading Technology Consulting business based in Newcastle upon Tyne, seek a Data Engineer to join their elite Tyneside team as part of rapid expansion of the business to cope with client demand and continued excellent performance. About the Role As a Data Engineer … well as development, testing and maintenance of said platform to ensure the availability, reliability, and integrity of critical data. Key Deliverables Data Pipeline Development: Design and develop sophisticated data pipelines to import data from external vendors, sell-side partners, and other providers seamlessly ...

Data Engineer Join a growing data engineering function and help build scalable, cloud-based data products that support data-driven decision making across the organisation. The Opportunity This is an exciting opportunity for a Data Engineer to work with modern … cloud technologies while contributing to the design, development, and delivery of enterprise data products. Working alongside Product Managers, Architects, Principal Engineers, and fellow Data Engineers, you will help create robust, high-performing data solutions that transform raw data into valuable business insights. ...

Data Engineer Up to £50,000 + benefits Newcastle - Hybrid (3 days in office) We are partnering with a well-established and growing organisation that is investing heavily in its data and technology capabilities. Operating within a fast-paced environment, the business is focused on using … data to drive operational efficiency, improve decision-making, and support future growth. As part of this investment, they are looking to appoint a Data Engineer to join their technology team and play a key role in the development and evolution of their modern data ...

Role: Data Engineer Location: Newcastle upon Tyne The Opportunity Join a rapidly growing technology consultancy delivering cutting-edge solutions across financial services, private capital and defence. This is an exciting opportunity for a Data Engineer to work on business-critical data platforms that support … investment decision-making and advanced analytics. Whether you're early in your career or an experienced Data Engineer, you'll have the opportunity to work alongside exceptional technologists, solve complex data challenges, and contribute to the development of innovative data solutions in a highly ...

Data Engineer Newcastle Upon Tyne (5 days onsite) Salary: £40,000£120,000 depending on experience Were supporting a rapidly growing financial technology organisation as they continue to expand their engineering capability, building innovative data solutions across investment and financial services environments. They are looking … Data Engineers at all levels to join a high-performing Data Analytics team, helping design, build, and maintain the data platforms that support critical investment decisions. This is an opportunity to work on complex data challenges, collaborate with talented engineers and business ...

working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus … exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns Ensure ...

working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus … exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns Ensure ...

Bristol, London, Blackburn, Redcar or Doncaster £56,667 + benefits (+ London weighting, if applicable) We are seeking a motivated and enthusiastic Senior Data Engineer to join our TED team and play an important role in building and maintaining the technical infrastructure that supports the NIoT and TED. … improve teacher and leader development across the education system. A key part of that mission is our Teacher Education Dataset (TED), an ambitious data and research initiative focused on building better evidence about teacher development and what makes teaching impactful. By bringing together education, research and digital infrastructure ...

Shape the Future with AI & Data We are looking for talented AI/Data Engineers to join a growing technology consultancy delivering innovative data, analytics and AI solutions for enterprise clients. This is an exciting opportunity to work with modern cloud, data and AI technologies, helping organisations unlock value from their data and accelerate digital transformation.Whether your background is in Data Engineering, AI Engineering, or both, you'll have the opportunity to design and build scalable solutions that deliver real business impact. ...

Title: Senior Data Engineer Location: Leeds - Hybrid Salary: Up to £80,000 Why Apply? This is a rare opportunity to join a growing technology business at a pivotal stage in its journey. As the first Senior Data Engineer in the business, you'll have the chance … shape the foundations of its data capability, influence technical decisions from day one, and play a key role in how data engineering evolves as the company continues to grow. You'll remain hands on, designing and building modern cloud-based data platforms, developing scalable ...