1 to 25 of 28 Data Pipeline Jobs in the North of England

Are you passionate about leveraging data to drive positive impact in the realm of public service? My client is an award-winning, government-backed not-for-profit organisation embarking on a major digital transformation journey with a primary focus on becoming more data-led. As they … pipelines to ensure optimal throughput and minimal latency, contributing to the overall efficiency of their data ecosystem. Address data pipeline failures and performance bottlenecks with precision, utilising your problem-solving skills to maintain the integrity of their data processes. Keep abreast of … ETL best practices. Proficiency in Python, C#, or PowerShell to enhance and optimize data processes. Ability to troubleshoot complex data pipeline issues with precision. Effectively collaborate with both technical and non-technical stakeholders. Azure certifications, such as Microsoft Certified: Azure Data Engineer Associate. more »

Data Engineer to join our growing team. You will be responsible for expanding and optimizing our data, data pipeline architecture and optimizing data flow across functional teams. The Data Engineer will work with our software developers, database architects, data analysts and data scientists on data initiatives. Responsibilities for Data Engineer: Configuring Azure Event Hubs Writing Azure Function Apps in C# Creating data pipelines in Azure Data Factory Creating PowerBI reports and visualisations Analysing analytics business requirements to … determine the data models and data flows required to deliver new dashboards and reports Creating Solution Design documents for analytics solutions Documenting Architectural Decisions that are relevant for analytics solutions Designing Extract-Transform-Load processes Required Technical and Professional Expertise Development of complex PowerBI reports from more »

Introduction A Data Asset Manager is needed to be the driving force in maximising the value and impact of data assets within a data strategy. This is an opportunity to play a key role in shaping the future of data management and … analytics and you will join a highly functioning team driven by a common goal. The Data Asset Manager will develop investment cases for data assets, implement innovative strategies to enhance return on investment, and ensure alignment with organisational goals. This role will require you to understand … business objectives, translate them into data strategies, and then sell them back to internal stakeholders to gain buy-in from the wider business. As such, you will need excellent people skills and the ability to communicate technical matters to stakeholders at all levels. Key Responsibilities Manage and maintain more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your … expertise will be critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with … partitioning strategies. Develop and maintain documentation, including data models, ETL processes, and system configurations. Troubleshoot issues related to data quality, pipeline failures, and performance bottlenecks. Stay updated on industry best practices and emerging trends in Snowflake and data engineering. Requirements: Proven experience as more »

Data Engineer Our client based near Manchester is looking for a skilled Data Engineer to join their agile team. In this role, you'll play a pivotal part in designing, building, and maintaining data pipelines, ensuring the integrity and availability of data for various stakeholders, including BI Teams, Analytics, and Data Scientists. Responsibilities: Design, build, and automate data flow processes and ELTs to provide comprehensive data from business systems. Collaborate with product development teams to ensure best practices and data integrity from … source to destination. Assist in integrating data between systems, including third-party platforms. Write specifications and documentation for data processes. Continuously explore new solutions, tools, and processes to enhance data operations. Requirements: Bachelor's or Master's degree in Computer Science, related field, or more »

Mid-Senior Level Data Engineer - Financial Services Location: Manchester, UK Salary: Up to £70k THIS ROLE DOES NOT OFFER VISA SPONSORSHIP Join a dynamic and innovative team within the financial services sector, where cutting-edge technology meets the world of finance. We're working with a forward-thinking … company dedicated to leveraging data to drive actionable insights and empower smarter decision-making. Explore Group are seeking a talented and experienced Senior Data Engineer to join our clients team in Manchester. As a Senior Data Engineer, you will play a pivotal role in … architecting, developing, and maintaining their data infrastructure within the Azure Cloud environment. Your expertise will be instrumental in driving the success of their data-driven initiatives, with a focus on efficiency, scalability, and reliability. Responsibilities: Design, build, and maintain scalable data pipelines and ETL more »

Senior Data Engineer - Up to £70k - Greater Manchester - hybrid working (Need to be based locally) This role does not offer sponsorship. iO Associates is recruiting a talented Senior Data Engineer for one of our clients in the eCommerce industry. This is an exciting time to join … a business that is undergoing significant digital transformation in line with it's evolving Data strategy. What will you be doing? Designing, developing and deploying robust data pipelines and ETL processes to transform and store large volumes of structured and unstructured data from diverse … sources. Implementing best practices for data modelling, storage and retrieval to ensure scalability, reliability and performance of business data infrastructure. Collaborating with data scientists and analysts to operationalise machine learning models and enable real-time data analytics for actionable insights. Working closely more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

In this role, you'll be part of a team that leverages cutting-edge tools and technologies to extract, analyse, and visualise complex data, ultimately contributing to the organisation's success. If you're driven, adaptable, and thrive in a fast-paced environment, we encourage you to apply. … Responsibilities: Conduct data manipulation and transformation in Azure, Snowflake, and other specified data warehouses Design and execute data solutions. Manage dataset access and controls. Draft and validate processes. Document and log structural alterations in Azure/Snowflake. Develop and sustain data processes … applications, and features. Deploy and uphold database objects. Enhance and maintain tools for system analysis. Construct and manage Power BI data models in line with team requirements. Collaborate with stakeholders to implement existing and newly acquired contracts. Establish and maintain data warehouse infrastructure, flows, and pipelines. more »

Are you interested in working for a scaling technology company that specialises in delivering innovative data solutions? Found Talent are seeking a talented Data Engineer to join the company and work alongside other passionate individuals who share this vision. You will work closely with the organisation … creating apps and using data sources across multiple platforms. You will manage company data, monitor accuracy and completeness, and advise on ways that data quality can be improved. As a member of the team, you will work on exciting projects that challenge you and … help you develop your skills. Responsibilities: Develop and maintain reports and dashboards from a variety of data sources Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Design, develop, and implement data pipelines Identify, root more »

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »

businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Mortgage Services are hiring for a Data Engineer to work within the performance reporting function which provides invaluable insight to internal and external stakeholders around lending performance. This role would see … be working internally with the business to support workflow, change and business processes aimed to increase efficiency as well as upholding and ensuring data quality and maintenance of data structures, while using tools such as power BI to build dashboards and power automate to maintain and … create data pipelines. What you’ll be doing Building large, complex data systems and pipelines to enable the production of accurate and timely management information in accordance with business and individual stakeholder requirements. Identifying, designing, and implementing internal process improvements, automating manual processes, optimizing data more »

ETL Developer 1 day a month in their Cumbria offices ETL, JavaScript, Python, Data Modelling , Kafka 55k & benefits Join an award-winning software company nestled in the serene beauty of the Lake District. We're on the lookout for a dynamic ETL Developer to be part of their … growing team based out of Penrith in Cumbria. Collaborate with Business Intelligence, Data Management, and Software Development teams to drive ongoing product development. This role is all about data from crafting storage architectures to orchestrating extraction, formatting, and presenting data to end-users. Take … charge of the entire ETL process, ensuring seamless data flow and management. Enjoy the flexibility of remote work, with occasional visits to their Penrith/Lake District offices (expenses covered). Now is the perfect time to hop aboard their success story, as they embark on exciting growth more »

Senior Software Engineer with expertise in orchestrating end-to-end solutions from "curb to gate" while leveraging AWS, Python, Node.js, Kafka, and Big Data technologies. Job Description: As a Senior Software Engineer specializing in _Curb to Gate_ solutions, you will play a pivotal role in designing, developing, and … robust software systems that orchestrate seamless user journeys from entry point to destination. Leveraging your expertise in AWS, Python, Node.js, Kafka, and Big Data technologies, you will contribute to the creation of scalable and efficient solutions that enhance the overall user experience. Responsibilities: - Architect and develop end-to … backend services and APIs using Python and Node.js, ensuring high performance, reliability, and security. - Implement event-driven architectures using Kafka for real-time data processing and communication between microservices. - Utilize Big Data technologies (e.g., Apache Spark, Hadoop) to process and analyze large volumes of data more »

hire a 'Manual QA Engineer' for one of our leading data analytics clients, to work on cutting-edge data streaming pipeline that processes large company datasets. Collaboration is key, working closely with the data engineering team to enhance test coverage. Your responsibilities extend … to improving or creating new test frameworks and data utilities. Responsibilities in the role: • Design, develop, and execute tests using tools like Postman, 'Octoperf' or similar for API testing. • Develop test plans, test cases, and testing scripts, maintaining documentation of results and tracking bugs • Writing automated test frameworks … years of QA experience writing automated test frameworks with Selenium or other relevant technology. · Experience with Playwright · Experiencing in functional testing data pipelines (ETL, data warehouse) · C#, JavaScript or TypeScript skills · L1 Support experience for client issues Plusses: · API testing · Data Streaming Application (Kafka more »

Data Engineer Role Pearson Carter are currently working with an social policy software and analytics company who are looking for a Data Engineer to join their Team. In this role their is an opportunity to take responsibility and lead on new development work. Responsibilities: You will … be responsible for ensuring that the team maintains and improves the quality of our data pipelines, and their downstream products Leading the data team, growing junior team members Ensuring the security of data entrusted to the organisation, minimising the risk of security breach, potential … rokas@pearsoncarter.com or 0191 406 6111. Azure, Python, SQL, SSIS, SSAS, SSRS, Datafactory, Databricks, Node, Typescript, IaaS, PaaS, SaaS, Cloud, DevOps, CI, CS, Pipelines, Data, Engineer, Architect, Platform, Security, Servers, Storage, Development, Applications, Virtualisation, Hardware, Software, Hybrid, Middleware, Runtime, App, Virtual, Computing, Apps, Application, Bespoke, Ireland, Northwest, Dublin more »

acquisition of a new BI Developer. As a BI Developer, you will collaborate closely with cross-functional teams to understand business requirements, design data models, and develop robust BI reports and dashboards. This role will be based from the Leeds office on a hybrid working model to be … BI solutions using tools such as Power BI, Tableau, or similar. Collaborate with stakeholders to gather and analyse business requirements. Develop and maintain data models, ETL processes, and data pipelines. Create interactive dashboards and reports to provide insights into key business metrics. Optimise query performance and … ensure data accuracy and integrity. Stay updated with emerging BI trends and technologies to drive continuous improvement. Utilise real time analytics to have a meaningful impact on business performance. Requirements: Relevant Degree in Computer Science or similar field Advanced Power BI SQL & SSRS DAX Experience with cloud platforms more »

at THG, you'll automate and optimise infrastructure, support expansion, and enhance service reliability. Key tasks include cloud automation, Linux engineering, CI/CD pipeline implementation, performance monitoring, and proactive operational improvements. Role As a DevOps Engineer across the engineering teams, you will be working on ways to automate … be expected to help our busy technical teams with full stack project builds, networking, cloud deployment, automation, infrastructure optimisation, Linux system administration, optimal data delivery architecture, content work and anything else to help us meet customer needs. We’ll expect you to work to project milestones, reporting to … will work closely with the Engineering teams to ensure that deployed infrastructure meets quality, security and safety standards. You will build and maintain data pipelines (including those from 3rd party sources and APIs). You will automate repetitive data tasks and infrastructure using CI/CD more »