19 Data Pipeline Jobs in the North of England with Remote Work Options

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your … expertise will be critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with … partitioning strategies. Develop and maintain documentation, including data models, ETL processes, and system configurations. Troubleshoot issues related to data quality, pipeline failures, and performance bottlenecks. Stay updated on industry best practices and emerging trends in Snowflake and data engineering. Requirements: Proven experience as more »

About Us Airtime Rewards is delivering the leading data-led rewards technology globally. We believe every shopper should feel great about their daily spend. Our app is loved by our members (>3.5m!) and we're continually building new features that drive towards our vision that sees hundreds of … and insight that transforms their understanding of their customers. We do all this with our cutting-edge proprietary technology, utilising real-time purchase data and AI learning to delight our members and maintain relationships with >200 retailers (including Boots, Aldi, Tesco, Greggs, Selfridges, and Halfords to name a … ourselves on culture, are solving new problems, and need great people to join us on our international journey as we deliver the leading data-led rewards technology globally. The Opportunity We are looking to recruit a Data Engineer to join and strengthen our existing team and more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

In this role, you'll be part of a team that leverages cutting-edge tools and technologies to extract, analyse, and visualise complex data, ultimately contributing to the organisation's success. If you're driven, adaptable, and thrive in a fast-paced environment, we encourage you to apply. … Responsibilities: Conduct data manipulation and transformation in Azure, Snowflake, and other specified data warehouses Design and execute data solutions. Manage dataset access and controls. Draft and validate processes. Document and log structural alterations in Azure/Snowflake. Develop and sustain data processes … applications, and features. Deploy and uphold database objects. Enhance and maintain tools for system analysis. Construct and manage Power BI data models in line with team requirements. Collaborate with stakeholders to implement existing and newly acquired contracts. Establish and maintain data warehouse infrastructure, flows, and pipelines. more »

Are you interested in working for a scaling technology company that specialises in delivering innovative data solutions? Found Talent are seeking a talented Data Engineer to join the company and work alongside other passionate individuals who share this vision. You will work closely with the organisation … creating apps and using data sources across multiple platforms. You will manage company data, monitor accuracy and completeness, and advise on ways that data quality can be improved. As a member of the team, you will work on exciting projects that challenge you and … help you develop your skills. Responsibilities: Develop and maintain reports and dashboards from a variety of data sources Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Design, develop, and implement data pipelines Identify, root more »

Senior Data Engineer (Databricks) Hybrid working - 3 days onsite in Manchester Up to £70,000 I'm currently working with a data-centric organisation who are looking for a Senior Data Engineer with strong Databricks experience to join their team. The primary focus of … the role is Databricks data engineering. You will be building data pipelines using Databricks, coding using PySpark, and supporting internal applications. You will also be using Python for Data Transformations and work across the Azure Data Platform. Must Have Strong Databricks Data Engineering skills, not just admin but actually building data pipelines in Databricks and using it regularly. Strong coding experience with Pyspark. Strong experience in SQL Server and Python coding. Knowledge of Azure Data Factory. Strong 3-5 years working as a Data more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Newcastle. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and … and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. CI/CD pipeline automation utilising GitLab DevOps: GKE (Kubernetes), Terraform, Ansible Leadership capabilities: mentorship, management Role overview: If you're eager to collaborate with a driven team more »

Council, Sparks – Engagement Champion to name a few. We are hiring for Senior Product Developer Job Description:- Design, developing and testing large scale data processing systems through data pipelines and ETL's. Working closely with architects, analysts, and stakeholder to bring efficient and scalable solutions in … data processing. Skills : Specific skills we need – strong SQL, performance tuning, python for ETL frameworks and robust data warehousing experience and GCP. Strong experience in python strong knowledge of sql/plsql and ability to write performant sql queries Experience working on data pipelines … data warehouse and ETL's. GCP experience (Migration to cloud is a plus)(pub/sub, dataflow, dataproc, big query, cloud sql) knowledge in containers and container orchestration CI/CD experience version control (GIT) Orchestration tools ( airflow or cloud composer more »

our distinct culture, and our dedication to in-person collaboration sets us apart.About the roleWe're looking for Principal Software Engineers to build data products and help us improve our platform potential. Auto Trader makes data-informed decisions; we discuss and build solutions together, identifying areas … and patterns in how we use our data, enabling our platform users to self-serve their needs. We have teams working on a wide range of applications; from building the core data platform capabilities through to teams using insight to build specialized user experiences for our … customers. We are at the cutting edge of applying data technologies to solve problems and you can expect to work with a range of technologies including dbt, Kotlin/Java, Python, Apache Spark and Kafka.Join us as a Principal Software Engineer and, as well as shaping and creating more »

acquisition of a new BI Developer. As a BI Developer, you will collaborate closely with cross-functional teams to understand business requirements, design data models, and develop robust BI reports and dashboards. This role will be based from the Leeds office on a hybrid working model to be … BI solutions using tools such as Power BI, Tableau, or similar. Collaborate with stakeholders to gather and analyse business requirements. Develop and maintain data models, ETL processes, and data pipelines. Create interactive dashboards and reports to provide insights into key business metrics. Optimise query performance and … ensure data accuracy and integrity. Stay updated with emerging BI trends and technologies to drive continuous improvement. Utilise real time analytics to have a meaningful impact on business performance. Requirements: Relevant Degree in Computer Science or similar field Advanced Power BI SQL & SSRS DAX Experience with cloud platforms more »

part of our client's growing engineering division, you will play a pivotal role in designing, implementing, and optimising machine learning models and data pipelines. With a strong emphasis on AWS technologies and MLOps practices, you'll have the opportunity to contribute to the development of scalable, production … what you will learn: Experience developing, deploying, and maintaining machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI …/CD, and model monitoring. Proficiency in Python and relevant data manipulation and analysis libraries (e.g., pandas, NumPy). Experience with distributed computing frameworks like Apache Spark is a plus. Apache Spark and Airflow would be a bonus. Role overview: If you're looking to work with a more »