17 Data Pipeline Jobs in the North West

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

get the chance to get matched to this role and other similar roles, click on Apply to set up your free profile. Their Data Team is made up of 50+ people, covering data engineering, data science, and data architecture specialisms. The team … works with a range of public and private sector clients, building production grade cloud solutions focussed on streaming, graph, big data, and data science use cases. Job Description Due to the nature of the client engagements, every employee needs to be able to achieve Security Clearance. … and are proud to have an organisational culture where employees can bring their authentic selves to work. Team They are constructing the top data engineering practice in the UK, and their team build bespoke, mission critical data solutions for the UK Government as well as bluechip more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your … expertise will be critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with … partitioning strategies. Develop and maintain documentation, including data models, ETL processes, and system configurations. Troubleshoot issues related to data quality, pipeline failures, and performance bottlenecks. Stay updated on industry best practices and emerging trends in Snowflake and data engineering. Requirements: Proven experience as more »

About Us Airtime Rewards is delivering the leading data-led rewards technology globally. We believe every shopper should feel great about their daily spend. Our app is loved by our members (>3.5m!) and we're continually building new features that drive towards our vision that sees hundreds of … and insight that transforms their understanding of their customers. We do all this with our cutting-edge proprietary technology, utilising real-time purchase data and AI learning to delight our members and maintain relationships with >200 retailers (including Boots, Aldi, Tesco, Greggs, Selfridges, and Halfords to name a … ourselves on culture, are solving new problems, and need great people to join us on our international journey as we deliver the leading data-led rewards technology globally. The Opportunity We are looking to recruit a Data Engineer to join and strengthen our existing team and more »

Data Engineer Our client based near Manchester is looking for a skilled Data Engineer to join their agile team. In this role, you'll play a pivotal part in designing, building, and maintaining data pipelines, ensuring the integrity and availability of data for various stakeholders, including BI Teams, Analytics, and Data Scientists. Responsibilities: Design, build, and automate data flow processes and ELTs to provide comprehensive data from business systems. Collaborate with product development teams to ensure best practices and data integrity from … source to destination. Assist in integrating data between systems, including third-party platforms. Write specifications and documentation for data processes. Continuously explore new solutions, tools, and processes to enhance data operations. Requirements: Bachelor's or Master's degree in Computer Science, related field, or more »

Senior Data Engineer Manchester (Hybrid Role) £70,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Senior Data Engineer Salary: £68,202 to £75,780 Location: Manchester Hours: Full time Working Pattern: Our work style is hybrid, at least 2 days per week in our Manchester office. About this Opportunity This is an outstanding opportunity to work in a team delivering regulatory and technology … engineering skillset. We'll support you to be able to be able to take on technical challenges and develop your understanding of how data solutions and services are developed, tested and implemented. If this excites you then you would be an asset to our team! We are pioneering … journey in deploying solutions on the Google Cloud Platform. This role sits within our labs analytics pillar who are looking to create strategic data products and build data and analytics capability. We work using agile delivery practices, so a self-led individual capable of accurately estimating more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … The ideal candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain more »

In this role, you'll be part of a team that leverages cutting-edge tools and technologies to extract, analyse, and visualise complex data, ultimately contributing to the organisation's success. If you're driven, adaptable, and thrive in a fast-paced environment, we encourage you to apply. … Responsibilities: Conduct data manipulation and transformation in Azure, Snowflake, and other specified data warehouses Design and execute data solutions. Manage dataset access and controls. Draft and validate processes. Document and log structural alterations in Azure/Snowflake. Develop and sustain data processes … applications, and features. Deploy and uphold database objects. Enhance and maintain tools for system analysis. Construct and manage Power BI data models in line with team requirements. Collaborate with stakeholders to implement existing and newly acquired contracts. Establish and maintain data warehouse infrastructure, flows, and pipelines. more »

Are you interested in working for a scaling technology company that specialises in delivering innovative data solutions? Found Talent are seeking a talented Data Engineer to join the company and work alongside other passionate individuals who share this vision. You will work closely with the organisation … creating apps and using data sources across multiple platforms. You will manage company data, monitor accuracy and completeness, and advise on ways that data quality can be improved. As a member of the team, you will work on exciting projects that challenge you and … help you develop your skills. Responsibilities: Develop and maintain reports and dashboards from a variety of data sources Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Design, develop, and implement data pipelines Identify, root more »

Senior Data Engineer (Databricks) Hybrid working - 3 days onsite in Manchester Up to £70,000 I'm currently working with a data-centric organisation who are looking for a Senior Data Engineer with strong Databricks experience to join their team. The primary focus of … the role is Databricks data engineering. You will be building data pipelines using Databricks, coding using PySpark, and supporting internal applications. You will also be using Python for Data Transformations and work across the Azure Data Platform. Must Have Strong Databricks Data Engineering skills, not just admin but actually building data pipelines in Databricks and using it regularly. Strong coding experience with Pyspark. Strong experience in SQL Server and Python coding. Knowledge of Azure Data Factory. Strong 3-5 years working as a Data more »

About The RoleHippo Digital is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo’s Principal Data Engineers are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.Your role … identifying and ensuring that challenges are overcomeLead in the recruitment of other engineers, and support other consultants in their professional developmentEnsure Hippo’s Data and Engineering communities contribute to Hippo’s business at a strategic levelLead on new business opportunities, writing technical bids and proposalsPromote Hippo’s Data more »

our distinct culture, and our dedication to in-person collaboration sets us apart.About the roleWe're looking for Principal Software Engineers to build data products and help us improve our platform potential. Auto Trader makes data-informed decisions; we discuss and build solutions together, identifying areas … and patterns in how we use our data, enabling our platform users to self-serve their needs. We have teams working on a wide range of applications; from building the core data platform capabilities through to teams using insight to build specialized user experiences for our … customers. We are at the cutting edge of applying data technologies to solve problems and you can expect to work with a range of technologies including dbt, Kotlin/Java, Python, Apache Spark and Kafka.Join us as a Principal Software Engineer and, as well as shaping and creating more »