26 to 50 of 119 Data Pipeline Jobs in the North of England

Snowflake Data Engineer I am working with a hugely successful organisation based in Leeds who are looking for a Snowflake Data Engineer to join their newly formed data practice. You will join a business to work on their exciting Greenfield data platform … project, where you will have the opportunity to create the data warehouse from scratch and shape the ongoing direction of the data platform. You will work to build and maintain a robust and scalable data platform and will support the organisation's BI and … analytics goals. You will work closely with developers to transform data ready for reporting purposes to deliver accurate information to key business stakeholders. As part of this role you will be responsible for - Design and develop data pipelines ensuring the successful integration of data More ❯

A highly-successful Data Consultancy are seeking a technical Databricks Architect to design and deliver cutting-edge solutions using Databricks on Azure. This Consultancy are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in … their data. They pride themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you'll get involved from the early pre-sales stage of client projects … of high-level design skills and hands-on data engineering skills, spanning areas such as data modelling, data pipeline development and optimisation, data governance and documentation, with the ultimate goal of delivering a best-in-class yet cost-effective solution for More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This full-time, permanent position offers the chance … to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive innovative solutions, this role is perfect for you. … Data Engineer Responsibilities Design and maintain scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across More ❯

Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, we’re looking for an experienced Data … and software engineering teams to maintain seamless data integration and flow. Implement monitoring, logging, and alerting systems to track data pipeline performance and integrity. Uphold data security and compliance across all environments. Data Engineer experience we’re looking for - Demonstrated expertise … Kafka, Pulsar, and RabbitMQ. Extensive experience with high-performance databases, including PostgreSQL, ClickHouse, Cassandra, and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and enhancing real-time reporting. … At Dufrain we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have a great opportunity for a … engineering experience. Strong understanding of SQL and NoSQL databases, SQL, CosmosDB and Kusto Query Language (KQL). Solid experience of data pipeline development using both cloud and on-premises data sources. Excellent problem-solving, analytical, and communication skills. Strong desire to learn and adapt More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I’m working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data … This is a fantastic opportunity to join a forward-thinking company where you’ll play a key role in developing and optimising their data platform. The Role: As a Data Engineer , you’ll be working closely with the front office to understand data needs … and help shape the company’s data capabilities. You’ll be responsible for building and optimising data pipelines, automating data processes, and ensuring high data quality and governance. Key Responsibilities: Collaborate with the front office to scope and understand data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is … work with cutting-edge technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of … data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

Lead BI Developer Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington) - £60-70k + excellent bonus + bens An experienced Lead … BI Developer is urgently required by my client with significant experience of designing, building, implementing and maintaining robust data solutions on Azure SQL and BI platforms. Strong knowledge of ADF, Azure Data Lakes, Azure SQL and Synapse Analytics will be needed, along with experience of designing … data pipelines (ETL/ELT). Experience of technical leadership will also be required. Lead BI Developer Role and Responsibilities: - Development and maintenance of the Data Warehouse and Business Intelligence system infrastructure - Gather, interpret and develop reporting requirements through working in partnership with business leads - Develop More ❯

Software Engineer – Data focused – Hybrid in York – up to £60,000 About the Role We are seeking an experienced and highly motivated Senior C# Developer with a strong focus on data-centric development to join our dynamic technology team. You will play a pivotal role in … designing, developing, and maintaining robust C# applications with a deep integration into large-scale data pipelines, databases, and analytics platforms. Key Responsibilities Design, develop, and maintain C# applications and backend services with a strong emphasis on data integration and transformation. Optimise large-scale data … and ensure high-performance querying and storage. Develop and maintain RESTful APIs and services that interact with large datasets. Implement best practices for data integrity, data quality, and data security. Contribute to the design of data models, schemas, and ETL pipelines. Collaborate More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title : Data Engineer with Azure Experience Location : Newcastle/Sunderland, UK About the Role We are seeking a talented and motivated Mid Data Engineer … cloud technologies to join our team in Newcastle/Sunderland. The ideal candidate will play a key role in designing, building, and optimizing data pipelines, integrating various data sources, and supporting the development of scalable data architectures. This is a great opportunity for an More ❯

Senior Data Engineer - MS Fabric - Remote - £70k - £75k My client are a leading Data Partner and consultancy looking for an experienced senior data engineer with skills in Microsoft Fabric being the absolute essential here, the Azure Data Platform and Python to join … programme - guaranteed learning and development investment Life insurance Private medical health insurance Contributory pension scheme Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Azure Develop good working relationships with clients on a project including interpersonal skills with … both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support More ❯

ECOM are pleased to be exclusively recruiting for a Senior Data Engineer here in Manchester. You'll join a team where your work reaches millions. This role is within a forward-thinking company leading, offering a dynamic environment where you can grow, make an impact, and shape the … future of technology. The Role: As a Data Engineer, you'll design, develop, and optimise data pipelines on a Databricks-based platform, Symphony. You'll collaborate with teams to create scalable data solutions, ensuring efficient data ingestion, transformation, and analysis. Responsibilities: Design … and maintain scalable data pipelines and infrastructure using Databricks. Collaborate with commercial teams to define data product requirements and visualisations. Develop and optimise ETL/ELT processes for smooth data flow and accurate analysis. Ensure adherence to data architecture principles and support More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a start up tech consultancy and help to lead their data engineering practice. If you are an experienced and capable data engineer … and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the … engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, Synapse, SQL) Expert use of Databricks More ❯

Senior Data Engineer - MS Fabric - Remote - £70k - £75k My client are a leading Data Partner and consultancy looking for an experienced senior data engineer with skills in Microsoft Fabric being the absolute essential here, the Azure Data Platform and Python to join … programme - guaranteed learning and development investment Life insurance Private medical health insurance Contributory pension scheme Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Azure Develop good working relationships with clients on a project including interpersonal skills with … both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … delivery. Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly More ❯

Senior Analyst & Data Specialist Location: Liverpool Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯

AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data Engineer to … join our client’s growing team? You'll play a key role in developing, maintaining, and improving our end-to-end data pipeline, working with cutting-edge technologies and large-scale datasets in real-time. Skills and Experience: Strong problem-solving skills Knowledge of AWS or similar … Experience debugging business-critical systems Role and Responsibilities: Write high-quality application code and tests Develop infrastructure automation and scheduling scripts for reliable data processing Continuously improve platform performance with cutting-edge technologies Provide support for production systems Review code and give helpful feedback Developing scalable backend and More ❯

Data Architect – Databricks Hybrid (Manchester or London) Up to £100,000 Full-time, Permanent About the Role Our client, a dynamic Microsoft Partner, is seeking a highly skilled Data Architect with deep expertise in Databricks. This is a strategic role focused on designing, leading, and delivering … modern data solutions for enterprise clients across various sectors. You will work closely with stakeholders to define architecture, modernise data platforms, and guide delivery teams through complex implementations. Key Responsibilities Design and lead the architecture of modern data solutions using Databricks. Collaborate with clients … solutions, contribute to technical discovery sessions, and articulate architectural approaches. Support proposal development by providing technical input, solution design narratives, and estimations for data platform engagements. Define best practices around data modelling, ETL/ELT pipelines, and data platform scalability. Champion cloud-native principles More ❯