1 to 25 of 37 Permanent Data Pipeline Jobs in the North West

Data Scientist Location: Manchester, Exchange Quays Working pattern: Hybrid- 2 days a week on site Department: Technology Salary: Competitive, dependent on experience About the role We're looking for a Data Scientist to join an ambitious technology business in Manchester, working at the intersection of data … pipelines and data workflows Work with AWS services including S3, RDS, Lambda, ECS, Glue and CloudWatch Monitor data quality, pipeline performance and production issues Design and maintain data models and database schemas Write efficient SQL queries and work with relational databases ...

Data Engineer This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms that … Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Current active SC or eligibility for SC Clearance ...

Title: Senior Data Platform Engineer - Compliance Assurance Contract: 12 Months Location: Chester -3 days per week onsite Rate: Highly Competitive Status: Inside IR35 Working pattern: Fulltime About the role We are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable … code reviews and CI/CD pipelines to manage code changes and promote solutions through Development, UAT and Production. Troubleshoot production issues, improve pipeline performance and establish operational monitoring and support procedures. Collaborate with architects, platform engineers, control owners, risk teams and vendors to deliver reusable engineering solutions. Explore ...

Senior Data Engineer This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms … Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being most Senior of Lead within ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

seeking a Data Engineer for a leading marine energy company based on Merseyside but operating globally to its maritime clients. The company provides battery and hybrid energy solutions that are used across the maritime industry. They offer products worldwide supported by remote and on-site monitoring to ensure … first-class customer service. Data Engineer - The Role This is a full-time permanent position working for an outstanding Company who will provide full training The role operates the observability and data infrastructure behind an industrial energy-telemetry platform. You will collect and process large volumes ...

expected to investigate problems independently, gather technical evidence and determine whether an issue sits within the frontend, backend, API, database, data pipeline, automation or environment. You will have: Strong commercial experience as an SDET, QA Automation Engineer or similar. Strong TypeScript or JavaScript development skills. Strong hands … also be beneficial: Node.js React/Redux Docker/Docker Compose AWS RDS Advanced Cucumber.js JSON Schema/AJV ETL and data-pipeline testing Analytics and dashboard testing Python or R Performance testing and investigation Figma Canvas-based visualisation libraries such as Chart.js, D3 or amCharts Prior ...

will be accountable for the delivery, quality and technical direction of the team's work across Oracle Database, Oracle APEX applications and the data pipelines that ingest, transform and validate data from multiple internal and external sources. You will make sure that data … backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception handling ...

Senior Data Engineer – SQL/Python/AWS Adria Solutions is recruiting a Senior Data Engineer for a growing business developing a new digital services platform. With established backing, the business is building its data capability from the ground up. As its first dedicated … data engineer, you’ll have significant input into the architecture, technology choices and standards that underpin reporting, analytics and future AI capabilities. The role Reporting to the CTO, you’ll turn platform, transaction and third-party data into trusted datasets for operational insight, financial reporting ...

Databricks Data & AI Engineer Manchester or London (Hybrid Working) | Up to £50,000 + Bonus + Benefits Are you passionate about building modern data platforms and working with the latest Data & AI technologies? Do you want to play a key role in delivering large … scale data transformation projects for some of the UK's most recognised organisations? An exciting opportunity has arisen for a Databricks Data & AI Engineer to join a leading technology and consulting organisation with a strong reputation for delivering cutting-edge cloud, data, analytics ...

pass up this chance, apply quickly if your experience and skills match what is in the following description. Palantir Foundry Consultant/Data Engineer | Defence & Security SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth of a leading Palantir capability … within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development ...

Palantir Foundry Consultant/Data Engineer | Defence & Security Please double check you have the right level of experience and qualifications by reading the full overview of this opportunity below. SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth … leading Palantir capability within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through ...

Palantir Foundry Consultant/Data Engineer | Defence & Security Please double check you have the right level of experience and qualifications by reading the full overview of this opportunity below. SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth … leading Palantir capability within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through ...

Description Palantir Foundry Consultant/Data Engineer | Defence & Security \n SC Cleared/DV Eligible \n London/Bristol/Manchester \n Salaries DOE \n We're supporting the growth of a leading Palantir capability within a high performing Technology & Transformation practice, delivering complex data … This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development and deployment of solutions across the Palantir Foundry platform . You'll transform complex data into trusted information ...

Description Palantir Foundry Consultant/Data Engineer | Defence & Security \n SC Cleared/DV Eligible \n London/Bristol/Manchester \n Salaries DOE \n We're supporting the growth of a leading Palantir capability within a high performing Technology & Transformation practice, delivering complex data … This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development and deployment of solutions across the Palantir Foundry platform . You'll transform complex data into trusted information ...

Data Engineer for MS Fabric Integration based in Lancashire On going contract programme Lancashire Hybrid | Competitive Salary + Benefits Are you a skilled Data Engineer looking to make a real impact? We're seeking a proactive and technically strong individual to help shape and develop … data platform using Microsoft Fabric . This role will provide dedicated data engineering capability with a primary focus on developing and optimising the use of Microsoft Fabric. The team has already begun establishing capability in Fabric alongside ongoing delivery. This role will build on that foundation ...

Data Engineer for MS Fabric Integration based in Lancashire On going contract programme Lancashire Hybrid | Competitive Salary + Benefits Are you a skilled Data Engineer looking to make a real impact? We're seeking a proactive and technically strong individual to help shape and develop … data platform using Microsoft Fabric . This role will provide dedicated data engineering capability with a primary focus on developing and optimising the use of Microsoft Fabric. The team has already begun establishing capability in Fabric alongside ongoing delivery. This role will build on that foundation ...

extend) Location: Hybrid working IR35 Status: Outside Start Date: ASAP About the Role This is an opportunity to lead the delivery of a data transformation, helping an organisation establish its first centralised data warehouse and modern reporting capability.This is a hands-on contract role where … through to implementation, documentation and knowledge transfer. What You'll Do Lead the end-to-end design and delivery of a Microsoft Fabric data platform. Design and implement scalable data warehouse/lakehouse architecture. Build and optimise automated data pipelines from APIs, databases, SaaS ...

deploy intelligent, scalable solutions that integrate machine learning models, event streaming pipelines, and cloud-native services on Azure and AWSArchitect and implement data platforms using Snowflake for analytics and reporting, ensuring seamless integration with broader enterprise data ecosystemsBuild and maintain real-time event streaming architectures (e.g. … continuous learning and experimentationPartner with Architecture and Data Science teams to define best practices for ML model deployment, data pipeline design, and cloud infrastructure standardsConduct thorough code reviews with a focus on AI-assisted quality, providing constructive feedback to enhance code quality and team expertiseCollaborate ...

Reporting in to the Head of IT, the successful Data Engineer will work on building and maintaining data pipelines to support analytics and decision-making processes. This role is all about ensuring data flows smoothly and efficiently, helping the business make informed choices. Client … mission is to "enrich the lives of pets and their owners through visibly better pet food." We are currently looking to grow our Data Engineering & Analytics team Description The successful Data Engineer will be responsible for but not limited to: Design, build and maintain efficient ...

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

Data Engineer | Python, SQL & AWS | Up to £80k | Fully Remote Fancy being part of a new data team, with the opportunity to help build and shape the platform from day one? I'm working with a growing financial services business looking for a Data Engineer to help develop its AWS data platform. What you'll be doing: Building data pipelines using Python and SQL. Working with AWS, including S3, Glue, Lambda and Redshift. Integrating data from internal systems and external sources. Automating reporting and improving data ...

PermanentManchester, United Kingdom90,000Founding Data Engineer4 day working week – Monday – ThursdayUp to 90,000 + bonus/equityAbout the companyA well-backed startup building a platform that enables car dealerships to acquire vehicles directly from private sellers in a more efficient, data-led way. They … scaling quickly across the US and are now at the point where data needs to evolve from something functional into something structured, scalable and commercially powerful. This is a Founding Data Engineer hire, offering real ownership from day one and the opportunity to shape how data ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Regulatory Data Developer, you will shape the reporting systems that keep our regulatory data accurate, timely and ready for change. The Regulatory Data … Server solutions to GCP, while helping to design and deliver new cloud-native reporting systems in BigQuery. The work spans data modelling, pipeline development, validation and automation, with AI-assisted development also playing a part in improving consistency and reducing manual effort. Qualifications Strong Google BigQuery experience. ...

make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider ...