26 to 43 of 43 Data Pipeline Jobs in the North West

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

Data Engineer | Python, SQL & AWS | Up to £80k | Fully Remote Fancy being part of a new data team, with the opportunity to help build and shape the platform from day one? I'm working with a growing financial services business looking for a Data Engineer to help develop its AWS data platform. What you'll be doing: Building data pipelines using Python and SQL. Working with AWS, including S3, Glue, Lambda and Redshift. Integrating data from internal systems and external sources. Automating reporting and improving data ...

PermanentManchester, United Kingdom90,000Founding Data Engineer4 day working week – Monday – ThursdayUp to 90,000 + bonus/equityAbout the companyA well-backed startup building a platform that enables car dealerships to acquire vehicles directly from private sellers in a more efficient, data-led way. They … scaling quickly across the US and are now at the point where data needs to evolve from something functional into something structured, scalable and commercially powerful. This is a Founding Data Engineer hire, offering real ownership from day one and the opportunity to shape how data ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Regulatory Data Developer, you will shape the reporting systems that keep our regulatory data accurate, timely and ready for change. The Regulatory Data … Server solutions to GCP, while helping to design and deliver new cloud-native reporting systems in BigQuery. The work spans data modelling, pipeline development, validation and automation, with AI-assisted development also playing a part in improving consistency and reducing manual effort. Qualifications Strong Google BigQuery experience. ...

make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider ...

maintaining complex, AWS-native software systems within their area of ownership. This role combines deep hands-on software engineering expertise with strong cloud, data engineering, and AI capabilities. The Senior Software Engineer drives architectural decisions, delivers high-quality production code, and champions engineering excellence through rigorous testing, code … experience developing cloud-native applications and services within AWS environments. Strong background in data engineering, including data modeling, ETL development, pipeline design, and large-scale data processing. Demonstrated experience building and deploying production-grade AI agents and agentic systems that solve real-world ...

tell whether the numbers stack up? Our client is looking for a Commercial BI Manager (Commercial Planning & Insights Manager) to turn complex data into clear sales plans, sharper forecasts and practical opportunities for growth. Reporting to the Head of Sales, you’ll bring regional sales targets, customer opportunities … events. Turn insight into action: Identify commercial risks and growth opportunities, with clear recommendations on what to do next. Keep the data dependable: Validate figures, investigate discrepancies and maintain consistent definitions and reporting controls. Connect the teams: Work with Sales, Marketing, Category, Pricing and Finance, presenting findings clearly ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Lead Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Lead Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

value outcomes over output, build the smallest thing that works and then iterate. Skills: • Distributed systems • Cloud (cost and security aware) and IaC • Data pipelines, vector stores and embeddings • AI assisted engineering (Claude Code, agents, evals) • Consulting and stakeholder management You should be tech agnostic and expect ...

Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. … take on complex, hands-on engineering challenges, building modern data platforms that have a tangible impact on how public services are delivered. Key Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver ...

organization's technology communities to foster a culture of technical excellence and growth. Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions. Implementation of effective unit testing practices to ensure proper code design, readability, and reliability. Assistant Vice President ExpectationsTo advise … work, for business aligned support areas to keep up to speed with business activity and the business strategy. Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively ...

optimise Large Language Model (LLM) applications. Create AI-powered copilots, chatbots, knowledge management solutions, and workflow automation tools. Build and maintain scalable data pipelines to support AI initiatives. Implement Retrieval-Augmented Generation (RAG) frameworks and vector databases. Integrate AI technologies into existing business systems, applications, and processes. Evaluate … emerging AI technologies and recommend solutions that deliver measurable business benefits. Monitor and improve model performance, accuracy, reliability, and security. Collaborate with data engineers, software developers, and business stakeholders to gather requirements and deliver solutions. Establish AI governance, best practices, and responsible AI standards. Provide technical guidance ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full job details ...

Engineer, you'll work across the full solution lifecycle, helping to design, build and deploy AI-powered applications whilst ensuring the underlying integrations, data and processes are robust and scalable. You'll be involved in: Building AI-enabled solutions such as conversational assistants, workflow automation and intelligent document … Generation (RAG) and agent-based approaches Taking solutions from prototype through to deployment, monitoring and continuous improvement Building and maintaining APIs, integrations and data pipelines that support AI applications Working closely with business stakeholders to understand operational challenges and translate them into practical technical solutions Supporting user testing ...

combine structured study from Sheffield Hallam University with practical consulting experience, working alongside Capgemini Invent colleagues to help our clients address real business, data, AI and technology challenges. Role As a Digital & Technology Solutions Degree Apprentice, you’ll work as part of a team delivering and improving digital … help organisations run more effectively. When you join, you’ll start on one of the below pathways, depending on your skills and interests: Data Analyst In this pathway, you’ll learn how to use data to help organisations understand performance and make informed decisions. ...

real impact from day one, taking ownership of solutions from initial concept through to deployment. The Role Working closely with the Director of Data and Business Optimisation, you will design, build and deploy AI-powered applications, agents and integrations to improve efficiency across finance, billing, field operations … using modern programming languages and large language models. Integrating AI solutions with Microsoft 365, finance, CRM, workforce management and other business systems. Building data pipelines and reporting services to provide reliable, consistent business information. Implementing effective AI governance, security, testing and monitoring to ensure solutions are reliable, compliant ...

delivery and resourcing. \n \n Capability Building & Tech Pioneer \n \n Champion resilient, extensible, and reusable platform capabilities (APIs, Cloud infrastructure, and modern data architectures) that ensure scalability and a competitive advantage. \n Partner closely with engineering teams to challenge and inform technological choices that enable both near … success metrics and customer-driven acceptance criteria to measure product impact and performance post-launch. \n \n Commercial & Business Focus \n \n Leverage data, business analytics, and operational rigor to ensure high-quality product performance and well-managed execution within a highly regulated consumer credit landscape. \n Partner ...

implements process improvement initiatives by engaging with cross-functional teams. Responsible to scan processes for AI automation and augmentation, develop business cases, design data pipelines and models, and lead end-to-end execution from discoveries through production and ongoing optimization Strong grounding in prompt engineering, NLP, optimization … experience translating operational pain points into deployable solutions; excellent communication and storytelling; and a track record delivering complex programs. Preferred: exposure to enterprise data, process mining, and responsible AI Assigned to moderately complex business problems and/or a piece of an enterprise-wide initiative. Conducts research ...