76 to 100 of 146 Data Pipeline Jobs in the North West

ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. Maia fixes that by combining 15 years … data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester and now we’re global - with teams across ...

currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Role Requirements Strong proficiency … handling Delta Lake formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge of structural data formats including Parquet, JSON, and CSV Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment Familiarity with unit testing data pipelines ...

Manchester (3 Days per Week in the Office) Are you a Senior Data Engineer who prefers building the foundations that make reporting possible, rather than inheriting someone else's platform and maintaining it? This role sits within a growing digital transformation and project controls consultancy delivering reporting … data solutions across major capital programmes. You'll work across two established client accounts from day one, building the data capability behind board-level reporting rather than simply producing dashboards. The work starts with understanding what stakeholders need to know, tracing that back to where ...

About Capgemini Invent Capgemini Invent is the future of AI consulting, blending strategy, creativity, and data science to help clients achieve transformation. YOUR ROLE This role sits at the intersection of strategy, innovation and delivery, perfect for someone who thrives on solving complex problems. From Agentic … enabling the AI-empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. DESIGN next-generation data, analytics and AI platforms – design and implement scalable, secure and cost-efficient platforms that power operational and analytical workloads leveraging leading cloud technologies ...

make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Platform Engineer at Naimuri, you will ...

Hippo is seeking a Senior Azure Data Engineer to join our Managed Services Team in the Manchester area. You will lead production data pipelines, collaborate with internal and client teams, and drive platform reliability and data-driven decision making. You’ll apply expertise … Python, Microsoft Fabric, and Azure Data Factory to deliver scalable, automated data solutions, with on-call commitments within a dynamic consultancy environment. #J-18808-Ljbffr ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … system backed by an Elasticsearch cluster. A custom workflow tool with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer ...

5+ years. Here are some things we’ve worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … Elasticsearch cluster. A custom workflow tool with a React/TS front‐end. An AI assurance capability. Orchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role As a Senior Software Engineer, you will lead ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer, you will lead ...

Airports Group) is hiring a Lead Data Engineer to shape Cavu's data platform. You will lead a team of Data Engineers while building scalable, cloud-based data pipelines and supporting analytics, forecasting and ML. Reporting to Head of Data Engineering, you will define strategy, drive best practices, partner with data scientists and analysts, and ensure data governance, security and quality across data lakehouse and streaming architectures. #J-18808-Ljbffr ...

development, automation, and general software engineering. The successful candidate will play a key role in building and deploying machine learning features and data-driven applications. You will work on end-to-end solutions – from writing robust code and unit tests to developing APIs and integrating machine learning models …/CD and automation tools; experience using Git for version control and platforms like Bitbucket for code collaboration; knowledge of build tools and pipeline configuration (Jenkins) to automate testing and deployment. Strong problem‐solving and analytical skills. Presentation and teamwork skills. Understanding of both Waterfall and Agile methodologies. #J ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Lead Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Lead Data Engineer , you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Software Engineer at Naimuri ...

Datalex is seeking a Senior Software Engineer specializing in Python-based AI/ML development to design and deploy machine learning features. The role involves building APIs, collaborating on CI/CD, and mentoring Junior ...

with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. Skills and Competencies 3+ years of experience within a data engineering or software development team Hands-on experience designing and developing data integration/ETL pipelines from diverse data sources … applying AI-assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelors degree or equivalent experience ...

bank’s digital footprint across on-prem and cloud assets, assessing exposure and exploitable risk. You’ll build and maintain data pipelines, queries, and dashboards to support cyber risk stakeholders. The role requires strong SQL/Python skills, experience with Qualys, Tanium, BladeLogic, and SSRS/Power BI. ...

security engineer and leading engineering initiatives in a DevSecOps environment. Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment. Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex ...

Jacobs Engineering Group Inc. is seeking a Senior Data Engineer to join our Data & Digital team in a hybrid role across the UK. You will design, build and maintain cloud-based data pipelines, collaborating with engineers, analysts and stakeholders to unlock data value and enable informed decisions. You will work with AWS and Azure services, implement data quality checks, and contribute to scalable data solutions across government and regulated environments. #J-18808-Ljbffr ...

risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence. Skills And Competencies 1+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources … assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelor’s degree or equivalet experience; Master ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

Role: Data Analyst Location: Stockport, Greater Manchester (Hybrid: 1 to 2 days per week in office) Salary: Up to £40,000 Are you a data professional with strong SQL and Power BI skills looking to take the next step into modern analytics and Microsoft Fabric … partnering with an established, innovation-focused software business to find a Data Analyst to join their collaborative R&D team. You will report directly to the IT Infrastructure Manager and work alongside experienced software engineers and testers in an environment that actively embraces modern, AI-assisted development tools. ...

network integration (including streaming protocols such as RTSP or ONVIF), real-time video analytics, edge deployment, or R&D infrastructure such as synthetic data pipelines and evaluation tooling So What's Next? If you are a Senior Software Engineer with strong skills in Python, Linux, Docker, and ideally ...

Moody’s Digital Content & Innovations Data Engineering team is seeking a data engineer to design, build, and support scalable data pipelines powering Moody’s next-generation digital content platform. You will develop data workflows using Databricks, Snowflake, Apache Airflow … Python within AWS to turn diverse data sources into reliable analytics. You will collaborate with cross-functional teams and mentor peers to improve data quality and governance. #J-18808-Ljbffr ...

Consultant/Senior Consultant in our Operational Analytics team, you will work directly to help clients make tangible improvements to their operations through Data, Analytics and AI. Your assignments may focus on supply chain, capital infrastructure and asset management, process intelligence, commercial analytics or other operational challenges across … techniques to areas such as supply chain planning, forecasting, logistics, network optimisation, asset reliability, process improvement and cost-to-serve analysis. Turn complex data into clear analyses, models, dashboards and decision-support tools that help clients act on insights. Understand business challenges, identify opportunities for AI-enabled transformation ...