25 of 25 Permanent Data Pipeline Jobs in Manchester

Data Scientist Location: Manchester, Exchange Quays Working pattern: Hybrid- 2 days a week on site Department: Technology Salary: Competitive, dependent on experience About the role We're looking for a Data Scientist to join an ambitious technology business in Manchester, working at the intersection of data … pipelines and data workflows Work with AWS services including S3, RDS, Lambda, ECS, Glue and CloudWatch Monitor data quality, pipeline performance and production issues Design and maintain data models and database schemas Write efficient SQL queries and work with relational databases ...

Data Engineer This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms that … Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Current active SC or eligibility for SC Clearance ...

Senior Data Engineer This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms … Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being most Senior of Lead within ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

expected to investigate problems independently, gather technical evidence and determine whether an issue sits within the frontend, backend, API, database, data pipeline, automation or environment. You will have: Strong commercial experience as an SDET, QA Automation Engineer or similar. Strong TypeScript or JavaScript development skills. Strong hands … also be beneficial: Node.js React/Redux Docker/Docker Compose AWS RDS Advanced Cucumber.js JSON Schema/AJV ETL and data-pipeline testing Analytics and dashboard testing Python or R Performance testing and investigation Figma Canvas-based visualisation libraries such as Chart.js, D3 or amCharts Prior ...

will be accountable for the delivery, quality and technical direction of the team's work across Oracle Database, Oracle APEX applications and the data pipelines that ingest, transform and validate data from multiple internal and external sources. You will make sure that data … backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception handling ...

Senior Data Engineer – SQL/Python/AWS Adria Solutions is recruiting a Senior Data Engineer for a growing business developing a new digital services platform. With established backing, the business is building its data capability from the ground up. As its first dedicated … data engineer, you’ll have significant input into the architecture, technology choices and standards that underpin reporting, analytics and future AI capabilities. The role Reporting to the CTO, you’ll turn platform, transaction and third-party data into trusted datasets for operational insight, financial reporting ...

Databricks Data & AI Engineer Manchester or London (Hybrid Working) | Up to £50,000 + Bonus + Benefits Are you passionate about building modern data platforms and working with the latest Data & AI technologies? Do you want to play a key role in delivering large … scale data transformation projects for some of the UK's most recognised organisations? An exciting opportunity has arisen for a Databricks Data & AI Engineer to join a leading technology and consulting organisation with a strong reputation for delivering cutting-edge cloud, data, analytics ...

pass up this chance, apply quickly if your experience and skills match what is in the following description. Palantir Foundry Consultant/Data Engineer | Defence & Security SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth of a leading Palantir capability … within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development ...

Description Palantir Foundry Consultant/Data Engineer | Defence & Security \n SC Cleared/DV Eligible \n London/Bristol/Manchester \n Salaries DOE \n We're supporting the growth of a leading Palantir capability within a high performing Technology & Transformation practice, delivering complex data … This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development and deployment of solutions across the Palantir Foundry platform . You'll transform complex data into trusted information ...

deploy intelligent, scalable solutions that integrate machine learning models, event streaming pipelines, and cloud-native services on Azure and AWSArchitect and implement data platforms using Snowflake for analytics and reporting, ensuring seamless integration with broader enterprise data ecosystemsBuild and maintain real-time event streaming architectures (e.g. … continuous learning and experimentationPartner with Architecture and Data Science teams to define best practices for ML model deployment, data pipeline design, and cloud infrastructure standardsConduct thorough code reviews with a focus on AI-assisted quality, providing constructive feedback to enhance code quality and team expertiseCollaborate ...

Reporting in to the Head of IT, the successful Data Engineer will work on building and maintaining data pipelines to support analytics and decision-making processes. This role is all about ensuring data flows smoothly and efficiently, helping the business make informed choices. Client … mission is to "enrich the lives of pets and their owners through visibly better pet food." We are currently looking to grow our Data Engineering & Analytics team Description The successful Data Engineer will be responsible for but not limited to: Design, build and maintain efficient ...

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

Data Engineer | Python, SQL & AWS | Up to £80k | Fully Remote Fancy being part of a new data team, with the opportunity to help build and shape the platform from day one? I'm working with a growing financial services business looking for a Data Engineer to help develop its AWS data platform. What you'll be doing: Building data pipelines using Python and SQL. Working with AWS, including S3, Glue, Lambda and Redshift. Integrating data from internal systems and external sources. Automating reporting and improving data ...

PermanentManchester, United Kingdom90,000Founding Data Engineer4 day working week – Monday – ThursdayUp to 90,000 + bonus/equityAbout the companyA well-backed startup building a platform that enables car dealerships to acquire vehicles directly from private sellers in a more efficient, data-led way. They … scaling quickly across the US and are now at the point where data needs to evolve from something functional into something structured, scalable and commercially powerful. This is a Founding Data Engineer hire, offering real ownership from day one and the opportunity to shape how data ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Regulatory Data Developer, you will shape the reporting systems that keep our regulatory data accurate, timely and ready for change. The Regulatory Data … Server solutions to GCP, while helping to design and deliver new cloud-native reporting systems in BigQuery. The work spans data modelling, pipeline development, validation and automation, with AI-assisted development also playing a part in improving consistency and reducing manual effort. Qualifications Strong Google BigQuery experience. ...

make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider ...

maintaining complex, AWS-native software systems within their area of ownership. This role combines deep hands-on software engineering expertise with strong cloud, data engineering, and AI capabilities. The Senior Software Engineer drives architectural decisions, delivers high-quality production code, and champions engineering excellence through rigorous testing, code … experience developing cloud-native applications and services within AWS environments. Strong background in data engineering, including data modeling, ETL development, pipeline design, and large-scale data processing. Demonstrated experience building and deploying production-grade AI agents and agentic systems that solve real-world ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Lead Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Lead Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

value outcomes over output, build the smallest thing that works and then iterate. Skills: • Distributed systems • Cloud (cost and security aware) and IaC • Data pipelines, vector stores and embeddings • AI assisted engineering (Claude Code, agents, evals) • Consulting and stakeholder management You should be tech agnostic and expect ...

Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. … take on complex, hands-on engineering challenges, building modern data platforms that have a tangible impact on how public services are delivered. Key Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver ...

optimise Large Language Model (LLM) applications. Create AI-powered copilots, chatbots, knowledge management solutions, and workflow automation tools. Build and maintain scalable data pipelines to support AI initiatives. Implement Retrieval-Augmented Generation (RAG) frameworks and vector databases. Integrate AI technologies into existing business systems, applications, and processes. Evaluate … emerging AI technologies and recommend solutions that deliver measurable business benefits. Monitor and improve model performance, accuracy, reliability, and security. Collaborate with data engineers, software developers, and business stakeholders to gather requirements and deliver solutions. Establish AI governance, best practices, and responsible AI standards. Provide technical guidance ...

Engineer, you'll work across the full solution lifecycle, helping to design, build and deploy AI-powered applications whilst ensuring the underlying integrations, data and processes are robust and scalable. You'll be involved in: Building AI-enabled solutions such as conversational assistants, workflow automation and intelligent document … Generation (RAG) and agent-based approaches Taking solutions from prototype through to deployment, monitoring and continuous improvement Building and maintaining APIs, integrations and data pipelines that support AI applications Working closely with business stakeholders to understand operational challenges and translate them into practical technical solutions Supporting user testing ...

real impact from day one, taking ownership of solutions from initial concept through to deployment. The Role Working closely with the Director of Data and Business Optimisation, you will design, build and deploy AI-powered applications, agents and integrations to improve efficiency across finance, billing, field operations … using modern programming languages and large language models. Integrating AI solutions with Microsoft 365, finance, CRM, workforce management and other business systems. Building data pipelines and reporting services to provide reliable, consistent business information. Implementing effective AI governance, security, testing and monitoring to ensure solutions are reliable, compliant ...

implements process improvement initiatives by engaging with cross-functional teams. Responsible to scan processes for AI automation and augmentation, develop business cases, design data pipelines and models, and lead end-to-end execution from discoveries through production and ongoing optimization Strong grounding in prompt engineering, NLP, optimization … experience translating operational pain points into deployable solutions; excellent communication and storytelling; and a track record delivering complex programs. Preferred: exposure to enterprise data, process mining, and responsible AI Assigned to moderately complex business problems and/or a piece of an enterprise-wide initiative. Conducts research ...