1 to 25 of 32 Data Pipeline Jobs in Shrewsbury

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of … systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business … needs and analytic strategies. Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure. Essential Skills: Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Who are Inference Group? Are you ready to be a part of a company that’s redefining the future of data and AI? Welcome to Inference Group, where we’re not just a tech startup – we’re a team of passionate innovators dedicated to empowering businesses through the … transformative power of data, machine learning, and AI. At Inference Group, we’re on a mission to help businesses unlock their true potential and drive sustainable growth. As we rapidly expand, we’re looking for like-minded, creative technical experts who want to make a real impact. Here … of MLOps practices and tools – e.g., version control for data/models, CI/CD for machine learning, containerization (Docker, Kubernetes), and pipeline orchestration. Understanding of data engineering principles (ETL/ELT processes, data warehousing) to oversee data pipeline development. More ❯

Azure Data Engineer Remote (UK-based) Up to £60,000 per annum About the Company We are a leader in the insurance sector, committed to data-driven decision making and modernising our technology landscape. As part of our continued growth, we’re seeking a skilled Azure … Data Engineer to support our data platform and engineering initiatives. Role Overview As an Azure Data Engineer, you will be instrumental in designing, building, and optimising data pipelines and architecture in our Azure environment. This role is ideal for someone with strong … SQL skills and a background in Azure data services, looking to play a key role in transforming and scaling our data operations. Key Responsibilities Develop and maintain scalable data pipelines in Azure. Build and optimise data integration workflows using Azure Data More ❯

collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and … C#. This role would suit an experienced Data platform engineer or Data Solutions Architect who thrives in working across multiple projects with a diverse range of clients, and who places the importance of bridging the gap between complex data problems and real life product More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Data Engineer We’re working with a forward-thinking Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. … You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights creation. … This is a fantastic opportunity for someone who is passionate about building scalable, high-performance data solutions utilising the latest cutting-edge cloud technologies. As part of this role, you will be responsible for some of the following areas • Design and develop scalable data pipelines to More ❯

Head of Data Engineering & Governance Investment & Wealth Management Hybrid (3 days at home with 2 days traveling in the UK) £120k - £140k basic (DOE) + bonus (10-25%) and benefits (pension, life insurance, healthcare, holidays, & more). “Money makes the world go round,” they say. Maybe it did … But now? It’s data. This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance … for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly More ❯

a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable … Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data More ❯

Senior Data Engineer – 6-Month Contract | London | Insurance Sector We're exclusively recruiting for a Senior Data Engineer to join a leading organisation within the Property & Casualty Insurance sector. 📍 Location : London (Hybrid) ⏳ Contract : 6 months (potential extension) 📁 Sector : Insurance – Property & Casualty 💼 Work Type : Contract (Inside IR35 …/Outside – subject to discussion) You’ll be embedded within the Actuarial team , building scalable data platforms and pipelines to support pricing analysis. You’ll work closely with stakeholders, lead third-party collaborations, and play a critical role in optimising and managing robust data infrastructure. 🔧 Key … as a Data Engineer (ideally in the insurance or financial sector). Expertise in SQL Server , ETL frameworks , and data pipeline development . Solid knowledge of Python , Azure , AWS , and tools like Databricks , Glue , S3 , etc. Ability to identify and resolve performance bottlenecks and data More ❯

leading-edge finance solutions through a unique combination of teamwork and technology. From this continued success we are now looking to recruit a Data Analyst to allow us to continue our exciting growth plans. Our aim is to take the service we offer to the next level, to … d like to be part of? As a key member of our team, you’ll be responsible for translating business requirements into practical data models, reports, and dashboards that deliver real insights Role responsibilities; Stakeholder Engagement: Collaborate with key stakeholders across the business to understand their data needs, gather requirements, and provide clear insights that drive decision-making. Data Modelling & Analysis : Design, develop, and maintain scalable data models to ensure data quality and accuracy, utilising SQL and Azure Synapse where necessary. Dashboard Development: Build and maintain visually compelling and More ❯

Recruitment Company is working with an Environmental and Sustainability Business that supports and empower their customers journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting … and data requirements. About the role: The Data Engineer will be working with the latest innovative technologies, to design, build and maintain data solutions, constructing process to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources whilst ensuring data quality under the framework of a new Data Platform for real time application integration and reporting, and will work closely with business stakeholders More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) 👩🏽‍💻 Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland 🌍 numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space … We are looking for experienced Lead Backend Engineers (PHP) to join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build … features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer More ❯

Data Engineer (Azure, SQL, ETL, Databricks, Data Factory) South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly … across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the … company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the More ❯

Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that … into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing … from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up More ❯

Job Title: Data Engineer (Azure) Rate: £350-600/day DOE (outside IR35) Location: Remote Contract Length: 6 months A consultancy client of ours have secured a project with a leading European bank. They are seeking an Azure focused Data Engineer to work with them on … a a contract basis. This is an exciting opportunity to work on cutting-edge data projects, building scalable data pipelines and cloud-based systems that deliver real impact. The end client operate in Azure hence Microsoft Azure experience is required for consideration. Key Responsibilities: Design, develop … and maintain scalable and high-performance data pipelines on Azure. Optimise data storage and retrieval processes to enhance performance and reduce costs. Collaborate with data scientists, analysts, and product teams to deliver data-driven solutions that support business objectives. Work with both More ❯

Lead Data Engineer Telford, Shropshire Up to £100k + Benefits A new role for a Lead Data Engineer has arisen with an international Tech company working on a major UK Government Programme designing and delivering a range of data solutions. This is an opportunity … to play a key role in a collaborative function architecting data pipelines and infrastructure, leading in both a technical sense but also through mentorship and establishing best practices and standards. The Role The Lead Data Engineer will design and implement complex data flows to … connect operational systems, build and maintain data environments, evaluate and develop tools to improve data analytics platforms and recognise opportunities to reuse existing data flows between teams. Requirements This is a leadership role and requires not only demonstrable experience of leading on data More ❯

client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with … and Power BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we … d love to hear from you. Essential Expertise: Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus More ❯

Data Science Manager Remote (UK-Based) Up to £75,000 The Company This UK-based start-up has achieved … rapid growth in just two years, now boasting a team of ~40 people across divisions. Following a successful funding round and with a strong pipeline ahead, they continue to scale at pace. They specialise in predictive analytics and KPI tracking across a broad range of companies and industries. Their … predictive insights empower hedge funds and investors with critical performance data, ahead of public earnings reports. The Role As a Data Science Manager , you’ll take ownership of the end-to-end development of KPI prediction models and manage a team of data scientists More ❯

Job Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits Salary: £55–65k This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The … role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system … with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive More ❯

Insight Global is seeking a Azure Data Engineers to join a prestigious energy client based in London. The successful candidates will be responsible for designing, implementing, and managing live data streaming pipelines for the client’s Energy Trading team. This role involves designing data pipelines for Crude and Products trading data from on-premise DB2 … databases to an Azure Cloud environment. This is an Inside IR35 contract role and the individual must sit out of the UK. Key Responsibilities: Pipeline Management: Design, implement, and manage live data streaming pipelines using Azure Databricks to ensure seamless data flow and real-time More ❯

of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for a motivated and technically capable Graduate Data & AI Engineer to join our growing Microsoft consultancy team. This is an exciting opportunity for someone early in their career to gain hands-on … experience delivering real-world Data and AI solutions on the Azure platform, while also developing consulting skills through direct customer engagement. In this role, you’ll support the design, development, and deployment of data pipelines, analytics solutions, and AI-powered applications. You’ll work alongside experienced … engineers and consultants, contributing to a wide range of projects- from traditional data engineering and reporting to modern machine learning and Generative AI initiatives. We’re looking for someone who is passionate about technology, eager to learn, and comfortable working in a dynamic environment. You should have a More ❯

in Life Sciences, Financial Services, and Technology . Our work helps enterprise clients better understand, engage, and convert their customers, with the right data powering the right decisions. We’re now hiring an Analytics Engineer to support a high-profile international client. This role focuses on transforming and … modelling marketing data so it can be used for decision-making, personalisation, and campaign activation across multiple platforms and markets. The Role As an Analytics Engineer , you’ll sit between data engineering and marketing activation. Your job is to make raw data usable, building … segmentation, performance measurement, and automated marketing journeys. You won’t be running campaigns or designing the customer journey, but you’ll ensure that data flows cleanly and accurately across the Martech stack so CRM teams can. Day to day you’ll be designing and maintaining high-quality, analysis More ❯

Senior Data Engineer Competitive Salary and Benefits Package Fully Remote I am working with a leading Fintech business who are currently strengthening their data team. In this key role, you will be working in an agile environment supporting multiple teams to develop creative data-driven solutions, building high performance, resilient, automated data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be very keen to hear from you: Advanced SQL Knowledge (Oracle, PostgreSQL, MSSQL, etc.). Scripting languages … Python, PowerShell). Web service APIs (SOAP, REST). Data modelling experience. Knowledge of Snowflake Analytics Platform would be an advantage. Experience in working within an Agile environment. Knowledge of GIT, Jenkins (CI). Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For a More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯