26 to 50 of 74 Data Pipeline Jobs in Shrewsbury

Senior Backend Engineer (Platform Experience & Data Warehousing teams) 👩🏽‍💻 Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland 🌍 numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space … We are looking for experienced Senior Backend Engineers (PHP) to join either our Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualization tool (dashboards) and … build features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) 👩🏽‍💻 Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland 🌍 numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space … We are looking for experienced Lead Backend Engineers (PHP) to join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build … features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer More ❯

and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work. Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back … in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains. We hold top-level partnership statuses with all … and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such More ❯

Job Title: Senior Data Engineer - 12 month FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the … next phase of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and … optimise scalable data solutions using Azure cloud technologies. Lead the development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering More ❯

Data Analyst/Power BI/Tableau/SQL/Python/Azure/Permanent/Cardiff/Bristol/Hybrid Salary - £50 - £60K DOE Excellent Benefits Cardiff or Bristol Base – Expensed Travel across the company network I am lucky enough to be working with a global consultancy … as they grow their footprint. They are looking to add a Data Analyst on a permanent basis. This role will be based in Cardiff or Bristol; therefore, you will need to be commutable to one or the other or even both up to 3 days a week. Please … note that we cannot accept those on a short VISA or PSWV as the client cannot sponsor now or in the future. As Data Analyst, you will lead on the delivery of strategic insights that drive business decisions across commercial, operational, and product teams. You will work closely More ❯

Data Analyst/Power BI/Tableau/SQL/Python/Azure/Permanent/Cardiff/Bristol/Hybrid Salary - £50 - £60K DOE Excellent Benefits Cardiff or Bristol Base – Expensed Travel across the company network I am lucky enough to be working with a global consultancy … as they grow their footprint. They are looking to add a Data Analyst on a permanent basis. This role will be based in Cardiff or Bristol; therefore, you will need to be commutable to one or the other or even both up to 3 days a week. Please … note that we cannot accept those on a short VISA or PSWV as the client cannot sponsor now or in the future. As Data Analyst, you will lead on the delivery of strategic insights that drive business decisions across commercial, operational, and product teams. You will work closely More ❯

Data Engineer (Azure, SQL, ETL, Databricks, Data Factory) South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly … across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the … company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the More ❯

Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that … into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing … from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up More ❯

Job Title: Data Engineer (Azure) 💰 Salary: £50-60k (+ 15% bonus) ➕ Benefits : Private healthcare, up to 50% staff discount, free weekly lunches Free access to therapy, nutritionists and physiotherapists 📍 Location: Angel (4 office days/week) 🏦 Industry: Entertainment & hospitality We're looking for a Data … immersive experienced. With over 30 venues around the world, this award-winning brand has ambitious growth plans, with lots of exciting products in the pipeline 🚀 As a Data Engineer, you will be working in the technology team, helping to build out the existing Data and … platform. This role is placed within a small team, allowing the successful candidate design freedom in implementing bespoke features and enhancements to the data platform using the latest technology. Key responsibilities will include: Developing and maintaining data pipelines to orchestrate the ingestion of data More ❯

Possibility of remote work: Hybrid (2/3 days) Contract duration: 6 months-INSIDe IR 35 Location: London JOB DETAILS Role Title: Data Modeler/Technical Architect Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 6 years Job Description: Must have … hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data … modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands on experience in SQL developement Excellent More ❯

Lead Data Engineer Telford, Shropshire Up to £100k + Benefits A new role for a Lead Data Engineer has arisen with an international Tech company working on a major UK Government Programme designing and delivering a range of data solutions. This is an opportunity … to play a key role in a collaborative function architecting data pipelines and infrastructure, leading in both a technical sense but also through mentorship and establishing best practices and standards. The Role The Lead Data Engineer will design and implement complex data flows to … connect operational systems, build and maintain data environments, evaluate and develop tools to improve data analytics platforms and recognise opportunities to reuse existing data flows between teams. Requirements This is a leadership role and requires not only demonstrable experience of leading on data More ❯

client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with … and Power BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we … d love to hear from you. Essential Expertise: Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus More ❯

Job Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits Salary: £55–65k This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The … role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system … with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive More ❯

difficult problems. As of now, Camlin operates in over 20 countries worldwide.🌐 Key Responsibilities: Collaborate with cross-functional teams to identify and address data-related requirements, contributing to strategic planning and execution. Architect and develop data solutions, spanning from backend infrastructure to data model … design and the implementation of data science and machine learning algorithms. Lead development activities, mentor team members and share your knowledge in a context of continuous improvement. Continuously enhance the quality of our tools and applications through bug fixes and code refactoring. Leverage the latest data … along with systems like Spark, Kafka, and Airflow, within cloud services such as AWS. Ensure the ongoing maintenance, troubleshooting, optimization, and reliability of data systems, including timely resolution of unexpected issues. Stay abreast of emerging technologies through research and testing, unlocking opportunities for productivity improvements and ensuring our More ❯

Contract Data Engineers (x3) – Defence Sector – Bristol Outside IR35 | DV Clearance Required Location: Bristol (Onsite/Hybrid) | Contract Duration: 6-12 months+ We are recruiting three experienced Data Engineers for a leading defence client in Bristol. This is a contract opportunity operating outside IR35, offering a … in a high-security, mission-critical environment. You must already hold UK DV Clearance , Key Responsibilities: Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana) Build and maintain … robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and troubleshoot real-time data pipelines to ensure high performance and reliability Write efficient, secure scripts and code using Python, Bash, or similar languages More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for a motivated and technically capable Graduate Data & AI Engineer to join our growing Microsoft consultancy team. This is an exciting opportunity for someone early in their career to gain hands-on … experience delivering real-world Data and AI solutions on the Azure platform, while also developing consulting skills through direct customer engagement. In this role, you’ll support the design, development, and deployment of data pipelines, analytics solutions, and AI-powered applications. You’ll work alongside experienced … engineers and consultants, contributing to a wide range of projects- from traditional data engineering and reporting to modern machine learning and Generative AI initiatives. We’re looking for someone who is passionate about technology, eager to learn, and comfortable working in a dynamic environment. You should have a More ❯

Quant Data Scientist - Hedge Fund - UAE Relocation - Leading Comp We are seeking a Data Scientist to join a high-calibre Quant team within a discreet fund based in the UAE, operating at the intersection of Quantitative Research and Artificial Intelligence. This role is dedicated to leveraging … data and language models to support the research, development, and implementation of systematic investment strategies. The successful candidate will combine strong technical skills with a solid understanding of financial markets and a passion for innovative data applications. Key Responsibilities Develop and maintain automated data … models. Conduct descriptive and exploratory analysis to uncover patterns, trends, and potential applications across a wide range of datasets. Maintain robust and scalable data infra to support real-time and batch processing workflows. Provide domain expertise to help shape financial knowledge representation in LLM outputs. Develop and apply More ❯

Quant Data Scientist - Hedge Fund - UAE Relocation - Leading Comp We are seeking a Data Scientist to join a high-calibre Quant team within a discreet fund based in the UAE, operating at the intersection of Quantitative Research and Artificial Intelligence. This role is dedicated to leveraging … data and language models to support the research, development, and implementation of systematic investment strategies. The successful candidate will combine strong technical skills with a solid understanding of financial markets and a passion for innovative data applications. Key Responsibilities Develop and maintain automated data … models. Conduct descriptive and exploratory analysis to uncover patterns, trends, and potential applications across a wide range of datasets. Maintain robust and scalable data infra to support real-time and batch processing workflows. Provide domain expertise to help shape financial knowledge representation in LLM outputs. Develop and apply More ❯

outperform their competition through speed and innovation. About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … debugging, and performance-tuning skills. Preferred Qualifications Strong communication skills and demonstrated ability to engage with business stakeholders and product teams. Experience in data modeling , data warehousing (e.g., Snowflake , AWS Glue , EMR , Apache Spark ), and working with data pipelines . Leadership experience—whether technical More ❯

You’ll Work With: Backend and integration work with Python , Node.js , and TypeScript Front-end work using React Cloud infrastructure via AWS APIs, data pipelines, and custom tooling for real-world deployments Opportunity to work with ML/AI systems at the integration level (no prior ML required More ❯

Senior Data Engineer Competitive Salary and Benefits Package Fully Remote I am working with a leading Fintech business who are currently strengthening their data team. In this key role, you will be working in an agile environment supporting multiple teams to develop creative data-driven solutions, building high performance, resilient, automated data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be very keen to hear from you: Advanced SQL Knowledge (Oracle, PostgreSQL, MSSQL, etc.). Scripting languages … Python, PowerShell). Web service APIs (SOAP, REST). Data modelling experience. Knowledge of Snowflake Analytics Platform would be an advantage. Experience in working within an Agile environment. Knowledge of GIT, Jenkins (CI). Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For a More ❯

Senior Data Operations Engineer Fully Remote Competitive Salary and Benefits Package I am working with a leading fintech client who are strengthening their data team. This is a key role, working as part of a team tasked with designing and developing high-performance and resilient automated … data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be really keen to hear from you: Advanced SQL Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving … related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For more information and a confidential chat about this role, contact Mark Raine at More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

Data Engineer – Paddington/Hybrid This is a project-based transformation role that is currently expected to end on 31st December 2026. 📍 London-based with hybrid flexibility | 🐾 Help build the future of pet care at Mars We’re looking for a skilled Data Engineer to join … our Pet Nutrition Digital team. You'll help us build a scalable, data-driven ecosystem that powers innovation across some of the world’s best-loved brands — and improves life for pets and pet owners everywhere. Join us on a multi-year digital transformation journey where your work … will unlock real impact. 🌟 What you'll do Build robust data pipelines using Python, PySpark, and cloud-native tools Engineer scalable data models with Databricks, Delta Lake, and Azure tech Collaborate with analysts, scientists, and fellow engineers to deliver insights Drive agile DevOps practices and continuous More ❯