126 to 150 of 373 Data Pipeline Jobs in the UK excluding London

to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key … e.g., star/snowflake schemas) Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support groundwork for future data … requirements clearly across business teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments and when translating complex business needs More ❯

to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast-growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … a variety of industries, which may include telecoms, insurance, healthcare, finance and mortgages across various sectors. The Role We are seeking a skilled Analytics Engineer to join our Data Engineering team, ideally as a permanent consultant opportunity. We can move fast and adapt our selection period to our needs. With this in mind, immediate or quick availability is … permanent rights to work are essential, alongside other factors we'll consider. This is a hands-on Analytics Engineering role where you'll be at the heart of data-driven decisions. Day to day you will be transforming raw data in clean, reliable and performant data models using dbt within Google Cloud Platform (GCP More ❯

control for subscribers. The world's largest content providers, including Amazon, Google and Microsoft trust Bango technology to reach subscribers everywhere. Bango, where people subscribe. Role As Product Data Analyst you will play a key role in building the Bango Digital Vending Machine that makes Bango the place where people subscribe. Reporting to VP Product, you will play … ignite ideas and opportunities to drive the growth of the DVM as well as design dashboards for tracking performance. We are seeking a highly motivated and detail-oriented Data Analyst to join our team. In this role, you will be responsible for turning raw data into actionable insights that drive strategic decisions across the business. Responsibilities … Discover opportunities in data for Bango to drive the performance of the Bango Digital Vending Machine and new data product opportunities. Conduct in-depth exploratory, descriptive, and diagnostic analysis to identify patterns, trends, and anomalies. Build and maintain dashboards and reports to track key performance indicators (KPIs) Collaborate with stakeholders across product, marketing, engineering, operations, sales More ❯

AWS Data Engineer - Manchester - Hybrid - £75,000 We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about … building scalable data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You'll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such More ❯

AWS Data Engineer - Manchester - Hybrid - £75,000 We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about … building scalable data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You'll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Role Profile: Data Engineer Reporting to : Lead Data Engineer Background A rapidly growing specialist (re)insurance organisation is building out its technology and data infrastructure. This role supports the delivery of secure, scalable cloud data solutions, aligning with business and compliance needs. Key Responsibilities Design, build, and maintain cloud-native data pipelines (Azure/GCP) Implement scalable data management frameworks: observability, validation, lineage Translate business needs into effective technical prototypes and solutions Collaborate with stakeholders, data teams, and service partners Ensure data security, governance, and regulatory compliance Monitor and optimise cloud resource usage and performance Automate data lifecycle tasks to improve … speed, consistency, and reliability Support analytics teams with clean, modelled data for self-service tools Mentor peers, share documentation, and support technical best practices Integrate infrastructure and data services across cloud platforms Skills and Experience Expertise in cloud platforms: Azure : Data Factory, Synapse, Monitor, ARM GCP : BigQuery, Dataflow, Cloud Composer, Pub/Sub Strong More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Data Engineer, Non Cleared - Policing background We are seeking a skilled and motivated Data Engineer with a background in policing or law enforcement to join our data and analytics team. The successful candidate will play a key role in designing, building, and maintaining data pipelines and infrastructure to support data-driven decision-making across policing operations. Your understanding of law enforcement processes, systems, and compliance requirements will be vital in shaping data solutions that are secure, ethical, and impactful. Rate - Negotiable Duration - 6- 12 Months Location - West Midlands - twice a week onsite Responsibilties Design, develop, and maintain scalable data pipelines to collect, process, and … transform structured and unstructured data from various policing systems. Collaborate with analysts, data scientists, and operational policing units to understand data requirements and deliver appropriate data solutions. Work with ETL/ELT tools to integrate data from sources such as Niche, Athena, PNC, custody systems, and other law enforcement platforms. More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools.* Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech, or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Senior Data/Power BI Engineer West Midlands/HybridPermanent - Full Time Are you passionate about turning data into powerful insights? TXP is looking for a Senior Data/Power BI Engineer to help our clients unlock the full potential of their data. In … this role, you'll: Design and deploy Power BI models and dashboards Collaborate with stakeholders to shape intelligent analytics solutions Support data warehousing and data pipeline development Drive analytics maturity and best practices across client organisations Mentor junior team members and lead by example What you'll bring: Expertise in Power BI, DAX, and SQL … Experience with Microsoft Fabric or similar platforms Strong understanding of manufacturing processes and ERP systems A passion for data storytelling and business impact Join a consultancy that values innovation, diversity, and continuous learning. Be part of a team that's shaping the future of data-driven decision-making. Apply now and help us build smarter, data More ❯

prospecting and qualification through to negotiation and deal closure. Identifying key decision-makers and internal champions within target businesses to support deal progression. Building and maintaining a strong, qualified pipeline and consistently delivering against revenue targets. Working collaboratively with the wider sales, product, and engineering teams to refine value propositions and go-to-market approaches. Delivering consultative, solution-based … sales conversations focused on operational and financial outcomes for merchants. Accurately managing Salesforce, CRM data, pipeline forecasting, and activity reporting. Requirements We'd love it if you have A proven track record in B2B sales, coupled with experience selling to mid-cap and enterprise clients - ideally within fintech, SaaS, or payments (or a similar industry focused on … about Super Payments? If applying via Otta, please provide us with your phone number here. GDPR Select When you apply to a job on this site, the personal data contained in your application will be collected by Super Payments Ltd ("Controller"), which is located at 2 Temple Back East, Temple Quay, Bristol, BS1 6EG ( and can be contacted More ❯

Data Analyst - 6 month contract - North London Based My global client is currently looking for a Data Analyst to join their Supply Chain Analytics team. This role will report into the Logistics Manager - Supply Chain Analytics - you will primary be responsible for working on day to day data analysis, building datasets, and a strategic … project to replace existing manual Excel reports with automated database sourced Power BI dashboards. Some of your responsibilities will be to: Identify manual data inputs and map them to appropriate fields in new or existing databases Collaborate with data engineers and/or IT to establish data pipelines that replace manual data sources. Rebuild reports using automated connections (e.g., Python, Excel Power Query, Power BI, Power Automate) linked to centralized data sources. Ensure data integrity, accuracy, and consistency across all reports during and after migration. Build and maintain automated dashboards and reports to support the day-to-day logistics operation. In order to be successful you More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet systems. Collaborating with a More ❯

days in office Leeds £60K We are looking for a BI Developer to join our clients team in Leeds. The ideal candidate will have experience in PowerBI, Data Engineering, and have a strong understanding of data warehousing and business intelligence. The role will involve working with a team of data engineers to design, develop … and maintain data pipelines. You will also be responsible for creating and managing data models, and developing reports and dashboards using PowerBI. The successful candidate will be a highly motivated and self-directed individual with excellent communication and teamwork skills. They will also have a strong understanding of data analysis and visualization techniques. Responsibilities … Create and manage data models Designing, developing, testing, and implementing robust data applications powered by cutting-edge technologies like Azure DataFactory, PowerBI, Qlikview, and SSRS. Develop reports and dashboards using PowerBI Work with a team of data engineers to improve data quality and performance Provide technical support to users of PowerBI Qualifications More ❯

of over 1,000 expert consultants and engineers across the UK, Germany, France, and India. We work with leading global clients to deliver cutting-edge infrastructure, cloud, and data solutions that shape the digital future. As a Data Engineer, youll be part of a collaborative, high-performing team that values continuous learning, professional excellence, and technical … innovation. Youll contribute to major customer programmes and benefit from the support of a well-established knowledge-sharing community. What you'll do Design and implement data solutions using Snowflake across cloud platforms (Azure and AWS) Build and maintain scalable data pipelines and ETL processes Optimise data models, storage, and performance for analytics and … reporting Ensure data integrity, security, and best practice compliance Serve as a subject matter expert in Snowflake engineering efforts within delivery teams Collaborate with internal teams and customer stakeholders to define and deliver robust data solutions Participate in customer meetings to present and discuss technical solutions Identify and escalate technical risks where necessary What you'll More ❯