101 to 125 of 379 Data Pipeline Jobs in the UK excluding London

Role title: Data engineer Rate: £425/d - £462/d Onsite requirement: Inside IR35 Contract lenght: 12 months Job Description : We are seeking a highly skilled and motivated Data Engineer to join our team in the Public Sector and Government industry. This is a full-time contract position with a duration of 12 months. The … successful candidate will be responsible for designing, developing, and maintaining our data infrastructure, ensuring efficient data migration, and supporting our data warehousing needs. Key Responsibilities : Design, develop, and maintain data pipelines using Data Stage, Red Shift, QuickSight, and S3. Perform data migration and ETL processes for both batch … and real-time data. Develop and optimise data warehouses to support business intelligence and analytic. Implement DevSecOps practices to ensure data security and compliance. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality and integrity across all data sources and systems. Utilise Java, SQL More ❯

employees to work with artificial intelligence (AI). One of BCAI's many training offerings is the 18-month expert program, in which employees develop into experts in data engineering and data science. "In a few years, software competence will be standard for every engineer", says Máté. As part of the expert program, the group leader … is training to become a data engineer. A data engineer's job is to organize, cleanse and make data available to others for use in training an artificial intelligence, for example. "As a leader, I feel a responsibility to educate myself in the field and be a role model. I didn't know anything … test reports should be generated automatically. He is bringing this project into the advanced training program to become a data engineer. The idea: "The data pipeline begins with the collection, conversion and structured storage of raw data. By means of AI, relevant data is automatically printed in the report, which only needs to More ❯

Data Engineer – Financial Services | Strong Kafka/Streaming Focus- Liverpool/Hybrid – Up to £75K (DOE) Our client, an innovative and rapidly expanding Financial Services organization, is seeking a Data Engineer to join their highly technical data team. This is a unique opportunity to be part of a forward-thinking company where data is central to strategic decision-making. We’re looking for someone who brings hands-on experience in streaming data architectures, particularly with Apache Kafka and Confluent Cloud, and is eager to shape the future of scalable, real-time data pipelines. You’ll work closely with both the core Data Engineering team and … the Data Science function, bridging the gap between model development and production-grade data infrastructure. What You’ll Do: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Confluent Cloud. Architect and implement robust, scalable data ingestion frameworks for batch and streaming use cases. Collaborate with stakeholders to More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … of the company's data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … of the company's data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform More ❯

Role: Snowflake Data Architect Location: Hove, UK Type: Permanent Role Work Mode: Hybrid Role & Responsibilities Define and implement the end-to-end architecture of Data warehouse on Snowflake. Create and maintain conceptual, logical, and physical data models in Snowflake. Design data pipelines and ingestion frameworks using Snowflake native tools. Collaborate with Data Governance teams to establish data lineage, data quality, and access control mechanisms. Engage with data stewards and stakeholders to build a comprehensive and scalable data warehouse. Implement RBAC, data masking, and encryption practices to ensure compliance with data security policies. Qualifications & Skills 10+ years of experience … in designing enterprise data platforms, with at least 5+ years in Snowflake. Strong expertise in SQL and data warehousing. Hands-on experience working in the insurance industry; prior experience with L&G is an advantage. 3+ years of experience with DBT for data transformation. Deep understanding of agile methodologies in data environments. More ❯

Data Engineer Remote (UK Only | No Visa Sponsorship) Build Scalable Data Infrastructure for Leading US Companies Talent Hero connects UK-based professionals with remote roles at innovative US tech firms. Were hiring Data Engineers who are logical, detail-oriented, and skilled at designing data pipelines and infrastructure. If you have strong backend … data skills and enjoy working with complex systems to deliver reliable, scalable solutions this is your chance to work globally from home. What Youll Do: Design, build, and maintain scalable data pipelines Integrate data from multiple sources and ensure data quality Collaborate with data scientists and analysts to support data needs Optimise data storage and retrieval for performance Work with batch and real-time processing frameworks Implement and manage ETL processes Use tools like Python, SQL, Spark, Airflow, Kafka, dbt, Snowflake, Redshift, BigQuery Requirements Bachelors degree in Computer Science, Engineering, or a related field 1+ year in a Data Engineer or similar role Proficiency More ❯

Data Engineer Remote (UK Only | No Visa Sponsorship) Build Scalable Data Infrastructure for Leading US Companies Talent Hero connects UK-based professionals with remote roles at innovative US tech firms. Were hiring Data Engineers who are logical, detail-oriented, and skilled at designing data pipelines and infrastructure. If you have strong backend … data skills and enjoy working with complex systems to deliver reliable, scalable solutions this is your chance to work globally from home. What Youll Do: Design, build, and maintain scalable data pipelines Integrate data from multiple sources and ensure data quality Collaborate with data scientists and analysts to support data needs Optimise data storage and retrieval for performance Work with batch and real-time processing frameworks Implement and manage ETL processes Use tools like Python, SQL, Spark, Airflow, Kafka, dbt, Snowflake, Redshift, BigQuery Requirements Bachelors degree in Computer Science, Engineering, or a related field 1+ year in a Data Engineer or similar role Proficiency More ❯

Evaro is looking to do for health care what online banking has done for finance, and we're looking for a Head of Data Science to help us that through data-driven insights and innovations. Our mission? To increase accessibility to prescription medications and improve health outcomes by providing a seamless, technology-driven solution that empowers … brands to integrate digital health services effortlessly, Evaro strives to build the online banking for UK healthcare. About the job We're looking to hire a Head of Data Science to build out and lead the data science capabilities across the organisation. You'll have a background in analytics, machine learning, and leading data teams. You'll be joining the company at an exciting time, working to build out a data team to help drive the company's direction. Ensuring that data isn't just analyzed but transformed into actionable insights that directly improve patient outcomes. Join Evaro as Head of Data Science to harness the More ❯

this role could be for you. The Role You will interact and build relationships with the client's front office and technology teams. Key responsibilities include: Data Pipeline Development: Design and develop sophisticated data pipelines to import data from external vendors, sell-side partners and other providers seamlessly into their central data … of their platform to ensure it aligns with ever-changing business requirements. Test the system regularly to confirm its effectiveness and perform troubleshooting when necessary Platform Maintenance and Data Reliability: Ensure the platform is well maintained, enabling uninterrupted access to crucial data points. Continuously verify data quality and integrity essential for investment process Continuous … improvement and collaboration: Collaborate with internal stakeholders to streamline data accessibility and usability. Drive innovation by adopting advanced analytics technologies and methodologies The Requirements This is an outstanding opportunity where you will be able to make an impact from day one. Working with an exceptionally talented group of people, you will have exposure to a wide variety of More ❯

Job Title: Graduate Data Engineer Location: Brighton, UK About Us: We are a dynamic and innovative technology consultancy based in Brighton. We specialise in providing cutting-edge solutions to our clients, enabling them to leverage data for strategic decision-making and operational efficiency. Our team is composed of talented professionals who are passionate about technology and … committed to delivering exceptional results. Job Description: Position Overview: We are seeking a highly motivated and enthusiastic Graduate Data Engineer to join our team. As a Graduate Data Engineer, you will be an integral part of our data engineering team, working on a variety of projects that involve data collection, transformation, and … analysis. This is an excellent opportunity for a recent graduate to kick-start their career in data engineering within a supportive and collaborative environment. Key Responsibilities: Assist in the design, development, and maintenance of data pipelines and ETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and More ❯

next level. We are based near Chester but have a global reach with customers all over the world. As we continue to scale, we are looking for a Data & BI Manager to lead the development of our internal data capabilities and deliver clear, actionable insights across the business. This is a key role for someone who … is excited by the opportunity to build a modern data stack from the ground up, connect business systems, and enable smarter decision-making across trading, marketing, product, and finance. Give this a watch: 🎬 https://www.tiktok.com/@sistersandseekers This role will report to our Directors, and is an exciting opportunity to join on a journey of expansion. … meet someone with: Strong experience with data integration tools such as Weld.app, Fivetran, Stitch, or Airbyte. Proficiency in SQL, data modelling, and data pipeline best practices. Demonstrated experience building dashboards and reports in Looker Studio, Power BI, Tableau, or equivalent. Strong understanding of eCommerce and marketing data ecosystems (e.g. Shopify, Klaviyo More ❯

We currently require the services of a Senior Data Analyst for a 6 Month Fixed Term Contract based in Nottingham. Job Overview This role will be responsible for providing up-to-date, accurate, and relevant data analysis to drive business decisions. The ideal person for this role thrives in fast paced environments with high levels of … our capability. A taste of what you'll be doing: Consultative Leadership : Spearhead initiatives with cross-functional stakeholders, employing a consultative approach to distil complex requirements into robust data/analytics approaches. Data Mastery : A trusted data expert, knowing what data is available, and which analytical technique is most relevant, ranging from … Deep expertise in SQL and Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (Databricks) and platforms (AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills with the ability to engage non-technical More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company … s reporting and analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. … You'll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear More ❯

UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems.To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain-ensuring scalability, quality, and performance.Develop data architectures and models (especially graph-based … that support seamless integration of infrastructure, operational data, and business intelligence.Define and enforce data solution standards, ensuring technical consistency and reuse across programmes.Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies.Manage stakeholder engagement to translate complex data requirements into clear, actionable solutions-communicating both technical More ❯

Data Architect ££105,000 - £115,000 GBP Hybrid WORKING Location: London, Central London, Greater London - United Kingdom Type: Permanent Data Architect Location: London (Hybrid) Salary: Up to £115,000 About our client: Our client is a global technology consultancy delivering transformation across data, digital, and infrastructure. Known for driving cutting-edge solutions across both … systems at national scale and pride themselves on technical depth, agile delivery, and a culture of collaboration. The Opportunity: This is a deeply technical role for a skilled Data Architect to join a high-performing engineering team focused on the design and implementation of robust data models within analytical and real-time domains. You'll work … across multiple consulting engagements with cross-functional teams, building modern, scalable data architecture from the ground up. Important: To be considered, you must currently hold active Security Clearance or have previously held Security Clearance . Additionally, you must have demonstrable experience delivering consulting engagements end to end - from discovery through to implementation - across client environments. What You'll More ❯

Are you a data developer with a passion for building robust, scalable integration solutions? We're looking for a Senior Data Integration Developer to join a forward-thinking digital team that's driving transformation through data. … This is a unique opportunity to step into a role originally designed for a niche integration specialist - now reimagined for someone with strong ETL, API, and data pipeline experience who's ready to innovate. Senior Data Integration Developer Location: Hybrid/North East England Salary: £47,000 - £54,000 The Opportunity You'll lead the … design, development, and optimisation of data integration flows across a complex digital ecosystem. Working with modern standards like REST and XML, you'll ensure seamless data exchange between internal systems and third-party platforms. You'll also collaborate closely with data platform teams to align on data standards and architecture. This role More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

Data Scientist 6 Month contract initially Based: Hybrid - Maximum of 3 days p/w - Wokingham Rate: £Market rates p/d (via Umbrella company) We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a … difference. We have a great opportunity for a highly experienced Data Scientist to join the team. We are seeking a skilled and experienced Data Scientist with expertise data scientists and LLM use cases and Data Engineering with Graph DB experience and Vector DB experience. As a Data Scientist, you will … datasets, building predictive models, and extracting meaningful insights to drive informed decision-making. Key Responsibilities: * Analyse and pre-process large-scale time series datasets, identifying relevant variables and data cleansing requirements. * Develop and implement advanced statistical models and machine learning algorithms to perform predictive analysis on time series data. * Build and validate forecasting models to predict future trends More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

arisen to join our Business Intelligence (BI) Team as a BI Technical Engineer at The Veterinary Defence Society (VDS). Youll play a pivotal role in shaping our data and reporting capabilitiessupporting informed decision-making, improving service delivery, and helping our teams make the most of data. This position combines data engineering, analytics, and stakeholder collaboration … offering an excellent opportunity to grow within a forward-thinking organisation. Key Responsibilities Design, develop, and maintain robust data pipelines into the data warehouse Create and maintain consistent business-wide data definitions and KPIs Develop interactive dashboards and reports to support data-driven decision-making Analyse data to uncover trends … patterns, and insights Collaborate with IT, Finance, Marketing, Compliance, and Operations teams Present insights and reports to senior leadership Identify and address data quality issues and improve data processes Contribute to project teams, ensuring data requirements are addressed from the outset Continuously improve BI tools and data engineering practices Required Skills & Experience More ❯