1 to 25 of 142 Permanent Data Pipeline Jobs in the UK excluding London

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job … Advise on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements. Contribute towards the … support, maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance. Responsibilities Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to more »

Your new company You will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. … Your new role As a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data … of database design and development, data management and systems integration Knowledge of automation testing as part of a data engineering pipeline Knowledge of software development approaches, disciplines and best practice Awareness of how data is used by Analysts, Data Scientists and more »

Senior Data Engineer (Azure/Data Lake/Databricks/Data Factory/SQL Data Warehouse/SQL Database) A leading energy company in the low-carbon sector is looking for a Senior Data Engineer . Base Location: Flexible, with … are also possible. Working Pattern: Permanent | Full Time | Hybrid (1 day at the office per week) What is the Role? As a Senior Data Engineer , you'll develop and optimize data pipelines on the Microsoft data stack, particularly the new Fabric data platform. You'll collaborate with data architects, developers, and stakeholders to drive data-driven decision-making. Reporting to the Lead Data Engineer, you'll be part of a team delivering innovative data solutions across the business. Key Responsibilities: Design and more »

Lead Database & ETL Developer looking for an exciting opportunity? Our Technology team at Southern Housing is searching for someone who can expertly manage data across our technology estate, optimising and developing source data systems to the highest quality standards. In this role, you'll take full … ownership of data management, ensuring its consistency throughout our ecosystem. Collaboration is key, as you will work alongside the data community of practice/guild to uphold consistent data practices and set the bar for organisational best practice and lead fellow Data … processes like Data Integration, Governance, Metadata Management Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies. Designing source data and data management principles. Demonstrated success more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Type: 6+ month and possibility of extension Looking for an enthusiastic Spark Scala Engineer who will be responsible for designing, building, and maintaining data pipelines using Apache Spark and Scala. This includes tasks like: Extracting data from various sources (databases, APIs, files) Transforming and cleaning the … data … Loading the data into data warehouses or data lakes (eg, BigQuery, Amazon Redshift) Automating the data pipeline execution using scheduling tools (eg, Airflow) Data analysis and modelling: While the primary focus might be on data engineering, some more »

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. Ensure more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … engineering team. l This role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Data Engineer £50k - £60k + 15% Bonus Letchworth/Hybrid (a couple of days onsite per month) Our client is currently searching for a Data Engineer to join their team. As a Data Engineer, you will assist in establishing a new data platform for our client, working with other parts of the business to migrate data from legacy systems and establish pipelines to move data from new applications to the data platform while adopting standard best practices. In your first few weeks in this … Data Engineer role, you can expect to: Participate in data development processes, data modelling, data analysis and synthesis and be responsible for ingesting data from different sources and transforming the data Be responsible for the Tableau Platform setup more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

About Us: iOpt Ltd is a IoT technology company using sensors to capture property data to help build smart solutions for sustainable and efficient living. The company works with a range of clients across different sectors. We are an innovative and rapidly growing company and we now require … a talented and motivated Data Analyst to join our team and contribute to our exciting journey. Job Purpose This role has been created to support the growth in our Data team in iOpt. You will be responsible for making sure we have a strong understanding of … Project Management: Apply knowledge and experience of project management methodologies. Utilize appropriate tools and techniques to contribute effectively to project success. Data Pipeline Development: Design, build, test, and deploy data pipelines to support analytic products. Ensure the efficiency and reliability of data flows more »

Data Engineer Manchester Hybrid (2-3 days per week in the office) Salary: Flexible dependent on experience Discretional Bonus Structure Private Medical/Dental insurance/Nursery Scheme A global law firm is seeking a talented Data Engineer to join its team and help shape its … data landscape. The role involves driving data projects from start to finish. The be successful in the role you will need strong experience with SQL and Azure Data Lake. Key Responsibilities of the Data Engineer: Reviewing and improving existing systems and data pipelines. Developing and deploying data pipelines in Azure. Integrating data from various sources. Ensuring data services are automated, reliable, and secure. Enhancing data efficiency and quality. SQL normalization. Additional Responsibilities as a Data Engineer: Cleaning and structuring data more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of more »

Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in … a fast paced and dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills … An appreciation for the big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer … Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements … into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile more »