301 to 325 of 3,504 Data Pipeline Jobs in England

Join to apply for the Ambitious Senior Azure Data Engineer role at Laminar Projects Join to apply for the Ambitious Senior Azure Data Engineer role at Laminar Projects Want to join a company that works on real world problems that make a difference to people’s lives? We are focused on changing how we build what … s around us, helping people to design and construct buildings and infrastructure. We’re seeking an ambitious data engineer who will be working on unique challenges that leverage the latest technologies. If you like solving complex business problems, we need you! Interested? Read on! We are Laminar Projects! We are an award winning consultancy that implements technology to … the core of everything we do, and where solving big challenges is part of the fun. The Role Purpose of the role We are currently looking for Azure Data Engineers to join our team. As a dynamic and tech-driven startup, curiosity and innovation are two of the main traits that we love about our applicants! Team The More ❯

is spent. We drive forward improved outcomes and efficiency in public services and make sure value for money is at the centre of decision-making through better evaluation, data and analysis. We advise on overall government policy on public sector pay and pensions, the biggest single driver of public spending. We collaborate with and directly support departments to … to share, improve and drive efficiency in the delivery of finance services. NOVA contains a full suite of functional design artefacts—Processes, KPIs, Business Glossary and a comprehensive Data Dictionary—to be adopted by all government organisations through the delivery of shared services and back-office systems. We are committed to enhancing finance performance by supporting the adoption … of the NOVA finance functional design and its data standards. Driving up finance data maturity, improving data architecture, and creating data integration solutions are central to our GFF 2030 Strategy and ambition for an Insightful and Data Driven finance function. The seventeen-person team works across a wide range of More ❯

Redbrain is a team full of tech-loving, results-driven data nerds who love helping retailers achieve kickass results (and we really mean that). Our people thrive on applying their tech smarts to the online retail space. We've been shaking up the online affiliate business for years, investing millions into technical solutions to transform online shopping … a highly skilled Business Intelligence (BI) Developer with expertise in Google BigQuery, Looker Studio, and PostgreSQL. The ideal candidate will be responsible for designing, developing, and optimising our data pipelines and reporting solutions to drive data-driven decision-making across the organisation. KEY RESPONSIBILITIES This role demands a deep understanding of data modelling, SQL … in BigQuery and PostgreSQL, along with a proven ability to create insightful and visually appealing reports and dashboards in Looker Studio. BigQuery Development & Optimization: Design and implement efficient data models in BigQuery to support business reporting needs. Write and optimise complex SQL queries for data extraction, transformation, and loading (ETL) processes. Improve query performance and reduce More ❯

Company Description Hitachi Solutions Europe is a global Digital, Data and Technology consultancy, Microsoft Gold partner and Cloud Services partner, specialising in end-to-end transformation. As a global consultancy firm working across the private and public sectors, we specialise in Dynamics 365 Business Applications, Power Platform, including Azure, Application Modernisation and Data & Analytics. Our highly … practices, ensuring delivery of scalable and efficient solutions. Define high-value business scenarios that can benefit from AI solutions (Machine Learning and Gen AI). Explore and analyse data from various sources and formats using tools such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, and Azure Machine Learning Implement data pipelines and workflows to automate … that coding, security and CI/CD best practices are followed. Communicate and present findings and recommendations to stakeholders and customers using tools such as Power BI, Azure Data Explorer, and Azure AI Services. Qualifications Key Competencies Demonstrable experience in data science, machine learning, or a related field. Proficiency in Python, SQL, or other programming languages More ❯

robust and scalable machine learning pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based on personality, potential, and enthusiasm … best practices and methodologies. • Experience with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep understanding of machine learning principles … algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including versioning, tracking, and model monitoring. • Ability to optimize and fine-tune ML models More ❯

robust and scalable machine learning pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based on personality, potential, and enthusiasm … best practices and methodologies. Experience with version control systems (e.g., Git). Familiarity with CI/CD tools and practices. Strong problem-solving and analytical skills. Understanding of data structures and algorithms. Ability to design and develop scalable, efficient, and maintainable software systems. Experience with microservice architecture, API development. Machine Learning (ML): Deep understanding of machine learning principles … algorithms, and techniques. Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proficiency in data preprocessing, feature engineering, and model evaluation. Knowledge of ML model deployment and serving strategies, including containerization and microservices. Familiarity with ML lifecycle management, including versioning, tracking, and model monitoring. Ability to optimize and fine-tune ML models More ❯

Join to apply for the Senior Software Engineer role at Supermercados Guanabara Get AI-powered advice on this job and more exclusive features. Role: Senior Software Engineer, Data Solutions Location: Hybrid (2 days on-site in Telford) Salary: £70,000 to £80,000 + Excellent Benefits Candidates must be eligible for UK Security Clearance The Opportunity We are … recruit a Senior Software Engineer into a critical delivery team. This is a unique opportunity to join a high-performing, mission-led environment focused on building robust, scalable data and analytics platforms for government and defence customers. This hybrid role offers the chance to work on-site in Telford just two days a week initially, with increased flexibility … over time. You'll be part of a team delivering impactful solutions in a secure and complex data landscape—an ideal environment for those who want to develop cutting-edge systems and contribute to national resilience. The Role As a Senior Software Engineer, you will play a pivotal role in the design, development, and operation of innovative front More ❯

robust and scalable machine learning pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based on personality, potential, and enthusiasm … best practices and methodologies. • Experience with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep understanding of machine learning principles … algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including versioning, tracking, and model monitoring. • Ability to optimize and fine-tune ML models More ❯

Expiry Date: 31.07.2025 col-wide Job Description: Power BI Developer Location: Hampshire/Hybrid Role Overview Our client is undergoing a major transformation and is building a new data team to drive business insights and support key functions like data migration and management. They seek a dynamic and skilled Power Business Intelligence Developer to develop, optimise … and manage data infrastructure, enabling data-driven decision-making. This role involves both business intelligence development and data engineering, including creating data models, dashboards, and reporting solutions. Additionally, you will contribute to the establishment of the gold medallion data layer for advanced analytics. Collaborating with SQL developers and system experts … you will ensure data is consumed efficiently and support end users by designing, developing, and deploying reports across the organisation. Reporting to the Head of Data, you will play a key role in executing the company’s data strategy, supporting the DX program, and enabling business growth. You will also champion Power BI within More ❯

Job Type: Contract Job Location: Wimbledon , UK Job Description : For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience of delivering complex pipelines will be significantly valuable … to how to maintain and deliver world class data pipelines. Knowledge in the following areas essential: Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases. AWS Cloud: Extensive experience with AWS services such as S3, Glue, Lambda, RDS, and IAM. IBM Skills: DB2, Datastage, Tivoli Workload Scheduler, Urban Code … for data governance, security, and data quality across our data platform. Ensure data is well-documented, accessible, and meets compliance standards. Pipeline Automation & Optimisation: Drive the automation of data pipelines and workflows to improve efficiency and reliability. Team Management: Mentor and grow a team of data engineers More ❯

services, we are looking to hire a mid-level Data Engineer (2+ years' experience) who has worked with Azure and Databricks , and can contribute immediately across pipeline development, categorisation, and optimisation for AI/ML use cases. You'll work with diverse datasets spanning prepaid, financial services, gambling, and payments, supporting business-critical decisions with high … key role in evolving epay's data architecture and ML-enablement strategies. In the first few months, you would have: Taken ownership of a data pipeline or transformation flow within Databricks and contributed to its optimisation and reliability. Worked across raw and curated datasets to deliver categorised and enriched data ready for analytics … they are part of a team and be willing to occupy various roles to allow the team to adjust work more effectively. Responsibilities of the role: Data Pipeline Development: Build and maintain batch and streaming pipelines using Azure Data Factory and Azure Databricks. Data Categorisation & Enrichment: Structure unprocessed datasets through tagging, standardisation, and More ❯

lineage, governance, and operational analytics as core platform features, ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements, making Workato the go-to orchestration solution for … to enhance data classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into Workato’s data services, driving continuous optimization and smarter decision-making. Advanced … ability to use customer research, data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. Educational Background Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related field. An MBA or advanced degree is a plus but not required. More ❯

Job Title: Technical Lead, Data Engineering - Financial Crime Solutions (Crypto) Overview: Overview Are you passionate about Data Engineering and eager to lead a team in a fast-paced, data-driven environment? Do you thrive on solving complex data problems and delivering impactful solutions? This is a great opportunity to join the team … behind Crypto Secure, a powerful risk assessment tool helping banks gain greater visibility of crypto spend, transaction volumes, and AML risk exposure. As a Technical Lead for our Data Engineering team, you will drive the direction of our data platform, leading a small team of engineers in a hands-on capacity, developing data pipelines … data security, performance, and scalability. - Advocate for clean, maintainable, and scalable data pipelines. - Drive CI/CD and automation best practices for data pipeline efficiency. All About You Technical & Engineering Skills - Extensive demonstrable experience in data engineering, with expertise in building scalable data pipelines and infrastructure. - Deep understanding of More ❯

Are you ready to shape the future of data in a global organisation? I’m looking for an experienced Data Engineer to join our client’s newly formed Data Team working on a greenfield project to build a modern, AI-ready data platform from the ground up. You’ll be based in … supportive - ideal for someone who thrives on building solutions from scratch. 🌐About the Project: You’ll play a key role in designing and implementing a brand-new Snowflake Data Warehouse hosted on Microsoft Azure , with a modern tech stack that includes: Snowflake for scalable cloud data warehousing dbt for data transformation and modelling Azure … Engineering or Data Development role Strong knowledge of Azure services , especially Azure Data Factory Hands-on experience (or strong understanding) of Snowflake , including pipeline development and data modelling Familiarity with dbt or similar transformation tools Experience working with both structured and unstructured data Understanding of data governance More ❯

actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Are you ready to shape the future of data in a global organisation? I’m looking for an experienced Data Engineer to join our client’s newly formed Data Team working on a greenfield … project to build a modern, AI-ready data platform from the ground up. You’ll be based in their modern Leeds office 4 days a week, working closely with a collaborative and ambitious team. The environment is fast-paced, innovative, and supportive - ideal for someone who thrives on building solutions from scratch. About the Project: You’ll play … Engineering or Data Development role Strong knowledge of Azure services , especially Azure Data Factory Hands-on experience (or strong understanding) of Snowflake , including pipeline development and data modelling Familiarity with dbt or similar transformation tools Experience working with both structured and unstructured data Understanding of data governance More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … scaling fast and now looking for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, you’ll be the go-to person. You More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest challenges. Theyve built a next … theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, youll be the go-to person. You'll More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … data warehouses using Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data is properly ingested More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … data warehouses using Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data is properly ingested More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … data warehouses using Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data is properly ingested More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

Social network you want to login/join with: We are on the lookout for a Data Engineer to join a dynamic, forward-thinking company. You’ll will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. The … ultimate goal is to make data accessible so that stakeholders can use it to evaluate and optimise their performance. What you’ll be responsible for: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified … including design patterns innovation, data lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources into cohesive meaningful and valuable More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯