26 to 50 of 6,212 Data Pipeline Jobs in England

Join to apply for the Senior Data Engineer role at Gamingtec 2 weeks ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at Gamingtec Get AI-powered advice on this job and more exclusive features. Role Overview As a … for real-time events using Kafka and related technologies; Create data validation processes to ensure data quality and integrity; Optimise pipeline performance and resource utilisation. Data Modeling & Transformation Implement dimensional data models following best practices and team standards; Develop standardised transformations … transformation frameworks; Hands-on experience with AWS data services (Redshift, S3, Glue, Lambda); Proficiency with Python for data processing and pipeline development; Experience with workflow orchestration tools like Airflow or similar; Knowledge of streaming data technologies such as Kafka; Familiarity with infrastructure-as More ❯

Join to apply for the Lead Data Engineer/Architect role at Insurance Office of America 1 day ago Be among the first 25 applicants Join to apply for the Lead Data Engineer/Architect role at Insurance Office of America Get AI-powered advice on … of data platforms, including data lakes, data warehouses, and other data processing systems. Data Pipeline Development: Designing, building, and maintaining robust data pipelines for data ingestion, transformation, and loading. Assemble large, complex data … optimizing data delivery, and assisting in re-designing infrastructure for greater scalability, etc. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the IT operations, automation and More ❯

the platform, and driving its further development. This role requires proficiency in data engineering, data modelling, and data pipeline orchestration, with a proven track record of working with Azure-specific data platform tools and technologies. Strategic and forward-thinking capabilities, as … & Analytics team. Oversee the team’s Agile processes including sprints, ask prioritisation and issue resolution Define best practices for data pipeline design, development, and maintenance. Coordinate with the solution architect to ensure platform architecture meets current and future requirements. Act as a point of escalation … and analytics. Platform Administration and Optimization: Monitor and optimize Azure Synapse Analytics performance, ensuring cost efficiency and resource utilization. Implement monitoring and alerting for pipeline performance, failures, and resource consumption. Suggest and implement automation for repetitive tasks using tools like Azure Logic Apps, Power Automate, or custom scripting. Collaborate More ❯

Data Quality & Governance Manager - Leeds - Hybrid - £70k - £75k My client are greenfielding an entire data practice! The chosen candidate for this role will lead efforts to ensure data across the organization is consistent, reliable, and governed effectively. You’ll develop and implement frameworks for … data quality, governance, and master data management. You will ensure the effective management of data warehouse architecture, pipelines, and support data migrations using a combination of Snowflake and Microsoft Azure technologies. Salary and Benefits Competitive salary of £70k - £75k (DOE) Hybrid working … bank holidays (rising to 27 with service) Discretionary bonus of up to 10% Private medical care And many more Role and Responsibilities Lead Data Governance Strategy : Develop and execute the overall data governance and quality strategy, aligned with business needs and global standards. Data More ❯

the U. S. and United Kingdom. In California, dba IOA Insurance Services. (#0E67768) For more information, visit www.ioausa.com. Job Description: Position Title: Lead Data Engineer/Architect Department: Enterprise Systems Reports To : Director, Data Analytics Supervises : N/A Classification: Full Time, Permanent JOB SUMMARY : The … of data platforms, including data lakes, data warehouses, and other data processing systems. • Data Pipeline Development: Designing, building, and maintaining robust data pipelines for data ingestion, transformation, and loading. • Assemble large, complex data … optimizing data delivery, and assisting in re-designing infrastructure for greater scalability, etc. • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. • Work with stakeholders including the IT operations, automation and More ❯

UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner … in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in … the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that More ❯

support operational needs for our clients and deliver a seamless experience to customers in the moments that matter. We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications … and SQL. Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases. Deep experience with ETL processes and data pipeline development. Strong understanding of data warehousing concepts and best practices. Experience with cloud platforms such as AWS and Azure. Excellent problem-solving … bonus. Tools and Applications Programming languages and tools: Python, SQL. Big data technologies: Hadoop, Spark, NoSQL databases. ETL and data pipeline tools: AWS Glue, Airflow. Cloud platforms: AWS, Azure. Data visualization tools and data modeling software. Version control systems and collaborative More ❯

Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data … Deep understanding of SQL and analytical data warehouses (Snowflake, Redshift preferred) with proven experience implementing ETL/ELT best practices at scale. Pipeline Management : Hands on experience with data pipeline tools (Airflow, dbt) and strong ability to optimise for performance and reliability. API Development … to ship medium features independently while contributing to the team's overall objectives. What you’ll be doing in the role Data Pipeline Development : Build and maintain robust data pipelines from internal databases and SaaS applications ensuring timely and accurate data delivery. Data More ❯

Join to apply for the Data Engineer role at Somerset Bridge Group Join to apply for the Data Engineer role at Somerset Bridge Group Get AI-powered advice on this job and more exclusive features. Application Deadline: 27 June 2025 Department: [SBSS] Enterprise Data Management Location: Newcastle Compensation: £55,000 - £68,500/year Description We're building something special — and we need a talented Data Engineer to help bring our Azure data platform to life. This is your chance to work on a greenfield Enterprise Data … Engineer will contribute to cost optimisation, governance, and automation within Azure’s modern data platform. Key Responsibilities Data Pipeline Development – Design, build, and maintain scalable ELT pipelines using Azure Databricks, Azure Data Factory (ADF), and Delta Lake to automate real-time More ❯

Advisory : Combining architectural assessments with platform selection guidance, providing vendor-independent recommendations for optimal data ecosystem design. Data Migration, Integration & Pipeline Support : Providing strategic guidance on data migration and integration approaches, logical pipeline design, and data flow orchestration, based on … understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. … Ability to bridge technical and business domains, translating between data practitioners and business stakeholders. Experience in owning, building, and maintaining a sales pipeline for D&AI services through prospecting and farming existing account relationships. Desirable Qualifications: Sector Experience – Significant experience in one or more of the following More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of … parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to … data pipelines, ensuring data quality, data integrity and data security. Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality. Implement and enforce data security best practices, including role-based access control (RBAC More ❯

of Data and Enterprise architecture to build data engineering process in AWS using modern tech stack. Responsibilities Data Pipeline Development : Design, build, and maintain scalable data pipelines to ingest, process, and store large sets of financial data from various … pipelines and integrations. Documentation & Best Practices : Maintain clear, well-organised documentation for all data engineering projects, including data pipeline processes, cloud infrastructure, and codebase. Data Governance & Security : Implement and enforce data governance policies and security practices, ensuring compliance with … financial regulations and protecting sensitive financial data. Troubleshooting & Optimisation : Monitor and troubleshoot data pipeline performance, addressing bottlenecks or issues promptly to ensure smooth data flow and operation. Requirements Several years of experience in data engineering, preferably in the financial services or similar regulated More ❯

Data Analyst | S2 | CDO | Milton Keynes Country: United Kingdom WHAT YOU WILL BE DOING Site Based Contract with a Hybrid Working Pattern. Join our community. We have an exciting opportunity within the Data Acquisition/Ingestion Engineering team for a mixed role with Agile and Data Analyst capabilities, high-skilled in AWS Cloud and Big Data work environments, autonomous, flexible … and committed. You're responsible for the end-to-end Data Ingestion, Acquisition and anonymisation to the Santander AWS and Hadoop lakes (Pipeline configuration, with a big focus on Data ingestion, Streaming, data transformation, integration, data exploitation, data modelling More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

bit.bio Cambridge, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Data & AI Engineer role at bit.bio bit.bio Cambridge, England, United Kingdom 2 days ago Be among the first 25 applicants Join to apply for the Senior Data … highly translational biotech research where you will be directly contributing to cutting edge discoveries. You will support the development of a data pipeline for continuous ingestion of new datasets from external/internal sources into the relevant databases so that it may be integrated into decision making … SQL and NoSQL databases, including Postgres and Cassandra. Experience designing and implementing knowledge graphs for data integration and analysis. Data pipeline and workflow management tools: Luigi, Airflow, etc. AWS cloud services: EC2, S3, Glue, Athena, API Gateway, Redshift. Experience with object-oriented and scripting languages More ❯

Job Title: AI Research & Data Scientist The WOW Adventure Ltd, acclaimed as the UK's best SEO company , is expanding its horizons and actively seeking skilled AI Research & Data Scientists to join our esteemed team. If you are passionate about Artificial Intelligence, Data Science … work alongside the UK's best SEO experts, this is your opportunity to contribute to ground-breaking projects and shape the future of data-driven innovation. AI Research & Data Scientists Key Responsibilities: Leverage your expertise in Artificial Intelligence, Machine Learning, and Big Data to … conduct advanced data analysis and generate actionable insights. Develop and implement innovative data structures, data engineering, and data modeling solutions. Utilize neural networks and deep learning techniques for predictive analytics and business intelligence. Drive data governance and ensure data More ❯

Office Based Position - Cambridge, UK with hybrid working available Your role in our team: At bit.bio, we’re setting our sights on embedding data and AI into our technology stack in new and innovative ways. We are looking for an experienced and passionate Senior Data & AI … highly translational biotech research where you will be directly contributing to cutting edge discoveries. You will support the development of a data pipeline for continuous ingestion of new datasets from external/internal sources into the relevant databases so that it may be integrated into decision making … SQL and NoSQL databases, including Postgres and Cassandra. Experience designing and implementing knowledge graphs for data integration and analysis. Data pipeline and workflow management tools: Luigi, Airflow, etc. AWS cloud services: EC2, S3, Glue, Athena, API Gateway, Redshift. Experience with object-oriented and scripting languages More ❯

Join to apply for the Data Engineer role at Natobotics Join to apply for the Data Engineer role at Natobotics Get AI-powered advice on this job and more exclusive features. Design, develop, and maintain ETL processes to move data from source systems to … and workflows to meet business requirements. Create and maintain documentation for data systems, pipelines, and processes. Monitor and troubleshoot data pipeline performance issues and resolve them promptly. Assist in the migration and integration of data from legacy systems into Snowflake, and other strategic … and workflows to meet business requirements. Create and maintain documentation for data systems, pipelines, and processes. Monitor and troubleshoot data pipeline performance issues and resolve them promptly. Assist in the migration and integration of data from legacy systems into Snowflake, and other strategic More ❯

Social network you want to login/join with: Head of Data Engineering & Analytics, slough col-narrow-left Client: Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Company Description … ideas and commitment to excellence, we want you to join us. To learn more visit alti-global.com. Job Description & Overview The Head of Data Engineering & Analytics will lead the development and execution of AlTi’s enterprise data engineering strategy, enabling the capture, transformation, storage and delivery … version control and system observability for data pipelines. Establish metrics and KPIs and identify and deploy tools to measure data pipeline health, data quality, timeliness and accuracy, team performance, cost-effectiveness, and business impact. Actively mentor and grow talent within the team while More ❯

status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Azure Data Engineer Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success … The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient … data pipelines, ensuring data quality, data integrity and data security. Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality. Implement and enforce data security best practices, including role-based access control (RBAC More ❯

where you can grow professionally, in adiverse and inclusive workplace that rewards your contribution. Job Description Summary : We are seeking a highly skilled data architect to join our dynamic team. As a senior data architect, you will be responsible for designing, implementing and maintaining the AWS … cloud infrastructure. You will plan a crucial role in architecting a scalable, reliable and efficient data solutions to support our business objectives. Responsibilities Design, develop, and maintain the data lake house architecture on AWS using best practices and industry standards. Implement data labelling strategy … and principals as required by Data Governance and Information Security. Design and implement robust ETL/ELT processes to extract, transform and load data from various sources into the data lake ensuring data quality and integrity. Ensure data quality, reliability More ❯