376 to 400 of 829 Data Pipeline Jobs in England

you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Data Scientist/Senior Data Scientist Join British Airways as a Data Scientist in our cutting-edge Operations Decision Support (ODS) product team. This full-stack … role sits at the heart of our transformation, combining data science, machine learning, and optimisation to build industrialised decision-support software. If you're passionate about solving real-world problems through intelligent, data-driven solutions and thrive in a collaborative, agile environment-this is your opportunity to make a real impact. What you'll do: Design … with software engineering teams, product & change teams to turn their models into industrialized products that are used by the airline every day to make better decisions. Build robust data pipelines, automate data cleaning, and deliver scalable, production-grade Python code using best practices such as typing, testing, and modular design. Integrate models into orchestration frameworks (e.g. More ❯

of 7, this newly created role is pivotal in you owning the Databricks strategy and how it's used to innovate across their brands. Youll design and develop data frameworks, power real-time data pipelines, and create data services that deliver actionable insights to their customer base. You will create and own a Databricks … product is aligned with business goals and leveraged to maximize value. Youll also own and be responsible for all Databricks-related activities, acting as the architect across the Data Engineering, Data Analytics, and Data Science teams. Your Profile A background in data architecture Experience of unity catalogue Advanced knowledge of Azure Databricks More ❯

Azure Data Engineer – FinTech | Azure | Data |12-month FTC London – Remote in office 4 times in a fortnight (flexible) Salary & Benefits – Up to £75,000 + 8 to 12% Pension, Life Assurance, Health & Dental Insurance, 25+ days annual leave + other flexible benefits Azure Data factory | Logic Apps | Azure Batch | Azure Functions | Azure DevOps … I’m working with a pioneering organisation in the UK fintech landscape who are on the hunt for an experienced Azure Data Engineer to join their fast-moving Intelligent Automation Team.This isn’t your average data gig. You’ll be building and scaling Azure-native pipelines that power the next phase of AI-led transformation in … financial services. If you're passionate about clean architecture, impactful automation, and cutting through the noise with robust cloud data solutions — you’ll thrive here.This role is a 12 month FTC and would suite someone who wants to dive into a new challenge for the next year or so.Role as an Azure Data Engineer: Crafting and More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

Junior Data Engineer - London (Hybrid) - SC Eligible - £50,000 A leading digital consultancy is looking to hire a Junior Data Engineer to support the expansion of its Data & AI team. This is an excellent opportunity for someone with 0-3 years of experience (or a strong academic background) to gain hands-on exposure to … cloud technologies and grow in a collaborative, fast-paced environment. What You'll Be Doing: Building and maintaining scalable data pipelines across Azure and GCP Working with tools such as Azure Data Factory, Snowflake, BigQuery, and Cloud Functions Supporting data warehousing and integration across diverse industry projects Collaborating with data professionals and … contributing to cross-functional delivery teams Assisting in reporting and data visualisation (Power BI/Looker - nice to have) What We're Looking For: 0-3 years of experience in a data engineering or similar role (graduates welcome) Proficiency in SQL and Python Exposure to any of the following: Azure Data Factory GCP BigQuery More ❯

week in Surrey office 8 Month Contract Upto £340 p/day Inside IR35 About the Role We are looking for a commercially minded and technically capable Senior Data Analyst to join our growing analytics team. This high-impact role involves delivering insights across digital, commercial, and operational areas by working with a variety of customer, sales, behavioural … and market data. You’ll work cross-functionally with stakeholders in Marketing, UX, Product, Logistics, and Finance, as well as with Data Engineers to enable scalable, data-driven decision making across the organisation. Key Responsibilities Analyse data from multiple internal systems including sales platforms, customer data sources, logistics, and financial planning tools … digital marketing strategy, sales trends, stock movement, and operational efficiency Support UX and behavioural analysis using tools that provide heatmaps, session replays, and user journey insights Collaborate with Data Engineers to access data via APIs, define requirements, and help shape data pipelines and modelling Build and maintain clear, user-friendly dashboards and reports in More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide More ❯

Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … achieving these. Skills Required for the Role Essential: Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide More ❯

Data Engineer - Generative AI & Secure Data Platforms South West or South East England (Hybrid - 2-3 days onsite) Up to £55k + Paid Overtime + Bonus + Benefits British Citizens Only | SC Clearance Required 37 hours a week. That's the baseline. But when the mission demands more, you're paid for every extra hour-because … your time matters. Imagine joining a team where your data engineering skills help shape the future of secure AI innovation. This isn't just about building pipelines-it's about enabling intelligent systems that support national resilience and technological advancement. You'll be part of a growing international team working on next-gen data platforms, with … a focus on generative AI, NLP, and secure data exchange. Your work will directly support internal customers across a high-trust, high-impact organisation. What You'll Be Doing Evaluate, design, and maintain resilient, secure data pipelines Collaborate with internal teams to optimise and safeguard datasets Ensure compliance with strict data governance and quality More ❯

Data Engineer - Generative AI & Secure Data Platforms South West or South East England (Hybrid - 2-3 days onsite) Up to £55k + Paid Overtime + Bonus + Benefits British Citizens Only | SC Clearance Required 37 hours a week. That's the baseline. But when the mission demands more, you're paid for every extra hour-because … your time matters. Imagine joining a team where your data engineering skills help shape the future of secure AI innovation. This isn't just about building pipelines-it's about enabling intelligent systems that support national resilience and technological advancement. You'll be part of a growing international team working on next-gen data platforms, with … a focus on generative AI, NLP, and secure data exchange. Your work will directly support internal customers across a high-trust, high-impact organisation. What You'll Be Doing Evaluate, design, and maintain resilient, secure data pipelines Collaborate with internal teams to optimise and safeguard datasets Ensure compliance with strict data governance and quality More ❯

ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools, and … ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools, and … mentor, and grow an AI/ML team as we scale beyond our seed round. Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in More ❯

and experience talk with your recruiter to learn more. Base pay range $65,000.00/yr - $95,000.00/yr London (in person) At Etleap, were redefining how data teams build and manage data pipelines. Our no-code/low-code ETL platform allows seamless integration of data from any source whether databases, applications … or files into lakehouses like Snowflake, Databricks, and Redshift. With pipelines that just work and features like advanced data transformation using dbt Core and end-to-end pipeline observability, were focused on making robust data pipelines accessible to everyone. London (in person) At Etleap, were redefining how data teams build and manage data … or files into lakehouses like Snowflake, Databricks, and Redshift. With pipelines that just work and features like advanced data transformation using dbt Core and end-to-end pipeline observability, were focused on making robust data pipelines accessible to everyone. We are looking to add senior engineers to our core engineering team to build the infrastructure More ❯

by providing them with cutting-edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology … team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven models, and engineering robust data and analytics pipelines, to unlock actionable insights from our … vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across sales, trading, and technology. We are looking for a proactive individual with a practical and pragmatic attitude, ability to build consensus, and work both collaboratively and More ❯

by providing them with cutting-edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology … team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven models, and engineering robust data and analytics pipelines, to unlock actionable insights from our … vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across sales, trading, and technology. We are looking for a proactive individual with a practical and pragmatic attitude, ability to build consensus, and work both collaboratively and More ❯

by providing them with cutting-edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology … team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven models, and engineering robust data and analytics pipelines, to unlock actionable insights from our … vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across sales, trading, and technology. We are looking for a proactive individual with a practical and pragmatic attitude, ability to build consensus, and work both collaboratively and More ❯

Location: 1 Braham Street, London, United Kingdom Available locations: Belfast, Birmingham, Glasgow, Leeds, Bristol, Manchester or London Working Style: 3 days a week in office, 2 days anywhere Data is a vital part of our business and with your help, we can improve the services that we provide to our customers through engineering excellence of our data products. You'll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wifi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera. We are hiring 2 Lead Data Engineers to join our brilliant team. When you join us as … a Lead Data Engineer, you'll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment. As a team we believe in the agile principles of openness, transparency and continuous More ❯

few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python … and .NET Experience in implementing data solutions adhering to regulatory requirements and security measures Experience with Python with libraries such as Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

Senior Data Scientist - Product Analytics London, England Intercom is the AI Customer Service company on a mission to help businesses provide incredible customer experiences. Our AI agent Fin, the most advanced customer service AI agent on the market, lets businesses deliver always-on, impeccable customer service and ultimately transform their customer experiences for the better. Fin can also … Driven by our core values, we push boundaries, build with speed and intensity, and consistently deliver incredible value to our customers. What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom use data and insights to drive evidence based decision-making. We're a team of data scientists and product researchers … who use data - both big and small - to unlock actionable insights about our customers, our products and our business. We generate insights that build customer empathy, drive product strategy and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data and surfacing actionable More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£40,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

capable and insight-driven Senior Workforce Analytics Analyst to join our growing HR Reporting & Analytics team. In this role, you'll focus primarily on building out our People Data Model using Workday Prism Analytics and Power BI, helping to unlock the full potential of our workforce. You'll be instrumental in shaping how we use people data … planning, and performance. This is an excellent opportunity for someone with strong technical foundations to deepen their expertise in Prism Analytics and BI tools within a forward-thinking, data-driven environment. Why Join CMS? Work with leading-edge analytics tools such as Workday Prism Analytics and Power BI in a supportive, data-literate organisation. Develop your … expertise in modern data pipelines and reporting platforms, with support for professional growth and training. Be part of a collaborative analytics team that plays a critical role in shaping the firm's people strategy and operational insight. Gain exposure to a wide range of data initiatives across workforce planning, HR operations, and strategic projects. About You More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯