1 to 25 of 41 Data Pipeline Jobs in Bedfordshire

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

Job Description Description: We are actively seeking a Data Engineer responsible for designing, building, and maintaining infrastructure that supports data storage, processing, and retrieval. The role involves working with large data sets and developing data pipelines to transfer data from source systems to data warehouses, data lakes, and other storage and processing systems. The Data Engineer will collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the KR data architecture and data-driven solutions. Note: Due to federal security clearance requirements … time employment after the contract. Benefits include Medical, Dental, Vision, 401k with company matching, and life insurance. Rate: $80 - $86/hr W2 Responsibilities: Develop, optimize, and maintain data ingestion flows using Apache Kafka, Apache Nifi, and MySQL/PostgreSQL. Develop within AWS cloud services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena. Coordinate with data More ❯

Lead Data Scientist (Equity Only) - 1% Job Description: Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Responsibilities: Collaborate with cross-functional teams to understand business objectives and define analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for data extraction, transformation, and loading into AWS. Apply statistical and machine learning techniques for predictive and segmentation analyses. Develop KPIs and dashboards using Amazon QuickSight for data-driven decision-making. Perform … exploratory data analysis to uncover trends and insights. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements: Bachelor's or master's degree in Computer Science, Statistics, Mathematics, or related fields. Proven experience as a Data Scientist, especially with AWS analytics services. Strong proficiency in AWS tools More ❯

Lead Data Scientist (Equity Only) - Bedford Job Details Location: Bedford, United Kingdom Job Category: Other EU Work Permit Required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 About Luupli Luupli is a social media app 'in development' aimed at providing opportunities for diverse creators from marginalized communities. The platform will highlight their work and facilitate access to … social media opportunities. Job Description As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. Collaborating with cross-functional teams, you will develop data-driven solutions and provide actionable recommendations to shape data strategy and support business growth. Responsibilities Understand business objectives, define … data requirements, and set analytics goals. Develop data analysis strategies using AWS services such as Amazon Redshift, Athena, EMR, and QuickSight. Design and implement data pipelines and ETL processes for diverse data sources. Apply statistical and machine learning techniques for predictive, prescriptive analyses, clustering, segmentation, and pattern recognition. Identify key metrics, develop More ❯

employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Data Platform Engineer joining a team of committed data specialists. As our data strategy begins to take shape, we aim to become the most data driven airline in the world. To achieve this goal, we want to use our data to improve all … our business processes and that means allowing our teams to experiment and innovate as they deem fit. Within data platform engineering, this translates to building the frameworks and tooling data engineers, analysts and scientists utilise, enabling platform users to focus on value delivery Job Accountabilities Support the business in harnessing the power of data More ❯

employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Data Platform Engineer joining a team of committed data specialists. As our data strategy begins to take shape, we aim to become the most data driven airline in the world. To achieve this goal, we want to use our data to improve all … our business processes and that means allowing our teams to experiment and innovate as they deem fit. Within data platform engineering, this translates to building the frameworks and tooling data engineers, analysts and scientists utilise, enabling platform users to focus on value delivery Job Accountabilities Support the business in harnessing the power of data More ❯

employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Data Platform Engineer joining a team of committed data specialists. As our data strategy begins to take shape, we aim to become the most data driven airline in the world. To achieve this goal, we want to use our data to improve all … our business processes and that means allowing our teams to experiment and innovate as they deem fit. Within data platform engineering, this translates to building the frameworks and tooling data engineers, analysts and scientists utilise, enabling platform users to focus on value delivery Job Accountabilities Support the business in harnessing the power of data More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

Job Description: Location: Remote (United Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and … policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development More ❯

network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning, developing … and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, bedford col-narrow-left Client: Data Science Talent Location: bedford, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, luton, bedfordshire col-narrow-left Client: Data Science Talent Location: luton, bedfordshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Head of Data … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

pay them on their own terms. Role Summary You would be working closely with a wide array of people in our team and business – this will be from data engineers, governance and risk analysts through to our CFO to deliver actionable reporting. This would primarily service the finance team working with tools including DBT, Snowflake, PowerBI and no … an analytics champion - working with the wider analyst community to enable and upskill them to deliver insights to the business themselves. You will work with the head of data to disrupt and challenge existing processes across the operational side of the business, promote product analytics and deliver complex analysis that the wider analyst community is not able to … serve itself (such as predictive modelling and forecasting). As we are a small team there is an ask to support across the data and product landscape which includes: dabbling with AI, securing external data feeds and investigating innovative data focused product initiatives such as complex financial products for our customers. Skills: We need More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

Join to apply for the Senior Engineer – Data Pipeline Service Operations role at Oracle . Get AI-powered advice on this job and more exclusive features. Job Description This posting is for a Senior Engineer responsible for enabling 24x7 Operations in the Oracle Fusion Data Intelligence (FDI) product engineering organization. You will manage the uptime … of customer data pipelines that perform complex transformations. Customers rely on the data updated by these pipelines, which have downstream dependencies. Therefore, timely and accurate pipeline completion is crucial. You will also detect anomalies and implement mechanisms for early issue detection to prevent impact on timelines. Minimum Requirements UK Nationals eligible to support UK Government … Environments (hold valid UK Passport, UK Birth Certificate, or UK Naturalization Certificate) Skills and Experience BSc or higher in Computer Science/Engineering or equivalent 3+ years supporting data warehousing products, cloud/on-premise BI applications Proficiency in SQL/PL-SQL and debugging skills Experience troubleshooting network latency, analyzing logs Knowledge of ERP, HCM, CX applications More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Job Description - Data Technical Architect (15223) Location: Luton/Hybrid Company Overview: When it comes to innovation and achievement, there are few organisations with a better track record. Join us and you’ll be able to play a big part in the success of our highly successful, fast-paced business that opens up Europe so people can exercise … passengers a year, we employ over 13,000 people. It’s big-scale stuff and we’re still growing. Job Purpose: With a large investment into our big data platform (AWS, Databricks) and a huge amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the … way we store, analyze, and use data in a fast-paced organisation. You will join as a Data Technical Architect providing technical leadership to a data engineering team. You will play a major role in adhering to big data best practices while building and maintaining reliable data pipelines and products More ❯

Social network you want to login/join with: Data/Business Analyst, luton, bedfordshire col-narrow-left Client: Location: luton, bedfordshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 15 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Job Title: Data/Business Analyst Location: Remote (UK … based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, bedford col-narrow-left Client: Bytes Software Services Location: bedford, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯